Curriculum Vitae

EDUCATION

Ph.D. in Computer Science (since November 2021) 

University of Hertfordshire, UK

Thesis Title: Reinforcement Learning and Information Theory for Robotics Manipulation  

Supervisors: Dr. Nicola Catenacci-Volpi and Prof. Daniel Polani

Master of Science (MSc) in Computer Science (by Research) (August 2018 – July 2021)  

Sunway University, Malaysia and Lancaster University, UK   (Joint Degree Programme) 

Thesis Title: Multi-agent Deep Q-network for Traffic Signal Control under Rainfall: A Case Study on Sunway City, Malaysia

Supervisors: Prof. Kok-Lim Alvin Yau and Dr. Yeh-Ching Low 

Bachelor of Science in Electronics (BS-ES) (January 2014 - December 2017) [First Class Degree] 

Isra University, Hyderabad, Pakistan

Final Year Project: Robotic Arm Controlling using Hand Gestures 

Supervisor: Mr. Muhammad Nabeel Khan 

EXPERIENCE

Doctoral Researcher (since November 2021)

Adaptive Systems Research Group, University of Hertfordshire, UK 

Research Activities: Conducting research on reinforcement learning and information theory approaches for robotics manipulation. 

Research Assistant (August 2018 - December 2020

PG Research Lab, Sunway University, Malaysia

Research Activities: Carried my Masters thesis on deep reinforcement learning-based traffic signal control and evaluate

the performance via simulations in traffic simulator SUMO.

RESEARCH INTERESTS

AWARDS & ACHIEVEMENTS

SHORT COURSES & CERTIFICATIONS

TECHNICAL SKILLS

Programming Languages: C/C++, Python, Assembly, MATLAB, CUDA programming

Deep Learning Tools/Frameworks: PyTorch, TensorFlow

Simulator: SUMO for Traffic Simulation, Packet Tracer for Network Topology Simulation

Others: NI Multisim, Arduino Programming, LaTeX, MS Office, MS Visio