Embedded Files
EDUCATION
EDUCATION
Ph.D. in Computer Science (since November 2021)
Ph.D. in Computer Science (since November 2021)
University of Hertfordshire, UK
Thesis Title: Empowerment-Driven Reinforcement Learning for Tool Use in Sparse-Reward Environments
Supervisors: Dr. Nicola Catenacci-Volpi and Prof. Daniel Polani
Master of Science (MSc) in Computer Science (by Research) (August 2018 – July 2021)
Master of Science (MSc) in Computer Science (by Research) (August 2018 – July 2021)
Sunway University, Malaysia and Lancaster University, UK (Joint Degree Programme)
Thesis Title: Multi-agent Deep Q-network for Traffic Signal Control under Rainfall: A Case Study on Sunway City, Malaysia
Supervisors: Prof. Kok-Lim Alvin Yau and Dr. Yeh-Ching Low
Bachelor of Science in Electronics (BS-ES) (January 2014 - December 2017) [First Class Degree]
Bachelor of Science in Electronics (BS-ES) (January 2014 - December 2017) [First Class Degree]
Isra University, Hyderabad, Pakistan
Final Year Project: Robotic Arm Controlling using Hand Gestures
Supervisor: Mr. Muhammad Nabeel Khan
EXPERIENCE
EXPERIENCE
Visiting Lecturer (since January 2025)
Visiting Lecturer (since January 2025)
Department of Computer Science
University of Hertfordshire, UK
Doctoral Researcher (since November 2021)
Doctoral Researcher (since November 2021)
Adaptive Systems Research Group, University of Hertfordshire, UK
Research Activities: Conducting research on intrinsic motivation based approaches for reinforcement learning.
Research Assistant (August 2018 - December 2020)
Research Assistant (August 2018 - December 2020)
PG Research Lab, Sunway University, Malaysia
Research Activities: Carried my Masters thesis on deep reinforcement learning-based traffic signal control and evaluate
the performance via simulations in traffic simulator SUMO.
RESEARCH INTERESTS
RESEARCH INTERESTS
Artificial Intelligence
Reinforcement Learning
Cognitive and Behavioral Aspects of Tool Use and Affordances
Information-Theoretic Machine Learning (e.g., Empowerment, Mutual Information)
Intelligent Systems & Applied Deep Learning
Intelligent Transportation System
Robotics
AWARDS & ACHIEVEMENTS
AWARDS & ACHIEVEMENTS
Awarded Best Paper Finalist, IEEE ICDL 2023.
Achieved fully-funded PhD scholarship from UK Research and Innovation (UKRI).
Achieved Jeffery Cheah foundation research scholarship for graduate studies from Sunway University, Malaysia.
Achieved research grant worth RM27,500 for graduate studies from Sunway University, Malaysia.
Achieved partially funded Scholarship for undergraduate studies from Isra University, Pakistan.
SHORT COURSES & CERTIFICATIONS
SHORT COURSES & CERTIFICATIONS
IELTS | British Council
Introduction to Artificial Intelligence (AI)
AI for Everyone
Python for Data Science and AI
What is Data Science?
Microsoft Office Specialist
Cisco Certified Network Associate (Training)
Fiber Optics Network Design
Social & Behavioral Research
Students conducting no more than minimal risk research
CPISM (Certificate of Proficiency in Information Systems Management)
TECHNICAL SKILLS
TECHNICAL SKILLS
Programming Languages: Python, C++, Embedded C, Bash
ML Libraries: PyTorch, TensorFlow, RLlib, NumPy, joblib, Numba
Simulation: MiniHack, SUMO, OpenAI Gym, Packet Tracer
Embedded Systems: Arduino, Flex Sensors, Wireless Modules, Sensor-actuator integration, Embedded real-time control.
Others: CUDA, Linux shell, PyCharm, VSCode, LaTeX, MS Office
Page updated
Google Sites
Report abuse