Embedded Files
EDUCATION
EDUCATION
Ph.D. in Computer Science (November 2021 - February 2026)
Ph.D. in Computer Science (November 2021 - February 2026)
University of Hertfordshire, UK
Thesis Title: Object Empowerment: An Information-Theoretic Approach to Intrinsically Motivated Reinforcement Learning of Tool Use
Supervisors: Dr. Nicola Catenacci-Volpi and Prof. Daniel Polani
Master of Science (MSc) in Computer Science (by Research) (August 2018 – July 2021)
Master of Science (MSc) in Computer Science (by Research) (August 2018 – July 2021)
Sunway University, Malaysia and Lancaster University, UK (Joint Degree Programme)
Thesis Title: Multi-agent Deep Q-network for Traffic Signal Control under Rainfall: A Case Study on Sunway City, Malaysia
Supervisors: Prof. Kok-Lim Alvin Yau and Dr. Yeh-Ching Low
Bachelor of Science in Electronics (BS-ES) (January 2014 - December 2017) [First Class Degree]
Bachelor of Science in Electronics (BS-ES) (January 2014 - December 2017) [First Class Degree]
Isra University, Hyderabad, Pakistan
Final Year Project: Robotic Arm Controlling using Hand Gestures
Supervisor: Mr. Muhammad Nabeel Khan
EXPERIENCE
EXPERIENCE
Postdoctoral Researcher (since May 2026)
Postdoctoral Researcher (since May 2026)
ENCYRCLE Project, Swansea University, UK
Research Activities: Conducting research on artificial intelligence and reinforcement learning for autonomous decision-making and adaptation in complex environments, with applications to cyber-physical and automotive systems. The project is conducted in collaboration with Thales.
Visiting Lecturer (since January 2025)
Visiting Lecturer (since January 2025)
Department of Computer Science
University of Hertfordshire, UK
Doctoral Researcher (November 2021 - February 2026)
Doctoral Researcher (November 2021 - February 2026)
Adaptive Systems Research Group, University of Hertfordshire, UK
Research Activities: Conducting research on intrinsic motivation based approaches for reinforcement learning.
Research Assistant (August 2018 - December 2020)
Research Assistant (August 2018 - December 2020)
PG Research Lab, Sunway University, Malaysia
Research Activities: Carried my Masters thesis on deep reinforcement learning-based traffic signal control and evaluate
the performance via simulations in traffic simulator SUMO.
RESEARCH INTERESTS
RESEARCH INTERESTS
Artificial Intelligence
Reinforcement Learning
Autonomous Decision-Making and Adaptive Systems
Intrinsic Motivation and Information-Theoretic Learning
Tool Use, Affordances, and Embodied Intelligence
Cyber-Physical and Autonomous Systems
Intelligent Transportation and Automotive Systems
Robotics
AWARDS & ACHIEVEMENTS
AWARDS & ACHIEVEMENTS
Best Paper Finalist, IEEE ICDL 2023.
Fully-funded PhD scholarship from University of Hertfordshire, UK.
Jeffery Cheah foundation research scholarship for graduate studies from Sunway University, Malaysia.
Research grant worth RM27,500 for graduate studies from Sunway University, Malaysia.
Undergraduate merit scholarship for undergraduate studies from Isra University, Pakistan.
SHORT COURSES & CERTIFICATIONS
SHORT COURSES & CERTIFICATIONS
Teaching and Supporting Learning
Introduction to Artificial Intelligence (AI)
AI for Everyone
Python for Data Science and AI
What is Data Science?
Microsoft Office Specialist
Cisco Certified Network Associate (Training)
Fiber Optics Network Design
Social & Behavioral Research
Students conducting no more than minimal risk research
CPISM (Certificate of Proficiency in Information Systems Management)
TECHNICAL SKILLS
TECHNICAL SKILLS
Programming Languages: Python, C++, Embedded C, Bash
ML Libraries: PyTorch, TensorFlow, Stable-Baselines3, RLlib, NumPy, joblib, Numba
Simulation: MiniHack, SUMO, OpenAI Gym, Packet Tracer
Embedded Systems: Arduino, Flex Sensors, Wireless Modules, Sensor-actuator integration, Embedded real-time control.
Others: CUDA, Linux shell, PyCharm, VSCode, LaTeX, MS Office
Page updated
Google Sites
Report abuse