Publications

International Journals  (Google Scholar)

1. Ullah, Ihsan, and Youn-Hee Han. "Dynamic virtual network embedding for task offloading in IoV: GAT-assisted HDRL approach." Annals of Telecommunications (2025): 1-17.

2. Ali, Qaisar, and Ihsan Ullah. "Joint-node-link Mapping for Virtual Network Embedding in 5G/6G Environments Using GAT-augmented PPO." Mobile Networks and Applications (2025): 1-16.

3.  Ullah, Ihsan. "Digital twin-empowered task offloading in VEC: attention-augmented DRL for mobility-resilient optimization." Computer Networks (2025): 111818.

4.  Ullah, Amin, Ihsan Ullah, Qazi Mazhar ul Haq, Saddaf Rubab, Jamel Baili, and Muhammad Attique Khan. "SDN-Driven Multi-Objective Task Offloading in IoT-Enabled UAVs in Edge-Cloud Computing Using Double DQN." IEEE Transactions on Consumer Electronics (2025).

5. Sheikh, Mohammad Nowsin Amin, Muhammad Saibtain Raza, I. Hwang, Md Alamgir Hossain, Ihsan Ullah, Tahmid Hasan, and Mohammad Syuhaimi Ab-Rahman. "SDN-Enabled IoT Based Transport Layer DDoS Attacks Detection Using RNNs." Computers, Materials & Continua 85, no. 2 (2025).

6. I. Ullah and Y.-H. Han, "Optimizing Vehicular Edge Computing: Graph-based Double-DQN Approaches for Intelligent Task Offloading," The Journal of Supercomputing, Vol. 81, 76, Oct. 2024, DOI: 10.1007/s11227-024-06599-4.  

7. Gan Huang, Ihsan Ullah, Hanyao Huang, Kyung Tae Kim. Predictive mobility and cost-aware flow placement in SDN-based IoT networks: a Q-learning approach. Springer Journal of cloud computing (2024)

8. Lim, H. K., Ullah, I., Kim, J. B., & Han, Y. H.  "Virtual Network Embedding Based on Hierarchical Cooperative Multi-Agent Reinforcement Learning." IEEE Internet of Things Journal (2023). 

9.  I. Ullah., Lim, H. K., Seok, Y. J., & Han, Y. H. Optimizing Task Offloading and Resource Allocation in Edge-Cloud Networks: A DRL Approach . Springer Journal of cloud computing (2023)

10.  Lim, H. K., Ullah, I., Han, Y. H., & Kim, S. Y. Lim, Hyun-Kyo, et al. "Reinforcement learning-based virtual network embedding: A comprehensive survey." ICT Express (2023).Ullah, Ihsan, Ju-Bong Kim, and Youn-Hee Han. "Compound Context-Aware Bayesian Inference Scheme for Smart IoT Environment." Sensors 22.8 (2022): 3022. 

11. Ullah, Ihsan, et al. "An Energy-efficient Data Collection Scheme by Mobile Element based on Markov Decision Process for Wireless Sensor Networks." Wireless Personal Communications 123.3 (2022): 2283-2299. 

12. I. Ullah, H. Y. Youn, and Y.-H. Han, “Integration of type-2 fuzzy logic and Dempster–Shafer Theory for accurate inference of IoT-based health-care system,” Future Gener. Comput. Syst., vol. 124, pp. 369–380, Nov. 2021, doi: 10.1016/j.future.2021.06.012. 

13. H. -K. Lim, J. -B. Kim, I. Ullah, J. -S. Heo and Y. -H. Han, "Federated Reinforcement Learning Acceleration method for Precise Control of Multiple Devices," in IEEE Access, vol. 9, pp. 76296-76306, 2021, doi: 10.1109/ACCESS.2021.3083087. 

14. I. Ullah, M. S. Khan, M. St-Hilaire, M. Faisal, J. Kim, and S. M. Kim, “Task Priority-Based Cached-Data Prefetching and Eviction Mechanisms for Performance Optimization of Edge Computing Clusters,” Security and Communication Networks, vol. 2021, p. 5541974, Mar. 2021, doi: 10.1155/2021/5541974. 

15. I. Ullah, J. Youn and Y. -H. Han, "Multisensor Data Fusion Based on Modified Belief Entropy in Dempster–Shafer Theory for Smart Environment," in IEEE Access, vol. 9, pp. 37813-37822, 2021,  https://doi.org/10.1109/ACCESS.2021.3063242

16. Ihsan Ullah, Hee Yong Youn & Youn-Hee Han. “An Efficient Data Aggregation and Outlier Detection Scheme based on Radial Basis Function Neural Network for WSN " Journal of Ambient Intelligence and Humanized Computing (Jan 2021): 1-17.

17. N. Gul, M.S. Khan, S.M. Kim, M.S. Hilaire, I. Ullah, and J. Kim "Particle Swarm Optimization in the Presence of Malicious Users in Cognitive IoT Networks with Data" Scientific Programming  2020 (Nov 2020).   https://doi.org/10.1155/2020/8844083 

18. I. Ullah, M. S. Khan, M. Amir, J. Kim and S. M. Kim, "LSTPD: Least Slack Time-Based Preemptive Deadline Constraint Scheduler for Hadoop Clusters," in IEEE Access, vol. 8, pp. 111751-111762, 2020, doi: 10.1109/ACCESS.2020.3002565. 

19. Ullah, I., Youn, H.Y. Intelligent Data Fusion for Smart IoT Environment: A Survey. Wireless Pers Commun (2020). https://doi.org/10.1007/s11277-020-07369-0 

20. Ullah, I., Youn, H.Y. Task Classification and Scheduling Based on K-Means Clustering for Edge Computing. Wireless Pers Commun (2020). https://doi.org/10.1007/s11277-020-07343-w.

21. Ullah, I., Youn, H.Y. Efficient data aggregation with node clustering and extreme learning machine for WSN. J Supercomput (2020). https://doi.org/10.1007/s11227-020-03236-8 

22. Ullah, I., Youn, H.Y., A novel data aggregation scheme based on self-organized map for WSN. The Journal of Supercomputing (2019): 1-22. 

23. Ullah, I., Youn, H.Y.  Yong Youn. "Statistical multipath queue-wise preemption routing for zigbee-based WSN." Wireless Personal Communications 100.4 (2018): 1537-1551.

Korean Patents

1. Ihsan Ullah, and Hee Yong Youn "Method and Apparatus for Node Data Aggregation in Wireless Sensor Networks" KR Patent (2019) . App.No: 1020190089187

2. Ihsan Ullah, and Hee Yong Youn "Multipath Priority Routing Method for Wireless Sensor Networks and Routing Device Implementing " KR Patent (2019), App. No: 1020190004828  

International Conferences

1.  Ihsan Ullah; Qaisar Ali; Muhammad Ashraf; Youn-Hee Han "Enhancing Task Offloading in Vehicular Edge Computing with Digital Twin and Graph-Based DRL" “CSCI2025 conference (USA). Accepted.

2. Kung, Cheng-Ting, Qaisar Ali, and Ihsan Ullah. "Enhancing Profit in TAIEX Futures Trading with a PPO-Based Framework." 2025 Seventh International Symposium on Computer, Consumer and Control (IS3C). IEEE, 2025.

3. Chandler, Stacey Philippa, and Ihsan Ullah. "Network Routing Optimization Using an AWAC-Enhanced PPO and GAT Architecture." 2025 Seventh International Symposium on Computer, Consumer and Control (IS3C). IEEE, 2025.

4. Ihsan Ullah; Qaisar Ali; Muhammad Ashraf; Youn-Hee Han " Advanced Virtual Network Embedding: Combining Graph Attention Network and DRL for Optimal Resource Utilization" 2025 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). IEEE, 2025.

5. Asel Nurlanbek Kyzy; Chang-Hun Ji; Yohan Choi; Yeong-Jun Seok; Ihsan Ullah; Youn-Hee Han" Accelerating Convergence in Distributed Reinforcement Learning via Asynchronous PPO." 2025 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). IEEE, 2025.

6. Ullah, Ihsan, Hyun-Kyo Lim, Yeong-Jun Seok, Naeem Ul Islam, Chang-Hun Ji, and Youn-Hee Han. "Graph-Powered Reinforcement Learning for Intelligent Task Offloading in Vehicular Networks." In 2024 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), pp. 337-342. IEEE, 2024. 

7. Ullah, Ihsan, et al. "Efficient Virtual Network Embedding with Hierarchical and Cooperative Multi-Agent Reinforcement Learning." 2023 International Conference on Communication, Computing and Digital Systems (C-CODE). IEEE, 2023. 

8. Ullah, Ihsan, et al. "Optimal Task Offloading with Deep Q-Network for Edge-Cloud Computing Environment." 2022 13th International Conference on Information and Communication Technology Convergence (ICTC). IEEE, 2022. 

9. Choi, H. B., Kim, J. B., Ji, C. H., Ihsan, U., Han, Y. H., Oh, S. W., ... & Pyo, C. S. (2022, February). MARL-based Optimal Route Control in Multi-AGV Warehouses. In 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC) (pp. 333-338). IEEE. 

10. Ihsan. U., H. -K. Lim and Y. -H. Han, "Feature Correlation-based Data Fusion using Dempster-Shafer Evidence Theory for WSN," 2021 International Conference on Information and Communication Technology Convergence (ICTC), 2021, pp. 1208-1212, doi: 10.1109/ICTC52510.2021.9621064. 

11. Ihsan U., H. -K. Lim and Y. -H. Han, "Ego Network-based Virtual Network Embedding Scheme for Revenue Maximization," 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), 2021, pp. 155-160, doi: 10.1109/ICAIIC51459.2021.9415185. 

12. Kim, Sejun, Ihsan U, Taeho Lee, and Hee Yong Youn. "Fast Detection of Abnormal Data in IIoT with Segmented Linear Regression." In Proceedings on the International Conference on Internet Computing (ICOMP), pp. 88-94. The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2019.

13.