Bio
My Education
"National PhD in AI" student at Sapienza University of Rome
Master's Degree: "Artificial Intelligence and Robotics" (2024)
Sapienza University of Rome
(110 cum laude)
Bachelor's Degree: "Computer Engineering and Automation" (2019)
Sapienza University of Rome
(110 cum laude)
SPQR RoboCup SPL Team. I took part in RoboCup SPL competitions (2021, 2022) as a developer and as in the Technical Committee (2023).
Learn more about RoboCup SPL here!
My Research
Topics: Planning and Logical Reasoning, Autonomous Multi-Agent systems, Human-Robot Interaction, Multi-agent RAG pipelines.
Give a look at my research.
Fast facts
I am currently developing software for the "first italian robotic public employee", a humanoid robot developed by the Italian Institute of Technology and qbRobotics as a museum guide at the Temple of Hadrian, in Rome.
RoboCup Standard Platform League team developer: member of SPQR Team from Sapienza University of Rome
I've been part of the RoboCup SPL Technical Committee for RoboCup 2023
🏆"Best Paper Award" at RoboCup Symposium 2023
I am a Freelance Developer on the Upwork platform (link to my Upwork profile) with a 5-star rating on all my delivered projects.
I wrote an article as a freelance for an AI blog (link)
Competences
Programming: Python, C, C++, Java, JavaScript (NodeJS, BabylonJS, CannonJS, ThreeJS, jQuery), Scala, MatLab, MySQL, Prolog, Assembler, Web development (HTML5, CSS), Android Development
Machine Learning: Neural Networks (PyTorch), Natural Language Processing, Machine Learning, Computer Vision
Robotics: ROS (Robot Operating System), Coreographe (NAO), Humanoid Robots (NAO and others), Humanoid robots programming in C++ or Python and with or without ROS.
Other skills:
Proficient in English language (C1 level)
Adobe Photoshop, Adobe Illustrator, Adobe AfterEffects
My main skill
Working on robot systems, requiring both hardware and software-related know-how, with multiple programming languages and frameworks involved.
Publications
"Adaptive Team Behavior Planning using Human Coach Commands", Musumeci E., Suriani V., Antonioni E., Nardi D., Bloisi D.D. (2023). RoboCup 2022. Lecture Notes in Computer Science(), vol 13561. Springer, Cham. (Google Scholar).
"Play Everywhere: A Temporal Logic based Game Environment Independent Approach for Playing Soccer with Robots", Suriani V., Musumeci E., Nardi D., Bloisi D.D., Lecture notes in computer science-RoboCup 2023: Robot World Cup XXVI (Google Scholar)
🏆Best paper award!!!🏆
"LLM Based Multi-Agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain", Musumeci E., Brienza M., Suriani V., Nardi D., Bloisi D. D., [Accepted at HCI International 2024]. (Google Scholar)
"LLCoach: Generating Robot Soccer Behaviors using Multi-Role Large Language Models", Musumeci E., Brienza M., Suriani V., Nardi D., Bloisi D. D., [Accepted at RoboCup Symposium 2024]. (Website)
Projects
Task-based Human-Robot interaction routine in a Robot Soccer setting
This video shows the demo of a human-robot interaction routine, based on the autonomous completion of tasks issued through a GUI on an external device (a laptop, tablet or smartphone), chosen among a predefined library of soccer-related tasks. The robotic agent is a child-sized humanoid NAO robot, by Aldebaran, now acquired by SoftBanks Robotics.
The software being used on the robot is a fork of the framework used by the SPQRTeam in RoboCup SPL competitions, in turn based on the B-Human RoboCup SPL framework.
Languages involved:
Python
C++
HTML/JavaScript
RoboCup Coach
Project published with the paper "Adaptive Team Behavior Planning using Human Coach Commands"
The idea behind this project is to make a first step towards real-time coaching of robots in RoboCup Soccer SPL, by using online planning in a PDDL domain using temporal goals and constraints. The presented architecture allows a human in the loop to speak temporal goals over PDDL predicates, influencing robot behaviors in real-time.
Languages involved:
Python
C++
Minigame.io
A browser game, developed as a final project for an Interactive Graphics exam, featuring a series of “mini-games” (easy levels with a specific objective), designed modularly to allow an easy addition of new levels. It is implemented using the Babylon.js framework and Cannon.js as a physics engine. After a first round where all mini-games are played in sequence, mini-games will be chosen randomly and randomized (each mini-game provides its own randomization features). The player is implemented as a hierarchical model representing a “drawing mannequin” with animations for walking (forward, left, right, back), jumping, falling and being idle.
Languages involved:
JavaScript using BabylonJS and CannonJS libraries
HTML
Unsupervised feature selection for clustering in high-dimensional spaces
This library provides a vanilla implementation of a genetic algorithm. The library is then used to attempt a novel approach to perform unsupervised feature selection for clustering in high-dimensional spaces. Probably not publishable or peer-reviewable but at least I had fun implementing it.
UrbanSound8K sound classification using a Convolutional Neural Network
Classifier based on a convolutional neural network, to solve the environmental sound classification task. The CNN is trained using audio data taken from the UrbanSound8K dataset, with the addition of various feature extraction techniques:
Audio augmentations, as in the paper Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification. In particular, the Dynamic Range Compression augmentation is performed using the MUDA library.
Spectrogram deltas and delta-deltas, as in the paper Environmental Sound Classification with Convolutional Neural Networks
Spectrogram image augmentation techniques (mostly found on the web and by experimentation)
TRPO algorithm in Tensorflow 2
Small homemade modular framework created as a University project, to implement and test Reinforcement Learning algorithms, with a working implementation of TRPO.
Pass Planner for RoboCup SPL
As a member of SPQR Team, I contributed to the development of the "Pass Planner", an Artificial Intelligence System based on Automatic Planning algorithms (Dijkstra's algorithm for the search of shortest-paths and A* algorithm for heuristic search), to compute the best pass sequence to implement, during RoboCup SPL matches, effective collaborative strategies, culminating in a successful action, to score in the opponent goal.
GitHub repository is currently private and covered by Copyright
Play Everywhere
As an extension to previous work, we published "Play Everywhere: A Temporal Logic based Game Environment Independent Approach for Playing Soccer with Robots"
Here, we proposed a temporal logic-based approach that allows robots’ behaviors and goals to adapt to the semantics of the environment.
The soccer setting is modeled hierarchically and the robot selects the level of operation based on the perceived semantic characteristics of the environment, thus dynamically modifying the set of rules and goals to apply in an unstructured environment.
LLM Multi-Agent Generation of Documents from Semantic Templates
The recent introduction of Large Language Models has enabled the creation of customized text output satisfying user requests. In this work, we propose a novel approach that combines the LLMs with prompt engineering and multi-agent systems for generating new documents compliant with a desired structure. The main contribution of this work concerns replacing the commonly used manual prompting with a task description generated by semantic retrieval from an LLM. The potential of this approach is demonstrated through a series of experiments and case studies, showcasing its effectiveness in real-world Public Administration scenarios.
LLCoach: a multi-role LLM/VLM pipeline for generating multi-agent strategies in RoboCup Soccer
This paper introduces a novel application of Large Language Models (LLMs) to address the challenge of generating actionable plans in such settings, specifically within the context of the RoboCup Standard Platform League (SPL) competitions where robots are required to autonomously execute soccer strategies that emerge from the interactions of individual agents. In particular, we propose a multi-role approach leveraging the capabilities of LLMs to generate and refine plans for a robotic soccer team. The potential of the proposed method is demonstrated through an experimental evaluation, which has been carried out by simulating multiple matches where robots with the AI-generated plans play against robots running human built code.
Events
RoboCup 2021 Worldwide
Due to the COVID-19 pandemic, the annual RoboCup event was held remotely (link to the official website). This saw our team of robots facing 4 different challenges:
Obstacle avoidance challenge: the robot had to dribble through randomly placed obstacles, in order to score a goal
Passing challenge: two robots of the same team had to pass the ball to each other through an obstacle field
1vs1 challenge: two robots of opposing teams had to kick up to 4 balls in the opponent's field, scoring a point each time the ball stopped there. We got 4th worldwide in this challenge! This is the link to the video of one of our best matches.
Autonomous calibration challenge: the robot had to autonomously calibrate its cameras on a random remote soccer field and then self-localize on this field with the smallest possible error.
Maker Faire 2021 Rome Edition
Maker Faire is an event that hosts inventors, makers and researchers from all over the world, where each participant can share his ideas or showcase his inventions.
I took part in this event as a member of SPQR Team. We invited the HULKs Team (a german RoboCup SPL team) as adversaries for a small RoboCup tournament.
We also took the chance to showcase the reality of RoboCup SPL and the skills of our robots.
RoboCup 2022 Bangkok
RoboCup is a the main event in Robotics and Artificial Intelligence, taking place every year in different locations all over the world.
It features expositions, pitches and seminars but its main focus is posed on robotics tournaments.
I took part in this event as a member of SPQR Team from RoCoCo Lab of Sapienza University of Rome.
After the end of RoboCup 2022 I presented the paper "Adaptive Team Behavior Planning using Human Coach Commands" (link) at the RoboCup Symposium 2022.
Maker Faire 2022 - The European Edition
I took part in the 2022 edition of Maker Faire as a member of SPQR Team. We invited the Nao Devils team (a german RoboCup SPL team) as adversaries.
Here the SPQR team made presentations and public demonstrations, using the venue to test the new features of its C++ framework (mainly linked to ball passes between robots)
