Dresden, Germany
December 12 - 14, 2024
Welcome!
*The first LLMs' secrets workshop is an exclusive event for outstanding AI researchers contributing to the field of Natural Language Processing and Large Language Models. Participation is by invitation only, extended by the organizers.
Day 1: December 12, 2024
09:30 - 10:00 Registration and Welcome Coffee
10:00 - 11:00 Opening Remarks
Welcome by Workshop Chair
Introduction to Workshop Themes
Icebreaker and Networking
11:00 - 12:00 Keynote 1 | Prof. Michael Färber
LLMs and Knowledge Graphs for Science: from Papers to insights
12:00 - 14:00 Lunch Break
14:00 - 15:00 Keynote 2 | Ercong Nie
Probing Large Language Models: Multilingual Insights into Linguistic Form, Meaning, and Knowledge Representation
15:00 - 15:30 Coffee Break
15:30 - 16:30 Keynote 3 | Ruotong Liao
Reasoning with LLMs with a Temporal View: From Temporal Graph to Video Understanding.
16:30 - 17:30 Discussion: Large Language Models in Practice
Talks by Participants
Q&A and Open Discussion
17:30 - 18:00 Wrap-Up for Day 1
Summary and Discussion
Announcements for Day 2
Day 2: December 13, 2024
09:30 - 10:00 Coffee and Networking
10:00 - 11:00 Keynote 4 | Nicolas Popovič
Encoding or Decoding? NLU in the Age of Generative Language Models
11:00 - 12:00 Keynote 5 | Chunlan Ma
Multilinguality in the Era of Large Language Models
12:00 - 14:00 Lunch Break
14:00 - 15:00 Panel Discussion: Future Directions and Collaborations in LLMs
Panelists: Keynote speakers
Topics: Trends, Challenges, and Future Prospects in LLM research
15:00 - 15:30 Coffee Break
15:30 - 16:30 Training: Collaboration with ScaDS.AI and TU Dresden
Visit the facilities of ScaDS.AI and TU Dresden
Discover key research areas in AI at ScaDS.AI
16:30 - 17:30 Closing Remarks and Next Steps
Summary of Key Takeaways
Networking and Collaboration Opportunities
Optional Day: December 14, 2024
09:30 - 12:00 Extended Workshop (Optional Participation)
Deep Dive into Collaborative Research Ideas
Participant-Led Sessions and Discussions
Prof. Michael Färber is a distinguished scholar at the Technische Universität Dresden, where he holds the Chair for Scalable Software Architectures for Data Analytics since April 2024. His research focuses on natural language processing, machine learning, and knowledge representation, aiming to develop efficient and scalable software architectures for data analytics. Prof. Färber has authored over 75 publications in high-ranking conferences and journals, contributing significantly to advancements in artificial intelligence and data science.
Ercong Nie is a Ph.D. candidate at the Center for Information and Language Processing (CIS) at LMU Munich and a research intern at Huawei Technologies. His research focuses on computational linguistics and natural language processing, with a particular emphasis on multilingual language models and cross-lingual transfer learning. Ercong has contributed to several notable publications, including “Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages” presented at ACL 2023, and “Unleashing the Multilingual Encoder Potential: Boosting Zero-Shot Performance via Probability Calibration” featured in the Findings of EMNLP 2023. His work aims to enhance the performance of language models across diverse languages, especially those with limited resources.
Ruotong Liao is a Ph.D. student at LMU Munich, supervised by Prof. Volker Tresp. Her research focuses on Generative AI, foundational multi-modal models, and large language models, with a special emphasis on reasoning over temporal data such as videos and dynamic graphs. Ruotong has authored several notable publications, including “VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning” presented at EMNLP 2024, and “GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Models” featured in the Findings of NAACL 2024. Her work aims to advance the understanding and application of AI in processing and reasoning over complex temporal information.
Nicholas Popovič is a fourth-year Ph.D. student in the Web Science group at the Karlsruhe Institute of Technology. His research focuses on natural language processing and machine learning, particularly on representation learning for information extraction. Nicholas has authored several notable publications, including “Few-Shot Document-Level Relation Extraction” presented at NAACL 2022 and “Embedded Named Entity Recognition using Probing Classifiers” accepted at EMNLP 2024. His work aims to enhance the efficiency and accuracy of information extraction systems through advanced machine learning techniques.
Chunlan Ma is a Ph.D. student at the Center for Information and Language Processing (CIS) at LMU Munich. Her research focuses on natural language processing, multilingual large language models, and cross-lingual transfer learning. Chunlan has authored several notable publications, including “Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages”, presented at ACL 2023, and “Translico: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models,” featured at ACL 2024. Her work aims to enhance the performance of language models across diverse languages, especially those with limited resources.
Karlsruhe Institute of Technology
University of Munich / Huawei
University of Munich
Karlsruhe Institute of Technology
Forschungszentrum Informatik
University of Munich
Technical University of Munich
University of Munich
Prof. Michael Färber
ScaDS.AI/ Technische Universität Dresden
Shuzhou Yuan
ScaDS.AI/ Technische Universität Dresden
Tobias Schreieder
ScaDS.AI/ Technische Universität Dresden
Parisa Aghdam
ScaDS.AI/ Technische Universität Dresden
Jin Zhang
ScaDS.AI/ Technische Universität Dresden
Strehlener Str. 14, 7th floor
01069 Dresden
How to arrive?
From Dresden Hauptbahnhof, it is a 10-minute walk.
Alternatively, you can take Tram 8 or 10 from Dresden Hauptbahnhof, or Tram 11 from Hauptbahnhof Nord. Get off at Gret-Palucca-Straße (just one stop), but note that you will still need to walk for 6 minutes afterward.
For the most convenient option, you can take Bus 66 from Hauptbahnhof and get off at Uhlandstraße, which is right next to our building!