Abstract
Computer Graphics and Geometry Processing are the main disciplines dealing with 3D data such as meshes and point clouds. In turn, Artificial Intelligence and Deep Learning are fundamental paradigms to manage visual data. Nevertheless, applying traditional learning paradigms on 3D data requires rethinking architectural building blocks designed for 2D images, such as convolution and pooling operators, as well as attention layers.
In this course, we will introduce different representations for 3D data, and basic geometry processing techniques that intervene in deep learning pipelines (sampling, remeshing, conversion, …). Then, we will introduce methods able to learn tasks on 3D data. We will describe different architectures to process complex geometric domains, and the novel mechanisms introduced in the literature to preserve by design their intrinsic properties. Examples include graph learning techniques, augmented with geometric and topological information; attention modules to process unordered point sets and mesh data; transformer-like architectures for unstructured data.
In the second part of the course, we will discuss different applications where the interplay between Computer Graphics/Geometry Processing and Deep Learning is opening up to exciting results, including Computational Fabrication, Architectural Geometry, Aesthetic analysis of 3D models, and Environmental Monitoring.
Lessons will be hold in the first two weeks of October 2023, they will be in presence, but streamed live on Teams.
Please note that the start of the course has been shifted one week. Sorry for the
Exam: group project (2/3 students) or paper seminar
Prerequisites: basic mathematical tools to understand concepts of differential geometry and basic machine learning concepts
Oct Wed 04 Sala Sem. Est 09-11
Oct Wed 04 Sala Sem. Est 14-16
Oct Fri 06 Aula A1 09-11
Oct Fri 06 Aula C 14-16
Oct Wed 11 Sala Sem. Est 09-11 (Giorgi) Introduction: Challenges of learning on 3D Data
(Malomo) 3D Representations in a nutshell
Oct Wed 11 Sala Sem. Est 14-16 (Malomo) 3D Representations in a nutshell
Oct Fri 13 Sala Sem. Est 09-11 (Corsini) ML for different geometric representation
Oct Fri 13 Sala Sem. Est 14-16 (Cignoni) Sampling, and Mesh Processing bits
Oct Wed 18 Sala Sem. Ovest 09-11
Oct Wed 18 Sala Sem. Est 14-16
Oct Fri 20 Sala Sem. Est 09-11
Oct Fri 20 Sala Sem. Ovest 14-16
Avvisi
Materiali (to be completed)
Testi di riferimento (to be completed):
Botsch, Mario, Leif Kobbelt, Mark Pauly, Pierre Alliez, and Bruno Lévy. Polygon mesh processing. CRC press, 2010
Course Notes by Keenan Crane: http://www.cs.cmu.edu/~kmcrane/Projects/DDG/paper.pdf
Articoli:
Verranno aggiunti durante lo svolgimento del corso per approfondire le diverse tematiche
Durante il corso verranno pubblicate su questo sito le slide delle lezioni.
Exam Topics
(To be updated)
Lecturers
Paolo Cignoni, Massimiliano Corsini, Daniela Giorgi, Luigi Malomo