Hikaru Shindo* 1, Viktor Pfanschilling 1,4 , Devendra Singh Dhami 1,2, Kristian Kersting 1,2,3,4
1 TU Darmstadt, Germany
2 Hessian Center for AI (hessian.AI), Darmstadt, Germany
3 Centre for Cognitive Science, TU Darmstadt, Germany
4 German Center for Artificial Intelligence (DFKI), Germany
* Corresponding author: A@B, where (A, B) = (hikaru.shindo, tu-darmstadt.de)
Reasoning and learning using logic programming on complex visual scenes.
Perform visual reasoning beyond observation:
"What is the color of the 2nd left-most object after deleting a cyan object?"
Visualize the important factors for the reasoning using attention maps. Using the end-to-end reasoning architecture, NEUMANN highlights only relevant objects by computing input gradients.
This work was supported by the AI lighthouse project “SPAICER” (01MK20015E), the EU ICT-48 Network of AI Research Excellence Center “TAILOR” (EU Horizon 2020, GA No 952215), and the Collaboration Lab “AI in Construction” (AICO). The work has also benefited from the Hessian Ministry of Higher Education, Research, Science and the Arts (HMWK) cluster projects “The Third Wave of AI” and “The Adaptive Mind”, the Hessian Centre for Artificial Intelligence overall, the Hessian research priority program LOEWE within the project WhiteBox, and from the German Center for Artificial Intelligence (DFKI) project ‘SAINT’.