WP5 and Trustworthy AI

Crucially, empowering an AI agent with the ability to self-deliberate its own behavior carries significant risks, and this ability must by balanced with safety

The autonomous behavior must be:

• Guarded by human guided specifications and oversight

• Verifiable and comprehensible in human terms

• Ultimately trustworthy (WP3)

Assessing safety becomes essential in this context

• Formal verification, model checking and automated synthesis fulfilling safety specifications is central to this WP.