Trustworthy Complex and Intelligent Systems – 67th ESReDA Seminar

25-26 September 2025, DNV Headquarters, Veritasveien 1, Høvik, Norway (Venue: Big Blue)

We are pleased to host this 67th ESReDA seminar dedicated to exploring the challenges and solutions associated with developing and deploying trustworthy complex and intelligent systems.

This seminar will delve into various aspects of building and managing trustworthy systems, focusing on the following topics:

  • Autonomous Systems: Advancements and challenges in the deployment of autonomous vehicles, vessels, drones, and robots, emphasizing safety and trust.
  • AI Agents: Issues related to trust and safety of agentic AI systems.
  • Complex Industrial Systems: The use of modelling, simulation, and AI for understanding, controlling, or managing complex systems.
  • Multi-Agent AI: Trust and safety issues in systems involving multiple AI entities.
  • Ethical and Social Implications and Governance: Societal impacts and governance of intelligent systems, including privacy, bias, and ethical considerations.

The seminar is also meant as a starting point for the newly established ESReDA Project Group How can AI and other Emerging Technologies strengthen Safety and Security, where more than 10 European institutions will collaborate the next three to four years to make progress in this important area. Additional members are still welcome.

Keynote speakers:

  • Prof. Ingrid B. Utne is a professor at the NTNU Department of Marine Technology, and an expert on risk analysis of complex systems. In recent years, her focus has been on implementation of risk-aware AI/mission planning and decision making in robotics, particularly autonomous ships, drones ASVs and AUVs.

  • Prof. Hector Zenil is an associate professor at King’s College with a prolific academic and entrepreneurial career spanning many disciplines, including complexity science, artificial intelligence, computer science, precision healthcare and ageing research. He contributed to the computational linguistics’ code behind WolframAlpha, Siri, Alexa, and GPT4. He has authored 130+ academic papers and multiple books, including ‘Algorithmic Information Dynamics’ and ‘A Computable Universe’, and is Managing Editor of the Complex Systems journal.

  • Prof. Gaute T. Einevoll is a professor of physics at the Norwegian University of Life Sciences and the University of Oslo, with focus on computational neuroscience. He is a partner in the EU Human Brain Project and co-leader of the Norwegian node of the International Neuroinformatics Coordinating Facility (INCF). He also hosts the Norwegian science podcast ‘Vett og vitenskap med Gaute Einevoll’ and the ‘Theoretical Neuroscience Podcast’ and has authored several books.

PROGRAMME:

25 September

10:00–10:15 Welcome (Astrid Rusås Kristoffersen, Group Director Research and Development, DNV)

10:15–11:00 Supervisory Risk Control for Improved Safety and Trust in Embodied AI (Ingrid B. Utne, NTNU)

11:00–11:15 Break

11:15–11:45 Safety Assurance for AI-Based Components: Possible Coping Strategies (Eric Marsden, Foncsi)

11:45–12:15 An Approach to Structured Safety Arguments for Safe Use of Black Box Reinforcement Learning in the Control Loop of Real-Time Control Systems (Rune Winther, IFE)

12:15–12:45 Classifying AI Tools in Design and Operation in Process Industry on Safety and Security Aspects (Anna Lisa Vetere Arellano, EC)

12:45–13:30 Lunch

13:30–14:00 Trust in AI: Interpretability and Beyond – A Review (K. Darshana Abeyrathna and Tita Alissa Bach, DNV)

14:00–14:20 Industry 5.0: Navigating the Regulatory Frontier for Trustworthy AI (Anna Lisa Vetere Arellano, EC)

14:20–14:50 Building Trust in Autonomous Vessels by the Law (Erik Røsæg, University of Oslo)

14:50–15:05 Break

15:05–15:25 The Role of Simulations when Assuring Complex Systems (Siegfried Eisinger, DNV)

15:25–15:55 Complex Industrial Systems: The Use of Modelling, Simulation, and AI for Understanding, Controlling, or Managing Complex Systems (María Megía Cardeñoso, UGR)

15:55–16:15 On the Failure Probability of Silicon Crystals Related to Particle Collisions and Scattering (Elena Bylski, Ruhrwest)

16:15–16:20 Info about dinner (Siegfried Eisinger, DNV)

19:00– Dinner

 

26 September

09:00–09:15 Opening of Day 2 (Frank Børre Pedersen, Programme Director of Maritime Research, DNV)

09:15–10:00 Computational Neuroscience (Gaute T. Einevoll, University of Oslo)

10:00–10:45 Complex Systems (Hector Zenil, KCL AC)

10:45–11:00 Break

11:00–11:30 Towards Trustworthy Knowledge-Augmented Language Models for Maintenance Decision Support in Fusion Facilities (Mohammed Anouar Amzert, UGR)

11:30–12:00 The Development, Use, and Management of AI to Ensure Safety and Security in Socio-Technical Systems (John Kingston, JKLTD)

12:00–12:30 From Static Certification to Continuous Assurance: Adapting Governance for Learning AI Systems (Eric Marsden, Fonsci)

12:30–13:15 Lunch

13:15–13:35 What is the Link Between Complexity and Risk? (Andreas Hafver, DNV)

13:35–14:05 The Shape of Complexity (Konstantin Holzhausen, DNV)

14:05–14:35 The AI Trust Paradox: Using Intelligent Systems for Risk Management and Compliance in Critical Infrastructures (Juan Camilo Guevara Gomez, DNV)

14:35–15:05 Discussion: Research Gaps and Future Research Areas

15:05–15:15 Closing Session – Next ESReDA Seminar (Mohamed Eid and Antonio Jesus Guillen Lopez)

Register