Autopilots Need Parachutes: Reliability Lessons from LLM-Automated Embedded AI Systems
Roberto Morabito, EURECOM
Embedded AI systems are becoming increasingly complex to develop and maintain, requiring specialized workflows that span data processing, model conversion, optimization, and deployment across heterogeneous hardware platforms. Recently, large language models have emerged as a promising tool to automate parts of this lifecycle. In this talk, I present recent work investigating the use of generative AI models as orchestration agents for embedded machine learning pipelines. Using an automated system that leverages LLMs to generate and iteratively refine software artifacts for embedded platforms, we evaluate the feasibility of automating key stages of the AI lifecycle. Our empirical results reveal both the promise and the limitations of this approach. Generative models can significantly accelerate development workflows. However, they also introduce instability, iterative failure modes, and unpredictable operational costs. I will discuss the main failure patterns observed in practice and outline research directions aimed at improving reliability through hybrid reasoning frameworks and system-level feedback mechanisms.
Roberto Morabito is an Assistant Professor in the Networked Systems group of the Communication Systems Department at EURECOM, France, and a Docent at the University of Helsinki. Before joining EURECOM, he was a Senior Researcher in the Department of Computer Science at the University of Helsinki. Earlier in his career, he spent eight years at Ericsson Research Finland, where he worked on cloud platforms, IoT systems, and cyber-physical systems. He received his PhD in Networking Technology from Aalto University in 2019 and was a postdoctoral researcher at the EDGE Lab, School of Electrical and Computer Engineering, Princeton University. His research lies at the intersection of networked systems, edge computing, and distributed AI, focusing on the design and lifecycle management of AI systems operating under computing and networking resource constraints.
