Large Language Models (LLMs) applications rapidly evolved from code completion tools (e.g., GitHub Copilot, 2021) to autonomous code agents capable of complex reasoning and workflow execution. In this talk, we examine the technical advancements and remaining challenges in using LLMs for code generation, drawing on recent work from Mistral’s code generation team. We’ll discuss key improvements in model architectures, training strategies, and evaluation frameworks, as well as open questions in the field.