← back
Move Fast Break Nothing: Dedy Kredo
Takeaway
Reliable codegen needs a generator+critic pair: behavior-driven tests plus automated review flag the security and correctness issues humans miss.
Summary
- Dedy Kredo (Codium AI co-founder) argues code generation needs a GAN-style generator+critic architecture: a Code Integrity component that analyzes edge cases is as important as the codegen model.
- Codium maps class 'behaviors' (happy path + edge cases) and generates tests covering each — 'behavior coverage' is more meaningful than line coverage.
- Demo on Autoscraper (600-line, 5000-star, no tests): generated explanation, 9 tests, auto-fix on a failing test via reflective Chain of Thought.
- Pipeline: generate tests -> enhance code (Blake3 vs MD5 performance) -> /commit (LLM commit message) -> /review -> /improve catches an accidentally committed API key.
- Ships VS Code/JetBrains/Git plugins with ~200K installs; APIs coming to embed in other agents.
code-generationtestingcodium
Original description
Testing is the backbone of quality code, yet it often takes a back seat as developers prioritize feature creation. The industry's reliance on metrics such as code coverage is insufficient and can even be misleading. In this evolving landscape, where AI coding agents are becoming commonplace, there's a pressing need to revolutionize our approach to testing. Recorded live in San Francisco at the AI Engineer Summit 2023. See the full schedule of talks at https://ai.engineer/summit/schedule & join us at the AI Engineer World's Fair in 2024! Get your tickets today at https://ai.engineer/worlds-fair About Dedy Kredo Dedy, Co-Founder and Chief Product Officer of CodiumAI, steers the product and engineering teams with an ambitious mission: to empower developers in creating software swiftly and flawlessly, harnessing the synergy of artificial and human intelligence. Prior to CodiumAI, Dedy took on the role of VP of Customer Facing Data Science at Explorium. There, he established and led a dedicated team of data scientists, playing a significant part in the company's progression from its seed stage to a Series C round. Dedy also ventured into entrepreneurship with a bootstrapped online marketing startup, scaling it from a modest beginning to impressive revenue figures. Earlier, as a product line manager at VMware's management business unit, he collaborated with Fortune 500 companies, launching several successful products.