← back
Productionizing GenAI Models – Lessons from the world's best AI teams: Lukas Biewald
Takeaway
In GenAI, the learnings (not the code) are your IP — track every experiment automatically so iteration time, not feature velocity, becomes your competitive edge.
Summary
- W&B CEO Biewald notes >70% of audience has GenAI in production now — democratization happened via chat/LLMs, not the predicted AutoML/GUI path.
- Core insight: AI is uniquely easy to demo and uniquely hard to productionize because the workflow is experimental and non-deterministic, not the linear add-features pipeline of software.
- Therefore your IP is not the code or model but the *learnings* — every prompt, workflow and dead-end — which require passive automatic tracking for reproducibility; otherwise IP walks out the door with the engineer.
- Real ROI of LLMOps tools is shrinking iteration time via reproducibility and team collaboration, not just observability checkboxes.
llmopsweights-and-biasesreproducibility
Original description
AI is poised to add $15.7 trillion to the global economy by 2030, with generative AI at the forefront of this revolution, marking a transformative shift across sectors. In his talk, Lukas Biewald will unpack the impact and potential of generative AI models and share practical insights learned from the best ML teams in the world who're building and implementing AI in production. He will share specific insights on deploying GenAI models into real-world applications, emphasizing LLM evaluation, dataset management, model experimentation and optimization. This session is a call to action for ML teams looking to leverage AI's full potential responsibly, and looking to expedite putting AI into production. Recorded live in San Francisco at the AI Engineer World's Fair. See the full schedule of talks at https://www.ai.engineer/worldsfair/2024/schedule & join us at the AI Engineer World's Fair in 2025! Get your tickets today at https://ai.engineer/2025 About Lukas I’m Lukas Biewald, I founded CrowdFlower/Figure Eight and Weights and Biases. You can find my projects on twitter and medium and github. I live and work in San Francisco.