← back

AI Engineering 201: The Rest of the Owl

3.3K views · Nov 08, 2023 · 56:56 min · Watch on YouTube ↗
Takeaway

Most LLM apps fail because teams over-invest in inference and under-invest in the LUI patterns, monitoring, and evals that turn a model into a product.

Summary

  • Frames LLM apps as 'Language User Interfaces' (LUIs) — the next interface paradigm after CLIs and GUIs — citing Sam Altman, Eliza, SHRDLU, Ask Jeeves, and Alexa as precedents.
  • Surveys emerging architectural patterns from Sequoia's 'Act 2' framing where foundation models are components, not full solutions — e.g., Honeycomb's natural-language query assistant.
  • Covers monitoring, observability, and evaluation as the engineering practices needed to iterate LLM apps once they're past prototype.
  • Argues most engineering effort has gone into inference and not enough into the surrounding product 'owl' — UX, evals, observability.
llm-appsobservabilityux
Original description
Optional introductory course for AI Engineers, free for all Summit attendees. Advanced knowledge of AI Engineering, led by instructor Charles Frye of the massively popular Full Stack LLM Bootcamp.

Part Two - The Rest of the Owl

00:00 Intro
01:09 Patterns for Language User Interfaces
06:19 RAG: Information Retrieval for Generation
21:52 Function Calling: Structured Outputs and Tool Use
35:03 Agents and Cognitive Architectures
40:52 Shipping to Learn in ML + AI
45:42 LLM Monitoring and Observability Tools
49:42 Evaluating LLMs
55:48 Inspirational Outro