← back
What It Actually Takes to Deploy GenAI Applications to Enterprises: Arjun Bansal and Trey Doig
Takeaway
Enterprise GenAI deployment is mostly an accuracy and trust problem — you need configurable per-customer eval pipelines plus a 7-day path to ~95% accuracy before customers will renew.
Summary
- EchoAI applies GenAI to 100% of customer-support conversations (vs sampling 5%), extracting intent, sentiment, aspects, defects in real time
- Real example: Wine Enthusiast surfaced a manufacturing defect in fridges from live conversations weeks earlier than traditional retro analysis
- Pipeline normalizes/compresses conversations from many contact systems then runs dozens of configurable LLM-prompt pipelines that customers eventually own
- Trust is built via 7-day onboarding sampling to reach ~95% accuracy — enterprise buyers won't deploy without that
- Log10 (Arjun Bansal) builds the underlying accuracy infra: human review is gold-standard but expensive; LLM-as-judge alone has reliability problems — cites Air Canada refund hallucination and Chevy Tahoe $1 truck as cautionary tales
enterprisecustomer-supportevals
Original description
Join Trey Doig and Arjun Bansal as they recount Echo AI’s journey rolling out its conversational intelligence platform to billion-dollar retail brands. They’ll discuss navigating LLM accuracy issues as well as what needed to happen at the application and infrastructure layers in order to successfully deploy at enterprise scale. Recorded live in San Francisco at the AI Engineer World's Fair. See the full schedule of talks at https://www.ai.engineer/worldsfair/2024/schedule & join us at the AI Engineer World's Fair in 2025! Get your tickets today at https://ai.engineer/2025 About Arjun Arjun Bansal is an entrepreneur and AI expert focused on understanding and building intelligent systems. He is currently CEO & co-founder of Log10.io, a platform for measuring and improving accuracy of LLM applications and agents. Arjun previously co-founded Nervana Systems (acq. Intel), and XOKind (AI agents for travel). Arjun's career spans research in brain-machine interfaces, building AI processors, and AI sidekicks. About Trey Trey Doig is the Co-Founder & CTO at Echo AI, building a GenAI-native Conversation Intelligence platform. Trey has over ten years of experience in the tech industry, having worked as an engineer for IBM, Creative Commons, and Yelp. Trey’s previous startup SeatMe, was acquired by Yelp.com, which still powers their reservation functionality today.