← back

Cohere for VPs of AI: Vivek Muppalla

535 views · Feb 05, 2025 · 16:10 min · Watch on YouTube ↗
Takeaway

Cohere differentiates on enterprise-grade embeddings + rerank, built-in citations, customization and any-cloud/on-prem deployment rather than chasing the biggest base model.

Summary

  • Vivek Muppalla pitches Cohere as a data-security-focused enterprise AI company with a 'cracked team': co-founder/CEO Aidan Gomez (Transformer author), chief scientist Phil Blunsom (ex-DeepMind/Oxford), retrieval lead Nils Reimers (BERT/sentence-transformers), and RAG-paper co-author Patrick Lewis.
  • Product line: Command R (low-cost workhorse) and Command R+ (larger, complex reasoning/tool-use/RAG) on generation; plus embeddings and Rerank — a cross-encoder reranker that boosts retrieval precision and cuts input-token spend.
  • Five guiding principles: enterprise-benchmark eval suites (healthcare, HR, finance), efficiency/scalability over largest-model races, deep customization (incl. base-model retraining on customer data), data provenance with IP indemnification and no-training-on-customer-data guarantee, and deployment flexibility (any cloud, on-prem, VPC).
  • Built-in citations come out of the box for RAG, removing extra developer work; multilingual leadership on FLORES plus a tokenizer optimized for cost across languages.
  • Includes an archive-papers demo where rerank fixes ordering issues that lexical and embedding-only search both miss for a query like 'when was the attention paper published by Aidan Gomez'.
cohereragrerank
Original description
Executive briefing and private Q&A for VPs of AI

Recorded live in San Francisco at the AI Engineer World's Fair. See the full schedule of talks at https://www.ai.engineer/worldsfair/20... & join us at the AI Engineer World's Fair in 2025! Get your tickets today at https://ai.engineer/2025

About Vivek
Vivek Raju Muppalla has a diverse work experience in the technology industry. Vivek Raju is currently serving as the Director of Engineering at Cohere, a position they have held since 2023. Prior to that, from 2022 to 2023, they worked as a Director at Scale AI, where they were responsible for starting the company's Synthetic Data Business and focused on the Scale Enterprise Generative AI platform.