← back
Realtime Data Connectivity for AI: Tanmai Gopal
Takeaway
Give LLMs a unified SQL-like query interface, declarative authorization tied to data schema, and Python-as-plan execution rather than wrapping each API ad hoc.
Summary
- Tanmai Gopal (Hasura) argues LLMs can write Flappy Bird in 30s but fail to query the user's calendar/Salesforce/tickets intelligently — calls this the existential data-connectivity problem.
- Three ideas: unified SQL-style query language (LLMs know SQL semantics; arbitrary REST params are opaque), object-model authorization independent of access path, and letting LLMs plan data retrieval by writing Python.
- Don't ask LLMs to count letters in 'Supercalifragilistic' or count tools mentally — set them up for success by having them emit Python code that fetches and assembles the data.
- Demo: Blockbuster transactional DB queried via natural language to draft a customer thank-you email referencing recent rentals, traversing 3+ data sources.
- Pitches PromptQL approach: structured query + object authorization + LLM-generated retrieval plans.
datatoolsauthorization
Original description
What if ChatGPT could talk to your realtime data? Your product database? Your salesforce data? → Write an email for my top paying customer quoting recent movies they rented →→ What are the genres of the movies here? →→→ Make it funny using a reference from one of the movies. As we hurtle towards AI ubiquity, AI connected to realtime data will become the default user expectation. Join me as I unveil Pacha DDN, an AI powered realtime data access layer that securely connects data & business logic spread across multiple sources to your LLM. Pacha DDN provides autonomous explainable multi-step query planning to retrieve data from structured & unstructured data sources and APIs instantly. Recorded live in San Francisco at the AI Engineer World's Fair. See the full schedule of talks at https://www.ai.engineer/worldsfair/2024/schedule & join us at the AI Engineer World's Fair in 2025! Get your tickets today at https://ai.engineer/2025 About Tanmai Tanmai is the CEO and cofounder at Hasura. Hasura is an open-source technology startup, that provides a GraphQL engine to help application developers work with data in modern app and microservices/serverless environments.Prior to Hasura, Tanmai ran a consultingfirm helping enterprises modernizing their technology stacks, and moving from monolithic to cloud-native environments. He is a full-stack engineer who’s passionate about making it easy to build things. He created and taught one of India’s largest MOOCs on modern application development with over 250,000 students.