← back
tldraw.computer - Steve Ruiz, tldraw
Takeaway
Spatial canvases like tldraw turn AI generation into composable graphs where drawing, annotation, and node-wiring become the programming interface.
Summary
- tldraw is a free whiteboard SDK built on React with shapes that can be live YouTube videos, Figma embeds, CodeSandbox editors — even tldraw recursively embedded.
- Make Real (2023) used GPT-4 Vision to turn wireframe sketches into working HTML/JS apps; users could draw annotations to iterate on the generated app.
- Draw Fast uses latent consistency models to generate images from sketches in near-real time, re-rendering as the user draws.
- tldraw.computer is a node-graph canvas (built with Google for Gemini 2 launch) where each node has a script describing how to transform inputs to outputs — chaining text, speech, and image generation.
multimodalcanvas-uitldraw
Original description
Learn about tldraw's latest experiments with AI on an infinite canvas. In 2024, we created tldraw computer, a loose visual programming environment where arrows and LLMs powered every step of a graph on tldraw's canvas. About Steve Ruiz Steve Ruiz is founder and CEO of tldraw, a London-based startup building an infinite canvas component for the web. Recorded at the AI Engineer World's Fair in San Francisco. Stay up to date on our upcoming events and content by joining our newsletter here: https://www.ai.engineer/newsletter