🏄 This AI tool is insane

Tldraw turns sketches and doodles into working websites and programs

Author

Marc Csuzi
November 17, 2023

Hey-yo Surfers🏄!

We knew it was only a matter of time before awesome applications built on GPT-Vision pop up, but who would have thought that in less than two weeks we'd already have a killer app.

THE NEWS

🛠️This AI tool changes UI design and programming forever

Picture this: you sketch something, and it springs to life. It's pretty much like playing digital god. This is where we are at now with tldraw. It's a free whiteboard app that's now turbocharged with GPT-4 Vision. Your doodles? They're not just doodles anymore—they can become actual websites and programs.

How does it work? Simple. You draw on the whiteboard, and tldraw captures a screenshot. This goes to GPT-4 Vision, which works its magic, analyzing your drawing and spitting back usable code. tldraw then pops open a window where this code comes to life.

And hey, it's not all about web design. Draw a calculator on the whiteboard, and bam, you've got a working calculator. It's that versatile.

Once you get the result back, you can tweak and refine your creation using just text and arrows. Like what you've made? Copy the code with one click and plug it into your website or program. It's that easy.

This is obviously still not a one-click-to-fully-functioning-website/game solution. But, the potential? Huge. Front-end design used to be this long, grueling grind. Steep learning curve, endless bug squashing, and yeah, probably a fair bit of yelling at your computer screen.

Now, things are looking way more fun and user-friendly.

Some devs have even jokingly tweeted about starting to look for farming jobs. While it's not about replacing skilled developers, we are probably on the cusp of a new era where creating awesome websites and apps is a breeze.

You can try this online or run this on your computer, but you’ll need an OpenAI API Key, which you can get here.

ONE MORE THING

The office Copilot AI may not be as capable as GPT-4

⌚ If you have one more minute

  • 🤖Codegen - an AI tool that spins up an army of agents to solve your engineering problems.

  • 🎥 Meta came out with a new text-to-video generation model, and it looks awesome.

  • 🎤 OpenAI’s Whisper 3 proves to be the best at speech recognition.

AI Art of the Day 🎨

Here’s a new fun way to create pictures or even animations in real-time with Latent Consistency. You can play with it here!

🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄

That's all for today, folks!

If you enjoyed this, please share this hand-crafted newsletter with a friend. It would make this writer's day!