THE NEWS

🤖 Samsung introduces Galaxy AI in its new S24 phone

When Google announced Gemini Nano, an AI model designed for phones, late last year, Samsung was rumored to be one of the first to integrate it into its product.

Well, the rumors were true. Galaxy AI which is built on Gemini Nano, has debuted yesterday when Samsung revealed its new S24 series. Here are all the AI features:

Language barrier no more

Let's say you're trying to book a table in Madrid, but you don't know any Spanish beyond hola and una cerveza. With Galaxy AI's real-time voice translation feature, you can speak as you normally would, but then, the AI will step in to translate your words to the person on the other end.

And once the person responds, Galaxy AI will translate that statement for you in your native language.

You also get to choose whether to hear the original sentence in their language or just the translation.

Also, the phone shows the conversation as text on the screen, so you can read it as you talk. It would be really useful if the phone could also save these texts for later reference. I’m not sure if it can.

All this is done on the phone. That’s where the power of local AI comes into play. It’s super fast, the conversations stay private and you don’t need a good internet connection for it to work.

I wonder what happens with the translator when someone just keeps talking and talking? Does the translator wait patiently until they're finished and then start translating? That could lead to a pretty long and awkward pause, something we're not really accustomed to in a regular conversation. And here's another thought: what if the other person starts speaking again while you're still listening to the translation? Would you end up hearing both at once? I have so many questions.

What about when you need it in person? There's this app called 'Interpreter' that's perfect for when you're seeking directions from locals or, let's say, you want to confess your love to the girl sitting at the next table in a far-off, exotic country. It's designed to bridge the language gap in those face-to-face moments that matter.

The end of app switching. Let’s say you are chatting with your Colombian sweetheart but your Spanish is mid. Right now, when you hit your language limit, you have to switch to Google Translate Deepl, type the message in your language, translate, copy, switch back to WhatsApp and send.

Samsung's new Chat Assist is here to streamline this process. It cleverly detects different languages and handles the translations for you and your chat partner, all within the chat itself. No more app-hopping!

Photoshop in your phone

The Photos app also received an AI boost. Now, you can crop out people, move them around, or tilt a picture, and the phone will intelligently fill in any missing parts.

It will also automatically suggest edits, like removing shadows and reflections, and adjusting the lighting.

Tidier notes

I was notoriously bad at taking notes in high school. I never understood when to start a bullet point list or what should be a heading, so my notesbooks were always a mess. Sure, things have improved a bit now with taking notes on my phone, thanks to the option to edit them, but I rarely find the time to tidy them up. For people like me Note Assist is a blessing.

It does more than just organize your notes; it adds headings, bullet points, and even offers a summary of your note. And for those who love jotting down thoughts with the S pen, Note Assist can even straighten out your handwriting too.

Circle to Search

Ever found yourself scrolling through Instagram, spotting a plant in your friend's photo or a beautiful landscape, and wishing you could instantly know more about them? Now, it's as simple as circling them with your finger to launch a Google Search. Sure, Google Lens offered this capability before, but this new method cuts out the extra steps, streamlining visual searches to make them super convenient.

Voice Recorder

The Voice Recorder can now not only convert speech to text, but also differentiate between speakers and provide a quick summary of the conversation.

Some of these capabilities will come to a select few other Samsung devices as well, later this year. Stay tuned for those announcements. You can watch a 12-minute recap of the whole Galaxy event here.

ONE MORE THING

Bing/Copilot is dialing back on the free GPT-4 usage as it’s offering a paid subscription now.

⌚ If You Have One More Minute

• 🛰️ RunwayML just dropped "Multi Motion Brush" feature (for Creative Partners)

• 📹 Watch OpenAI's Altman and Makanju talk about the Global Implications of AI in Davos

• 🎵 AI buzzes Davos, but CEOs wrestle with how to make it pay

AI Art of the Day 🎨

Click on the tweet, watch the video and tell me Hollywood won’t be disrupted by AI within the next few years. To produce a trailer like this without actors and a crew would have been crazy to imagine just a year ago.

🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🏄🌊🌊🏄🌊🏄🌊🏄

That's all for today, folks!

If you enjoyed this, please consider sharing this hand-crafted newsletter with a friend.