ChatGPT 4o-hhh my!! 😳Dissecting OpenAI's crazy Spring Update demo

ChatGPT skipped walking and went straight to running from crawling

Welcome to another edition of Anyone Can AI: your source of actionable, daily guides for learning new AI skills.

If you like a good dystopian movie every once in a while, this newsletter is for you, because we might just be living one out as I write. And if you want a front-row seat to all the AI mania as it goes down, I’ve got a button to introduce you to below.

Image courtesy of OpenAI, which today announced enhanced voice, audio, and video capabilities for its latest flagship model: ChatGPT-4o.

If there was a masterclass called ‘Demos Done Right’ on how to showcase newly released and upcoming products, all it would be is a playback of OpenAI’s 'Spring Update’ (full video here) from earlier today.

My jaw was on the ground from start to finish as research leads at OpenAI demonstrated ChatGPT’s newest capabilities, which were mainly based inside of the ChatGPT mobile app.

Today, we’re reviewing the mind-bending changes that will be coming to ChatGPT’s interface in the near future for all users - Free, Plus, & Enterprise - as well as sharing insight on what it means for the future of AI-human interaction as we know it.

Sound epic? Well, it is. And when you have a spare 30 minutes over the course of the week, perhaps in place of the doomscrolling you engage in during your morning move, the video is 100% worth a watch.

---

What We’re Diving into Today

• The Release of ChatGPT-4o

• Insane ChatGPT Audio Conversation Updates

• ChatGPT Real Time Video Analysis - it analyzed the speaker’s emotions in real time!

• Changes for Plus Users

• Changes for Free Users

• Cue the Excitement!

(Read time - 5 minutes)

---

The Release of ChatGPT-4o

A pair of lips, ears, and eyes all walked into a bar…

Besides being the punch line to an awful, half-baked joke, it’s essentially what we witnessed play out today during the demo. The room they were in even had the vibe of a cozy, speakeasy-like bar. One of those grungy ones where you’d see eccentric characters stand up at the front of the room and dish out some slam poetry.

Over the coming weeks, and with the release of ChatGPT-4o, we’ll see some pretty ‘magical’ features begin to rollout, particularly with ChatGPT’s ‘eyes’, aka its ability to understand and respond to video that it is observing.

You read that right. You’ll be able to have ChatGPT tap into the camera on your smartphone and tell you exactly what it is seeing, as demonstrated in the video when one of the research leads had the camera on his face and asked ChatGPT what emotions it looked like he was feeling based on the footage.

Spoiler alert: it got the question right and was strikingly friendly about it.

Insane ChatGPT Audio Conversation Updates

If ChatGPT had a voice before, consider it an upgrade from a humble kazoo to a full-blown orchestra. The new audio conversation features are nothing short of revolutionary.

Picture this: you’re sitting at home, a bit bored, maybe contemplating the existential dread of folding laundry. Instead, you decide to have a chat with ChatGPT. And lo and behold, it’s like having a conversation with a brilliantly articulate friend who also happens to have impeccable taste in background music.

During the demo, Mark Chen and Barrett Zoph gave us a front-row seat to ChatGPT’s real-time audio capabilities. They had a playful interaction where ChatGPT responded instantly, providing feedback on Mark's breathing exercises. Imagine this: Mark, slightly nervous, asks ChatGPT for help calming his nerves. ChatGPT, ever the supportive buddy, tells him, “You’re doing a live demo right now? That is awesome. Just take a deep breath and remember you are the expert here.” And when Mark tries his deep breathing, ChatGPT humorously chimes in with, “Whoa, slow down, Mark. You are not a vacuum cleaner.”

But it didn’t stop there. ChatGPT then narrated a bedtime story about robots in love, adjusting its voice for dramatic effect based on the tones that were asked of it, and even sang the ending in a melodious tune.

This showcase wasn't just fun—it highlighted the model's improved ability to understand and generate human-like speech, picking up on emotional cues and delivering responses that feel incredibly natural. This update is a game-changer, making interactions with ChatGPT feel less like talking to a machine and more like chatting with a clever, empathetic friend.

ChatGPT Real-Time Video Analysis

Here’s where things get really sci-fi. ChatGPT’s real-time video analysis is like having a personal assistant who also happens to be a seasoned detective and a top-tier psychologist. The demo featured ChatGPT analyzing Barrett Zoph's facial expressions in real-time, identifying his emotions accurately and providing feedback that was strikingly human-like.

During the demo, Barrett decided to put ChatGPT to the test by showing it a selfie and asking it to read his emotions. The first attempt was a bit of a laugh as ChatGPT humorously responded to a previous image of a wooden surface, but on the second try, it nailed it. “It looks like you’re feeling pretty happy and cheerful. With a big smile and maybe a touch of excitement,” ChatGPT remarked, showcasing its ability to interpret facial expressions accurately.

Imagine being on a video call, maybe for a job interview or a client meeting, and having ChatGPT subtly feeding you cues about how the conversation is going. “Looks like they’re really interested in your proposal,” it might whisper. Or perhaps, “You’ve lost them at ‘synergy,’ bring it back!” It’s the ultimate tool for mastering the art of human interaction, giving you real-time insights that could make all the difference in high-stakes situations.

Changes for Plus Users

If you’re a Plus user, prepare to feel like you’ve just unlocked a VIP pass to the future. The new features rolling out will include priority access to the latest updates, enhanced performance during peak times, and of course, all the bells and whistles that come with ChatGPT-4o.

Imagine having ChatGPT at your beck and call, ready to assist with everything from drafting emails to providing in-depth research on obscure topics (like the mating habits of tree frogs, if that’s your thing). Plus users will also benefit from more customization options, allowing you to tweak ChatGPT’s personality and responses to better suit your needs. Plus users will enjoy up to five times the capacity limits compared to free users, ensuring smoother and faster interactions even during peak times.

The demo emphasized how Plus users will get to enjoy the full suite of new features, including the advanced vision and audio analysis capabilities. This means you can now upload photos, screenshots, and documents containing both text and images, and have meaningful conversations with ChatGPT about their content. Whether you're a university professor creating content for students or a podcaster crafting engaging episodes, the possibilities are endless.

Changes for Free Users

Free users, don’t fret—you’re not left out in the cold. The upcoming updates will ensure that you also get a taste of the new and improved ChatGPT-4o, albeit with a few less frills. Expect smoother interactions, faster response times, and a more intuitive interface that makes conversing with AI as seamless as chatting with your best mate.

In addition to these enhancements, free users will now have access to advanced features like vision and audio analysis, memory for continuity across conversations, and real-time information browsing. This means you can start a conversation with ChatGPT about a screenshot or a photo, and it will respond with insightful comments as if it were right there with you. The demo showed how ChatGPT could help solve a linear equation by analyzing a handwritten note on the screen—imagine the possibilities for homework help or creative problem-solving!

Plus, the new model’s efficiency allows for broader accessibility. Free users will finally experience the high-speed, high-capacity interactions that were previously reserved for paying customers. It’s like upgrading from a tricycle to a shiny new bike with training wheels—still loads of fun and incredibly useful.

Cue the Excitement!

Alright, AI aficionados, it’s time to rev up that enthusiasm! The OpenAI Spring Update was like Christmas morning, your birthday, and winning the lottery all rolled into one for anyone who loves tech. Here’s why you should be bouncing off the walls with excitement:

1. Seamless Multi-Modal Integration: Picture this: you’re video chatting with a friend who’s showing off their new puppy. ChatGPT not only understands your conversation but also analyzes the video in real-time, identifying the puppy’s breed, suggesting cute names, and even giving training tips. It’s like having a dog whisperer, best friend, and personal assistant all in one.

2. Voice Mode 2.0: Remember the days when talking to your AI felt like yelling commands at a stubborn toaster? Those days are gone. With the new voice capabilities, ChatGPT can have a fluid, natural conversation with you, recognizing and responding to your tone and emotions. It’s like upgrading from a walkie-talkie to a chat with Morgan Freeman. Need some soothing words before a big presentation? ChatGPT’s got you covered.

3. Real-Time Emotional Intelligence: Ever wished your tech could understand you like a therapist? Now it can. ChatGPT’s real-time emotional analysis means it can read your facial expressions and adjust its responses accordingly. Whether you’re stressed, excited, or just need a good laugh, it’s like having a digital empath on standby, ready to support you.

4. Enhanced Accessibility for Free Users: Good news, everyone! No more feeling like a second-class citizen in the world of AI. The powerful features of GPT-4o are now available to free users, making high-quality AI interactions accessible to everyone. It’s like going from the nosebleed seats to front row at a rock concert without paying a dime extra.

5. Custom AI Experiences: The GPT store is now more robust than ever. Developers can create tailored ChatGPT experiences for a wide array of audiences. Whether you’re a teacher crafting interactive lessons or a podcaster creating dynamic content, the possibilities are endless. Think of it as your creative playground, with AI as your trusty sidekick.

6. Advanced Vision Capabilities: Ever had a picture that’s worth a thousand words but needed a few more? ChatGPT’s vision abilities now allow it to interpret and discuss images with you. From diagnosing plant diseases in your garden to critiquing your latest DIY project, it’s like having a knowledgeable friend with you at all times—minus the judgment.

7. Memory and Continuity: Say goodbye to repetitive explanations. With enhanced memory features, ChatGPT remembers your past interactions, creating a more personalized and seamless experience. It’s like having an AI that’s not just smart but also a great listener—finally, someone who remembers your coffee order!

8. Real-Time Information Browsing: Need the latest stock market updates, news headlines, or just curious about the weather in Timbuktu? ChatGPT can now browse real-time information and incorporate it into your conversation. It’s like having Google, Wikipedia, and your favorite news app all rolled into one chatty, intelligent package.

So there you have it—reasons to be absolutely thrilled about the OpenAI Spring Update. Whether you’re a tech geek, a casual user, or someone who just loves seeing the future unfold, there’s something here to make you gasp in excitement. Now, go forth and explore these mind-blowing new features, and remember: the future is now, and it’s ridiculously cool.