I’m here to see the future of computing. But at the moment, I’m trying to coax a butterfly onto a nectar-dipped stick. I feel like I’m bothering the insects, but the monarch butterfly caretakers accompanying us in a 10-foot screened-in box insist that it’s okay, so I follow their instructions and keep gently prodding the feet of whichever butterfly is closest, willing it to hold on.
As we each gradually work on securing a butterfly, one of the butterfly experts asks our small group politely how our product launch is going. There’s a brief, collective silence. None of us have the energy to explain that it’s not our launch; we’re just here to cover and analyze it. But rather than explain this deeply boring backstory, someone in our group mercifully pipes up, “It’s going great.”
After many failed attempts, I finally get one of the little guys to hang on. There’s a rush of pride as I turn to the rest of the group and announce, “Look, I got one!” And then there’s nothing to do except stand awkwardly, wondering what comes next.
Qualcomm CEO Cristiano Amon presented his keynote speech with all of his usual vigor.
Related Post
Qualcomm’s annual Snapdragon Summit is weird like that. Every year, the company invites a lot of industry partners, analysts, and members of the press to Hawaii to bear witness to its next flagship chip announcement. I’ll tell you right now that industry partners, analysts, and members of the press are largely indoorsy people who are wholly unaccustomed to tropical climates. By the end of day two, I’d sweated through every item of clothing I packed and started doing laundry in my hotel room sink. On the plus side, my room’s patio is so hot that my clothes are bone-dry in a few hours.
Our butterfly encounter is part of a circuit of demo stations designed to show off the capabilities of the company’s latest tech. The stations are all positioned outside in the midday tropical sun, and by the time we get to the butterfly area, we are looking generally unwell and quite damp. Qualcomm has done a conscientious thing of incorporating elements of traditional Hawaiian culture into each station alongside its technology demos. Some are loosely connected; we learn the history of slack-key guitar while we try out a new audio switching technology.
Our first stop included a demonstration where we learned how poi is made, which is a traditional Hawaiian food staple.
Others don’t tie in as neatly, and an hour into the session, I’m not clear on what the monarch butterflies have to do with the next generation of mobile computing, but I’m too hot to care. After a while, our butterfly guides show us how to gently grasp a butterfly by holding its closed wings between two fingers, and we’re instructed to take one out of the enclosure and release them en masse as we each make a wish. My mind flips rapidly through about a half-dozen, from thoughts of peace and healing for the people of Maui, where we are visitors, to, “I’d like to get out of the sun as quickly as possible.”
With our butterflies free, we step over to the tech demo station and see one of the features I’ve been waiting for: generative photo expansion. It’s a feature supported by the Snapdragon 8 Gen 3, the mobile chipset Qualcomm has just announced. You pinch and zoom out of an image and watch as generative AI fills in the borders in a matter of seconds.
The concept is neat; the demo itself is a mixed bag. It handled some preloaded scenes quite well. But when challenged to fill in part of a picture of a face, things don’t go so well. Later on, I would see similar results — sometimes it’s incredibly impressive, but one time, it adds a disembodied sexy leg alongside a landscape. Other demos throughout the summit are a similar mix of impressive and not-quite-right. A couple of onstage demonstrations of on-device text generation go slightly sideways: what starts with a request to plan a trip from San Diego to Seattle shifts mid-demo to a trip from Maui to Seattle. Impressive, until it isn’t.
And that kind of sums up my feelings about the vision of a generative AI future I was shown over the week. The most optimistic scenario is the picture Qualcomm executives painted for me through its keynotes and a series of interviews: that on-device AI is truly the next turn in mobile computing — our phones won’t be the annoying little boxes of apps that they’ve turned into. AI will act as a more natural, accessible interface and a tool for all the things we want our devices to do. We’ll regain the mental and emotional overhead we spend every day on tapping little boxes and trying to remember what we were doing in the first place as we get lost in a sea of unscheduled scrolling.
Impressive, until it isn’t
AI could also be a real dumpster fire, too. There’s all the potential for misuse that could undo the very fabric of our society. Deepfakes, misinformation, you know, the real bad stuff. But the AI we’re probably going to encounter the most just seems annoying. One of the demos we’re shown features a man talking to a customer service AI chatbot about his wireless plan upgrade options, which is a totally pleasant exchange that also sounds like a living nightmare. You better believe that AI chatbots are about to start showing up in a lot of places where we’re accustomed to talking to a real person, while the barriers to letting you just “TALK TO A REPRESENTATIVE” grow ever higher.
To someone who isn’t constantly immersed in the whirling hot tub that is the consumer tech news cycle, this latest Coming of AI might sound thoroughly unimpressive. Hasn’t AI been around for a while now? What about the AI in our phone cameras, our assistants, and ChatGPT? The thing to know — and the thing that Qualcomm takes great pains in emphasizing over the course of a week — is that when the AI models run on your device and not in the cloud. It’s different.
If you had to wait 15 or 20 seconds for confirmation every time you asked Google to set a timer, you’d never use it again
The two keywords in this round of AI updates are “generative” and “on-device.” Your phone has already been using software trained on machine learning to decide which part of your photo is the sky and how blue it should be. This version of AI runs the machine learning models right on your phone and uses them to make something new — a stormy sky instead of a blue one.
Likewise, ChatGPT introduced the world to generative AI, but it runs its massive models in the cloud. Running smaller, condensed models locally allows your device to process requests much faster — and speed is crucial. If you had to wait 15 or 20 seconds for confirmation every time you asked Google to set a timer, you’d never use it again. Cutting out the trip to the cloud means you can reasonably ask AI to do things that often involve several follow-up requests, like generating image options from text again and again. It’s private, too, since nothing leaves your phone. Using a tool like Google’s current implementation of Magic Editor requires that you upload your image to the cloud first.
Generative AI as a tool has well and truly arrived, but what I’m trying to understand on my trip to the tropics is what it looks like as a tool on your phone. Qualcomm’s senior vice president of technology planning Durga Malladi provides the most compelling, optimistic pitch for AI on our phones. It can be more personal, for one thing. When I ask for suggested activities for a week in Maui, on-device AI can take into account my preferences and abilities and synthesize that information with data fetched from the cloud. Beyond that, Malladi sees AI as a tool that can help us take back some of the time and energy we spend getting what we want out of our phones. “A lot of the time you…
