Apple is integrating GPT-4o, the large language model that powers ChatGPT into iOS 18, iPadOS 18 and MacOS Sequioa thanks to a partnership with OpenAI announced at WWDC, the company’s annual developer conference, on Monday. But shortly after the keynote ended, Craig Federighi, Apple’s senior vice president of software engineering said that the company might also bake in Gemini, Google’s family of large language model, into its operating systems.

“We want to enable users ultimately to choose the models they want, maybe Google Gemini in the future,” Federighi said in a conversation with reporters after the keynote. “Nothing to announce right now.”

The news is notable because even though Apple did mention plans to add more AI models into its operating system in the keynote, it didn’t mention Gemini specifically. Letting people choose the AI model they want on their devices instead of simply foisting one on them would give Apple devices a level of customization that none of its competitors like Google or Samsung have.

Catch up here for all the news out of Apple's WWDC 2024.

Currently, Unicode 15.1 supports just shy of 3,800 various emoji. But for everyone out there that for some reason thinks that's not nearly enough, today at WWDC 2024, Apple announced the ability to use AI to generate unique emoji based on your prompts.

Called Genmoji, which looks to be an awful portmanteu of the words "generate" and "emoji," these new creations are powered by Apple Intelligence, which is a new collection of AI features coming to the iPhone, iPad and Mac sometime later this year. Similar to creating images with services like Midjourney and Dall-E, users will be able to whip up custom emoji by inputting specific prompts. Once made, they can be shared with others as stickers, reactions in a Tapback or simply embedded in-line in messages. 

Apple

While the feature isn't expected to be officially available until later this fall, there don't seem to be any major limitations to what you can dream up. In a teaser at WWDC, Apple showed examples like a smiley face with cucumbers over its eyes and a T-rex riding a skateboard while wearing a tutu. That said knowing Apple, there is sure to be some restrictions for Genmoji made using more graphic prompts like guns or blood. 

Now on some level, it could be fun to razz your friends with Genmoji based on their latest mishap. But at the same time, part of the magic of emoji has always been being able to convey a message using the limited number of icons while still getting your point across. Also, it's truly hard to imagine how much added value a bagel with lox Genmoji (see the lead picture above) provides compared to the classic image. But since AI is so hot right now, seeing Apple Intelligence get applied to emoji was probably an inevitability. 🤷‍♂️

As rumored, Apple confirmed at WWDC 2024 that it’s made a deal with OpenAI to bring ChatGPT to the iPhone and other devices. GPT-4 will power cloud-based AI queries in iOS 18, iPadOS 18 and macOS Sequoia.

Apple’s Craig Federighi said Siri can (with your permission) tap into ChatGPT’s knowledge base “when it might be helpful.” Examples include asking for menu ideas for an elaborate meal with specific ingredients.

Developing...

Catch up here for all the news out of Apple's WWDC 2024.

Today's keynote for Apple's Worldwide Developers Conference teased a lot of what users can expect later this year when all of its major software updates roll out. Big changes coming to iOS 18, macOS Sequoia and watchOS 11 include RCS support, a new Passwords app, a revamped Calculator app and a bunch of artificial intelligence (AI) infusions across the board thanks to the new "Apple Intelligence" system. If you weren't able to catch the news live, here's a rundown of everything announced at WWDC 2024.

Apple Intelligence

Apple

Apple revealed its plans to incorporate AI into its operating systems at WWDC this year. Dubbed "Apple Intelligence," this new generative AI system will appear in iOS and iPad 18 and macOS Sequoia in the form of (what Apple believes to be) practical tools that most people can use regularly. Those features include new writing tools that can help you rewrite, proofread and summarize things like emails and other messages, original emoji and image creation and more. The company emphasized the importance of "personal context" with Apple Intelligence, which will enable things like more specific actions such as using natural language to search for photos that contain only you and a specific family member.

Going hand-in-hand with original image generation is a new feature called Gemoji, which allows users to create their own unique emojis by typing in descriptions and requirements like "T-rex wearing a tutu on a surfboard."

Siri is getting an AI infusion now that it will be powered in part by large language models. In addition to asking Siri to delete an email or edit a photo, users will also be able to ask the virtual assistant to summarize articles and webpages in Safari and even extract personal information from a picture of your ID so it can fill out an online form for you.

Apple highlighted how most of the actions involved with Apple Intelligence will be done on-device, to make the system as privacy-focused as possible. But also, the company detailed how those with the latest Apple devices can use ChatGPT for free to answer queries that cannot be done on-device. Much of that involves users providing permission for Apple to share their query with ChatGPT in the moment. ChatGPT integration with iOS 18, iPadOS 18 and macOS Sequoia will roll out later this year.

iOS 18 and iPadOS 18

Apple

The next iPhone software update will roll out to users in the fall and, as expected, one of the biggest changes is support for Rich Communication Service, or RCS. The more-secure messaging protocol offers many improvements over SMS including end-to-end encryption, better media sharing and support for proper group chats. Apple previously stated it would adopt support for RCS in 2024 to comply with EU regulations, so it's unsurprising to see it highlighted in iOS 18's forthcoming features. Also new to Messages will be the ability to "tapback" reply using emojis and stickers, text formatting and effects and the ability to send messages via satellite.

iPhone users will have more control over their home screens in iOS 18 thanks to the fact that it will not be a locked grid system anymore. Users will be able to move app icons a more of a freestyle way, plus they'll be able to change app icon colors as well using a tint color picker. In terms of design and layout, this is one of the biggest changes to come to the iPhone's home screen in years and it gives iOS users similar features that Android users have had for a long time.

The Calculator app is getting a big overhaul in iOS 18, including improved unit conversions, a sidebar showing recent activity and integration with the Notes app. But what might be even more notable is the fact that the revamped Calculator app will not only be available on iPhones and Macs — it's coming to iPads for the first time as part of the iPadOS 18 update. Embedded within the iPadOS Calculator app is a new feature called Math Notes, which lets users write out math equations with the Apple Pencil and the app will solve many of them instantly.

iPadOS 18 will also feature a new Tab Bar, which looks similar to the Dynamic Island on iPhones. This bar makes it easier to access essential controls even when you're in apps, and depending on what you're doing, it can show up at the top of the screen or as a sidebar of sorts on the left of the display.

macOS Sequoia

Apple

The next iteration of Apple's computer software will be called macOS Sequoia. In addition to many of the AI features also coming to iOS and iPadOS 18 as part of Apple Intelligence, the next macOS update will include iPhone mirroring, which lets users see and control their iPhone screen on a Mac screen. They'll be able to use their keyboard and trackpad to intact with the iPhone screen on their laptop, and they can even open iOS apps directly on their computers.

A new Passwords app builds upon the technology of iCloud keychain to save all of users' passwords and login credentials across devices and platforms (it will be available on Windows in addition to all Apple platforms). Along with standard passwords, the new app can save passkeys, verification codes and more, and give users the ability to securely share passwords with others.

watchOS 11

Apple

The next software update for the Apple Watch includes two big changes: Training Load and a new Vitals app. Training Load in watchOS 11 essentially uses many of the health and fitness metrics collected during workout tracking to estimate your effort level each time. Each workout will receive a rating from one (easy) to ten (all out) that estimates how hard the user worked during that particular session.

The new Vitals app will show Apple Watch users how their vitals captured, including heart rate, compare to baseline measurements. This will hopefully allow users to better understand when something might be off and outside the normal suggested range.

The Activity app on iPhone is also getting an update to accompany watchOS 11, and will allow users to customize the data they see on the homepage so they can put the most important stats to them front and center. Cycle Tracking will also get an update to include more detailed pregnancy insights, including gestational age and information about the user's health metrics that may related to pregnancy (like heart rate fluctuations). 

visionOS 2

Apple

Until now, Apple's Vision Pro headset has only been available in the US. That's changing soon as the company announced the device's rollout in additional countries including Australia, Canada, China, France, Germany, Japan, Singapore and the UK. As far as the headset's software, visionOS goes, Apple announced that visionOS 2 will add spatial photos, which adds depth to images in the Photos app, new UI gesture controls and improved Mac screen mirroring with support for higher resolutions and display sizes.

AirPods Pro audio updates

Apple

Apple briefly mentioned some software updates coming to AirPods Pro, including improved Voice Isolation, which should help the buds better pick up a user’s voice in noise environments. A new Siri Interaction is coming to AirPods Pro as well: a silent head-nod will allow users to answer an incoming call without saying a word out loud to Siri, and contrasty, a shake of the head will decline a call. These silent interactions will also be applicable to messages and notifications, in addition to calls.

Developing...

Catch up here for all the news out of Apple's WWDC 2024.

The rumors are true. Apple is adding a dedicated passwords manager app to most of its operating systems. These include macOS, iPadOS, visionOS and iOS. It’ll even work on Windows by accessing the Passwords app via iCloud. That’s pretty neat. There are way too many passwords out there.

The first-party service is powered by iCloud Keychain and will compete with some heavy hitters in the space, like LastPass and 1Password. The simply-named Passwords app will be able to list various user logins and categorize them based on service type. For instance, banking passwords would be grouped differently than social media passwords. The app will also allow users to bypass manual password input by leveraging Face ID, Touch ID and autofill.

It’s worth noting that Apple already had a password manager, but it’s not exactly beloved and has been buried in the settings page. This new app, however, is quite a compelling option for those tied into the Apple ecosystem. The company didn’t say if the app was free or if it would require a monthly subscription.

Catch up here for all the news out of Apple's WWDC 2024.

Apple is going all in on AI in the most Apple way possible. At WWDC, the company’s annual conference for developers, the company revealed Apple Intelligence, an Apple-branded version of AI that is more focused on infusing its software with the technology and upgrading existing apps to make them more useful. 

On supported devices, Apple Intelligence will be able to quickly summarize web pages in Safari, a feature that already exists on rival web browsers like Arc. You’ll also be able to use Apple Intelligence to quickly catch up on priority notifications. And just like Gmail and Outlook, your devices will be able create fleshed out responses to emails and text messages on your behalf.

Apple’s AI updates are a long time coming. The technology has shaken up Silicon Valley ever since OpenAI launched ChatGPT around the end of 2022. Since then, Apple’s rivals like Google, Samsung and Microsoft, as well as companies like Meta have raced to integrate AI features in all their primary products. Last month, Google announced that AI would be a cornerstone of the next version of Android and made major AI-powered changes to its search engine. Samsung, Apple’s primary smartphone competitor, added AI features to its phones earlier this year that can translate calls in real time and edit photos. Microsoft, too, unveiled AI-powered Copilot PCs, aimed at infusing Windows with AI features that include live captioning, image editing, and beefing up systemwide search.

This is a developing story...

Catch up here for all the news out of Apple's WWDC 2024.

Apple's macOS 15 update is called Sequoia. The 2024 Mac software, coming this fall, includes iPhone mirroring and notification, a new passwords app and Safari upgrades.

iPhone mirroring lets you use your Mac to view, control and interact with your phone. It lets you access iOS apps and receive notifications from your nearby handset. Your iPhone screen stays locked in Standby mode while you work on your computer.

macOS also gets a new Windows-like snap window arrangement tool. Drag an app near the screen’s edge, and macOS will automatically suggest where to tile it. You can quickly place them side by side or in corners. Sequoia will also include new keyboard and menu shortcuts to arrange tiles even faster.

Apple also highlighted new video conferencing features in its WWDC keynote. Presenter Preview lets you see what you’re about to share with your call partner(s) before they see it, potentially saving folks some mistakes or embarrassment. Meanwhile, Background Replacement (as its name implies) lets you swap out your real background for built-in ones or your own photos.

1Password finally got “Sherlocked” with Apple’s new Passwords app. Building on Keychain and the passwords previously buried in Safari’s settings, the standalone app will include credentials, verification codes and security alerts. It syncs across devices and will also appear on iOS, iPadOS, visionOS and even Windows (via iCloud for Windows).

Safari gets some upgrades as well. These include Highlights, which automatically detect relevant info from webpages, and Summaries, providing AI-fueled recaps of web content in a redesigned Reader mode.

 Developing...

Catch up here for all the news out of Apple's WWDC 2024.

A new app for the Apple Watch will help you get a better overall view of your health and fitness levels. The new Vitals app synthesizes details from your Health and Fitness data. During the keynote at its Worldwide Developers Conference (WWDC) on Monday, Apple announced new features coming to watchOS 11. 

In addition to the new Vitals app, the Activity app is getting new abilities like Training Load that measures the intensity of your workout and rates your workouts. A unique algorithm will gauge your effort rating from one (easy) to ten (all out) so you can see how much you're deviating from your norm. You can also now set rest days and hang on to your streaks. 

If you like the Photos watch face, there's good news here too. Machine learning models will now help you find the best photos to feature and will automatically crop and frame it for you. 

This story is developing, please refresh for more updates.

Catch up here for all the news out of Apple's WWDC 2024.

Last month, Apple's tablets got a major revamp with the arrival of the M4 chip, two size options for the iPad Air, updates to the Magic Keyboard and a new iPad Pro packing a fancy Tandem OLED display. And now at WWDC 2024, Apple is looking to flesh out the iPad's software with a number of fresh features heading to iPadOS 18, which is due out sometime later this year. 

To start, iPadOS is getting new customization options for your home screen including the ability to put app icons wherever you want. Control Center has also been expanded with support for creating multiple lists and views, resizing and rearranging icons and more. There's also a new floating tab bar that makes it easy to navigate between apps, which can be further tuned to remember your favorite software. Screen Share is getting the ability to draw diagrams on someone else's iPad or even share their screen.

Apple

After years of requests, the iPad is now getting its own version of the Calculator app, which includes a new Math Notes feature that supports the Apple Pencil and the ability to input handwritten formulas. Math Notes will even update formulas in real-time or saved in case you want to revisit them later. Alternatively, the Smart Script tool in the Notes app uses machine learning to make your notes less messy and easier to edit. 

General privacy is also being upgraded with a new feature that lets you lock an app. This allows a friend or family member to borrow your device without giving them full access to everything on your tablet. Alternatively, there’s also a new hidden apps folder so you can stash sensitive software in a more secretive way.

Apple

In Messages, Tapbacks are now compatible with all your emoji. You can also schedule messages and even send messages via satellite in case you aren't currently connected to Wi-Fi or a cellular network. Apple even says messages sent using satellite will feature end-to-end encryption.

The Mail and Photos apps are also getting similarly big revamps. Mail will feature new categorizations meant to make it easier to find specific types of offers or info. Meanwhile, the Photos app will receive a new UI that makes it easier to scroll through your timeline to find specific images while hiding things like screenshots. And to help surface older photos, there will be new categories like Recent Days and People and Pets to highlight your top shots across a range of scenes and environments.

Audio on iPads is also getting a boost with a new ability for Siri to understand gestures for “Yes” and “No” by either shaking or nodding your head while wearing AirPods. This should make it easier to provide Apple's digital assistant with simple responses in areas like a crowded bus or quiet waiting room where you might be uncomfortable talking aloud.

Catch up here for all the news out of Apple's WWDC 2024.

Developing...

At WWDC 2024, Apple revealed a few key updates coming to AirPods this year. First, the company is adding a new head-nodding gesture on AirPods Pro that allows you to respond to Siri in crowded places where you'd rather not speak. You'll be able to nod affirmatively to silently say "yes" or shake your head for "no" and the voice assistant will react accordingly. In a demo, Apple showed a man in a crowded elevator shaking his head to tell Siri he didn't want to take a call from "Gam Gam." 

Developing...

Catch up here for all the news out of Apple's WWDC 2024.