Apple's new AI-powered Siri can use apps for you

As expected, Apple’s assistant is about to get much more helpful thanks to a load of new AI-powered capabilities. During WWDC, the company previewed a new version of Siri that can take actions on your behalf and understand a wide range of new queries.

The new version of Siri has a better understanding of the apps on your phone and will be able to take more than 100 actions based on your activity and device. For example, you could ask Siri to show you specific photos or memories in your Photos app or to find tracking details for an expected delivery from an email in the Mail app.

Siri will also be able to perform some tasks for you, like adding an address to a contact card, tweak a photo, or share a summary of your notes in an email. Third-party developers will also be able to take advantage of these new capabilities with a new “app intents framework” that will allow them to tap into Apple Intelligence and make certain actions compatible with Siri.

Another major change is that Siri will no longer be only a voice-activated assistant. Apple is adding a “type to Siri” that makes it a bit closer to the experience of other generative AI chatbots.

Apple didn’t specify when all of the new Siri capabilities will launch, but said the new version of its assistant will be coming to iPhone, iPad and the Mac. The revamped Siri is part of Apple’s push into “personal intelligence,” which Tim Cook described as the “next big step” for the company.

Developing...

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apples-new-ai-powered-siri-can-use-apps-for-you-184116016.html?src=rss

Apple brings a full-featured Passwords app to the Mac, iPhone, iPad and Windows

The rumors are true. Apple is adding a dedicated passwords manager app to most of its operating systems. These include macOS, iPadOS, visionOS and iOS. It’ll even work on Windows by accessing the Passwords app via iCloud. That’s pretty neat. There are way too many passwords out there.

The first-party service is powered by iCloud Keychain and will compete with some heavy hitters in the space, like LastPass and 1Password. The simply-named Passwords app will be able to list various user logins and categorize them based on service type. For instance, banking passwords would be grouped differently than social media passwords. The app will also allow users to bypass manual password input by leveraging Face ID, Touch ID and autofill.

It’s worth noting that Apple already had a password manager, but it’s not exactly beloved and has been buried in the settings page. This new app, however, is quite a compelling option for those tied into the Apple ecosystem. The company didn’t say if the app was free or if it would require a monthly subscription.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apple-brings-a-full-featured-passwords-app-to-the-mac-iphone-ipad-and-windows-181607490.html?src=rss

Apple's first attempt at AI is Apple Intelligence

Apple is going all in on AI in the most Apple way possible. At WWDC, the company’s annual conference for developers, the company revealed Apple Intelligence, an Apple-branded version of AI that is more focused on infusing its software with the technology and upgrading existing apps to make them more useful. 

On supported devices, Apple Intelligence will be able to quickly summarize web pages in Safari, a feature that already exists on rival web browsers like Arc. You’ll also be able to use Apple Intelligence to quickly catch up on priority notifications. And just like Gmail and Outlook, your devices will be able create fleshed out responses to emails and text messages on your behalf.

Apple’s AI updates are a long time coming. The technology has shaken up Silicon Valley ever since OpenAI launched ChatGPT around the end of 2022. Since then, Apple’s rivals like Google, Samsung and Microsoft, as well as companies like Meta have raced to integrate AI features in all their primary products. Last month, Google announced that AI would be a cornerstone of the next version of Android and made major AI-powered changes to its search engine. Samsung, Apple’s primary smartphone competitor, added AI features to its phones earlier this year that can translate calls in real time and edit photos. Microsoft, too, unveiled AI-powered Copilot PCs, aimed at infusing Windows with AI features that include live captioning, image editing, and beefing up systemwide search.

This is a developing story...

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apples-first-attempt-at-ai-is-apple-intelligence-181444846.html?src=rss

macOS Sequoia will let you see your iPhone mirrored on your Mac's screen

Apple's macOS 15 update is called Sequoia. The 2024 Mac software, coming this fall, includes iPhone mirroring and notification, a new passwords app and Safari upgrades.

iPhone mirroring lets you use your Mac to view, control and interact with your phone. It lets you access iOS apps and receive notifications from your nearby handset. Your iPhone screen stays locked in Standby mode while you work on your computer.

macOS also gets a new Windows-like snap window arrangement tool. Drag an app near the screen’s edge, and macOS will automatically suggest where to tile it. You can quickly place them side by side or in corners. Sequoia will also include new keyboard and menu shortcuts to arrange tiles even faster.

Apple also highlighted new video conferencing features in its WWDC keynote. Presenter Preview lets you see what you’re about to share with your call partner(s) before they see it, potentially saving folks some mistakes or embarrassment. Meanwhile, Background Replacement (as its name implies) lets you swap out your real background for built-in ones or your own photos.

1Password finally got “Sherlocked” with Apple’s new Passwords app. Building on Keychain and the passwords previously buried in Safari’s settings, the standalone app will include credentials, verification codes and security alerts. It syncs across devices and will also appear on iOS, iPadOS, visionOS and even Windows (via iCloud for Windows).

Safari gets some upgrades as well. These include Highlights, which automatically detect relevant info from webpages, and Summaries, providing AI-fueled recaps of web content in a redesigned Reader mode.

 Developing...

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/macos-sequoia-will-let-you-see-your-iphone-mirrored-on-your-macs-screen-180215857.html?src=rss

watchOS 11 includes a new Vitals app to see all your key health metrics

A new app for the Apple Watch will help you get a better overall view of your health and fitness levels. The new Vitals app synthesizes details from your Health and Fitness data. During the keynote at its Worldwide Developers Conference (WWDC) on Monday, Apple announced new features coming to watchOS 11. 

In addition to the new Vitals app, the Activity app is getting new abilities like Training Load that measures the intensity of your workout and rates your workouts. A unique algorithm will gauge your effort rating from one (easy) to ten (all out) so you can see how much you're deviating from your norm. You can also now set rest days and hang on to your streaks. 

If you like the Photos watch face, there's good news here too. Machine learning models will now help you find the best photos to feature and will automatically crop and frame it for you. 

This story is developing, please refresh for more updates.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/watchos-11-includes-a-new-vitals-app-to-see-all-your-key-health-metrics-175600647.html?src=rss

iPadOS 18's Smart Script uses machine learning to make your handwriting less horrible

Last month, Apple's tablets got a major revamp with the arrival of the M4 chip, two size options for the iPad Air, updates to the Magic Keyboard and a new iPad Pro packing a fancy Tandem OLED display. And now at WWDC 2024, Apple is looking to flesh out the iPad's software with a number of fresh features heading to iPadOS 18, which is due out sometime later this year. 

To start, iPadOS is getting new customization options for your home screen including the ability to put app icons wherever you want. Control Center has also been expanded with support for creating multiple lists and views, resizing and rearranging icons and more. There's also a new floating tab bar that makes it easy to navigate between apps, which can be further tuned to remember your favorite software. Screen Share is getting the ability to draw diagrams on someone else's iPad or even share their screen.

Apple

After years of requests, the iPad is now getting its own version of the Calculator app, which includes a new Math Notes feature that supports the Apple Pencil and the ability to input handwritten formulas. Math Notes will even update formulas in real-time or saved in case you want to revisit them later. Alternatively, the Smart Script tool in the Notes app uses machine learning to make your notes less messy and easier to edit. 

General privacy is also being upgraded with a new feature that lets you lock an app. This allows a friend or family member to borrow your device without giving them full access to everything on your tablet. Alternatively, there’s also a new hidden apps folder so you can stash sensitive software in a more secretive way.

Apple

In Messages, Tapbacks are now compatible with all your emoji. You can also schedule messages and even send messages via satellite in case you aren't currently connected to Wi-Fi or a cellular network. Apple even says messages sent using satellite will feature end-to-end encryption.

The Mail and Photos apps are also getting similarly big revamps. Mail will feature new categorizations meant to make it easier to find specific types of offers or info. Meanwhile, the Photos app will receive a new UI that makes it easier to scroll through your timeline to find specific images while hiding things like screenshots. And to help surface older photos, there will be new categories like Recent Days and People and Pets to highlight your top shots across a range of scenes and environments.

Audio on iPads is also getting a boost with a new ability for Siri to understand gestures for “Yes” and “No” by either shaking or nodding your head while wearing AirPods. This should make it easier to provide Apple's digital assistant with simple responses in areas like a crowded bus or quiet waiting room where you might be uncomfortable talking aloud.

Catch up here for all the news out of Apple's WWDC 2024.

Developing...

This article originally appeared on Engadget at https://www.engadget.com/ipados-18s-smart-script-uses-machine-learning-to-make-your-handwriting-less-horrible-175306533.html?src=rss

Apple redesigned the Photos app in iOS 18 to intelligently organize your memories

Apple’s iOS 18 update will have major changes for the Photos app. The company previewed a redesigned version of the app, that will organize all your photos around memorable moments like trips and events.

The company described the changes as the “biggest-ever” update for Photos. The new version of the app will ditch the current tabbed layout for Photos in favor of a single screen where you can view all your photos, albums and memories in one place. The familiar grid view of all your images will live at the top of the app, with intelligently organized “collections” below.There’s also a new filter button so you can look for specific types of pictures or easily weed out screenshots.

Apple is also making the app smarter with its new collections, which will sort your photos into album-like views based things like on recent trips and the people you spend the most time with. The app is also more customizable with the ability to pin albums to a dedicated section of the app.

Developing...

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/apple-redesigned-the-photos-app-in-ios-18-to-intelligently-organize-your-memories-174959393.html?src=rss

AirPods Pro update adds head-nodding gesture to silently respond to Siri

At WWDC 2024, Apple revealed a few key updates coming to AirPods this year. First, the company is adding a new head-nodding gesture on AirPods Pro that allows you to respond to Siri in crowded places where you'd rather not speak. You'll be able to nod affirmatively to silently say "yes" or shake your head for "no" and the voice assistant will react accordingly. In a demo, Apple showed a man in a crowded elevator shaking his head to tell Siri he didn't want to take a call from "Gam Gam." 

Developing...

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/airpods-pro-update-adds-head-nodding-gesture-to-silently-respond-to-siri-174141928.html?src=rss

Canon is making a new lens to capture spatial video for Apple’s Vision Pro

Alongside announcing its next-generation OS for Vision Pro, Apple wants to improve the content you can capture and share on the headset. Camera expert Canon is working on a new dedicated spatial lens for its R7 camera.

While details are light for now, the new lens, shown briefly during WWDC’s big presentation, is a lot more subtle than previous stereo lenses. It’s a 7.8mm f/4 lens with STM (stepping motor technology) that keeps focus quiet and smooth.

Canon has teased lenses aimed at VR and spatial content in the past, but intriguingly, the company has already said that none of its current cameras are high-speed enough to offer video that matches the Vision Pro. We’re waiting to hear exactly what kind of video (and at what refresh rates and resolution) this lens-and-camera combo can capture. Apple followed up with updates to its 180-degree 3D 8K video format, partnering with Blackmagic to create a new workflow to make Immersive Videos easier to capture and work with.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/canon-is-making-a-new-lens-to-capture-spatial-video-for-apples-vision-pro-173600145.html?src=rss

Yes, iOS 18 will include RCS support

Blink and you'll miss it: Apple just confirmed that RCS support will be in iOS 18 via a three-word update at the end of Craig Fedherigi's update on the new software. I wish this post was longer, with more details, but they said literally nothing else about it! We'll just have to wait until the iOS 18 beta is out there, I guess.

Catch up here for all the news out of Apple's WWDC 2024.

This article originally appeared on Engadget at https://www.engadget.com/yes-ios-18-will-include-rcs-support-173500589.html?src=rss