A massive leak from the FTC v. Microsoft court battle showed Microsoft's plans for a mid-generation Xbox Series X console, but that wasn't the only news. The same document also revealed Microsoft's tentative plans for the next-generation Xbox — what it calls a "hybrid game platform." The system would combine local hardware and cloud computing to create an "immersive game & app platform" arriving around 2028, according to a leaked May 2022 presentation hidden inside another PDF.

"Our vision: Develop a next generation hybrid game platform capable of leveraging the combined power of the client and cloud to deliver deeper immersion and entirely new classes of game experiences," one of the slides reads. "Optimized for real time game play and creators, we will enable new levels of performance beyond the capabilities of the client hardware alone." 

Microsoft

On the hardware side, Microsoft foresees things like next-gen DirectX raytracing, dynamic global illumination, ML based super resolution, micropolygon rendering optimization and more. The system could allow for different types of devices, ranging from relatively powerful consoles to "Thin OS... $99 consumer or handheld devices" that rely on xCloud computing. 

"Hybrid compute" would presumably differ from regular cloud gaming by using hardware and cloud computing to display in-game elements simultaneously. For instance, primary characters would run on your local GPU, while NPCs, background elements and more would be generated remotely. 

Microsoft

Microsoft also sees heavy use of AI and machine learning (ML) in next-gen gaming. From a performance vantage, neural networks would power super resolution, frame rate interpretation and latency compensation, for instance. They would improve game experiences (AI agents, codex, matchmaking, player ranking) and player services (safety & toxicity, personalization & discovery, support services). It would also aid on the creator side via AI game testing, procedural content, physics, NLP dialogue) and live ops (engagement & retention management, monetization, cloud resource optimization). 

One slide suggested Microsoft needed to forge deals with AMD for Navi 5 graphics and Zen 6 CPU cores, but another stated that the company needs to make an "Arm64 decision." In any case, it may have already begun its plans. Another slide titled "The journey has already started" shows a full roadmap: hardware design and hybrid game design starting fiscal year 2024, dev kits available by 2027 and shipping by 2028. 

Microsoft

The slide appears to be part of a conversation, and not a fixed roadmap by any means. Preceding the slideshow are documents showing a conversation between CEO Satya Nadella, Xbox's Phil Spencer, and others. Saying that the company is working on four types of computers (cloud everything, a hybrid Xbox, hybrid Windows, and hybrid HoloLens), Nadella notes that "we need to bring the company’s systems talent together to align on a unified vision," adding that "we can't go from big idea to big idea. We need to bring the company's systems talent together to align on a unified vision." 

Other ideas revolve around a "mobile controller," whereby the "controller becomes the hero." That makes it seem that Microsoft was still working out its vision for next-gen Xbox at the time of the presentation — so it may have changed course completely since then. 

We’ve already seen OpenAI and Salesforce incorporate their standalone chatbots into larger, more comprehensive machine learning platforms that span the breadth and depth of their businesses. On Tuesday, Google announced that its Bard AI is receiving the same treatment and has been empowered to pull real-time data from other Google applications including Docs, Maps, Lens, Flights, Hotels and YouTube, as well as the users’ own silo of stored personal data, to provide more relevant and actionable chatbot responses.

“I've had the great fortune of being a part of the team from the inception,” Jack Krawczyk,bproduct lead for Bard, told Engadget. “This Thursday marks six months since Bard entered into the world.”

Google

But despite of the technology’s rapid spread, Krawczyk concedes that many users remain wary of it, either because they don’t see an immediate use-case for it in their personal lives or “some others are saying, ‘I've also heard that it makes things up a lot.’” Bard’s new capabilities are meant to help assuage those concerns and build public trust with the technology through increased transparency and more fully explained reasoning by the AI.

“We started off talking about Bard as a creative collaborator because that we saw in our initial testing, that's how people use it,” he continued.”Six months into the experiment, that hypothesis is truly validating.”

The new iteration of Bard, “is the first time a language model will not only talk about how confident it is in its answer by finding content from across the web and linking to it,” Krawczyk said. “It's also the first time the language model is willing to admit that it made a mistake or got something wrong, and we think that's a critical step.” Krawczyk notes that feedback provided by the experimental tool’s users over the past half year has enabled the company to rapidly iterate increasingly robust, “more intuitive and imaginative” language models.

To that end, the chatbot can now parse and respond to more extensive and complicated prompts, such as “It’s my first semester in college and I want to get involved, but also would like to get strong grades. Help me formulate a point of view on why it’s important to balance my involvement in school clubs and extracurriculars, while also focusing on my studies.”

In order to provide these more expansive responses, Google is following OpenAI and Salesforce’s lead in enabling its AI to access the real-time capabilities of the company’s other apps — including Maps, YouTube, Hotels and Flights, among others. What’s more, users will be able to mix and match those API requests using natural language requests.

That is, if you want to take your partner to Puerto Rico on February 14, 2024 and go sightseeing, you’ll be able to ask Bard, “can you show me flights to Puerto Rico and available hotels on Valentines Day next year?” and then follow up with, “show me a map of interesting sites near our hotel” and Bard should be able to provide a list of potential flights, available hotel rooms and a list of stuff to do outside of said hotel room once you book it.

“We believe there's already a high bar for the transparency choice and control that you have with your data,” Krawczyk said. “It needs to be even higher as it relates to bringing in your private data.”

In an effort to improve the transparency of its AI’s reasoning, Google is both explicitly linking to the sites that it is summarizing, and introducing a Double Check feature that will highlight potentially unfounded responses. When users click on Bard’s G button, the AI will independently audit its latest response and search the web for supporting information. If Search turns up contradictory evidence, the statement is highlighted orange. Conversely, heavily referenced and supported statements will be highlighted green. 

Google

Users will also be able to opt-in to a feature, dubbed Bard Extensions, that will allow the AI access to their personal Google data (emails, photos, calendar entries, et cetera) so that it can provide specific answers about their daily lives. Instead of digging through email chains looking for a specific important date, for example, users will be able to ask Bard to scour their Gmail account for the information, as well as summarize the most important points of the overall discussion. Or, the user could work with the chatbot to draft a cover letter based specifically on the work experience listed in their resume.

And to allay concerns over Google potentially having even more access to your personal data than it already does, the company has pledged that “your content from Gmail, Docs and Drive is not seen by human reviewers, used by Bard to show you ads or used to train the Bard model.” What’s more, users will be able to opt in and out of the system at will and can allow or deny access to specific files. The service is initially only available to non-enterprise users in English, though the company is working to expand those offerings in the future.

“We think that this is a really critical step, but so much context is required in communication,” Krawczyk said. “We think really harnessing the healthy and open web is key because what we found in the first six months of Bard is, people will see a response and then follow up with trusted content to actually understand and go deeper. We're excited to provide that for people with this new experience.”

A Microsoft AI research team that uploaded training data on GitHub in an effort to offer other researchers open-source code and AI models for image recognition inadvertently exposed 38TB of personal data. Wiz, a cybersecurity firm, discovered a link included in the files that contained backups of Microsoft employees' computers. Those backups contained passwords to Microsoft services, secret keys and over 30,000 internal Teams messages from hundreds of the tech giant's employees, Wiz says. Microsoft assures in its own report of the incident, however, that "no customer data was exposed, and no other internal services were put at risk."

The link was deliberately included with the files so that interested researchers could download pretrained models — that part was no accident. Microsoft's researchers used an Azure feature called "SAS tokens," which allows users to create shareable links that give other people access to data in their Azure Storage account. Users can choose what information can be accessed through SAS links, whether it's a single file, a full container or their entire storage. In Microsoft's case, the researchers shared a link that had access to the full storage account. 

Wiz discovered and reported the security issue to Microsoft on June 22, and the company had revoked the SAS token by June 23. Microsoft also explained that it rescans all its public repositories, but its system had marked this particular link as a "false positive." The company has since fixed the issue, so that its system can detect SAS tokens that are too permissive than intended in the future. While the particular link Wiz detected has been fixed, improperly configured SAS tokens could potentially lead to data leaks and big privacy problems. Microsoft acknowledges that "SAS tokens need to be created and handled appropriately" and has also published a list of best practices when using them, which it presumably (and hopefully) practices itself. 

Microsoft is planning a mid-generation refresh of the Xbox Series X with a new disc-less cylindrical design, according to a document accidentally revealed from the FTC v. Microsoft court battle. It also leaked the existence of a new controller with a gyro (codenamed Sebile), a refreshed Xbox Series S, key specs for the new devices and a timeline. It's not clear how the documents came into public view, but they could be damaging for Xbox's gaming business, as it shows the company's strategy well over a year in advance.

Microsoft previously stated it has no plans to a mid-gen console refresh, but that doesn't appear to be true according to the document. In fact, the company plans no less than three new consoles. The first, codenamed Ellewood, is a light refresh of the Xbox Series S (set to arrive in September 2024), while "Brooklin," tentatively planned for November 2024, is a new disc-less version of the Xbox Series X. Another model, called XDL, matches Brooklin's specs but will presumably offer Xbox Design Lab customization. 

Microsoft via FTC

Microsoft's two-tone "Sebile" controller has a built-in accelerometer and haptics that "double as speakers," which would make it more like Sony's latest DualSense controller. It also features new modular thumbsticks, quieter buttons and thumbsticks and new app features, along with sustainability tweaks like a swappable battery, recycled materials and improved reparability. Once it's released, we'll likely see games with support for the gyro, letting you maneuver just by moving the controller around. The company will also have an XDL version of Sebile, codenamed Igraine.

The star of this leak is the new updated Xbox Series X console, though. While Microsoft touts it as "adorable" (presumably due to the cylindrical design that's less severe than the current fridge-like Xbox Series X), many gamers may not find the lack of a disc cute at all. 

Along with the new design, the Series X will come with Wi-Fi 6E, Bluetooth 5.2, USB-C front port, an all-new southbridge "to modernize IO and sustainability efforts" and a 6-nanometer die shrink. That will result in a reduced (15 percent) power draw with a new low-power standby mode that's up to 80 percent less than current standby, along with increased use of recycled plastic (>30 percent) and 100 percent recycled packaging. 

Microsoft via FTC

It'll have 2TB of storage, or double the current model, and come standard with the Sebile controller. Microsoft also notes that it'll have the "same great price" as the current Xbox Series X at $499 when it arrives (tentatively November 2024), but that's a somewhat disingenuous statement given the lack of a disc.

The Xbox Series S will have similar improvements inside, along with double the storage (1TB rather than 512GB), though the design appears relatively unchanged. It's also set to carry the same current $299 price, with availability tentatively set for September 2024. 

A lot more information is laid out, including things that Microsoft would no doubt want private, like projected sales volumes, margins, funding and more. For instance, Microsoft notes that "Sebile full product vision not currently approved due to GM % (gross margin percentage), and appears to place that ball in the "Finance" court. It also outlines a "path to leadership in gaming" with a vision of cloud-first, PC-first and console-first Xbox Game Pass subscription numbers. The leak appears to be a massive screwup that will likely cause some severe fallout, so stay tuned.

After 38 years, Microsoft is updating its Paint App with support for image transparency and layers. For most of us, MS Paint brings waves of nostalgia and memories of spending hours trying to be Picasso. Back then, you had a pencil, brushes, a handful of colors and not much else. Now, it seems Microsoft is beefing up its app to make it more useful for slightly more advanced image editing. In a blog post, Dave Grochocki, Principal Product Manager for Windows Inbox Apps, announced the new features and "exciting" new possibilities.

"When you combine layers, transparency, and other tools in Paint, you can create exciting new images and artwork! For example, when combined with the new background removal feature, you can quickly create interesting layered compositions," Grochocki said.

To get started, you'll need to click on the new layer option in the toolbar and that will open a panel on the side of the canvas. From there, you can hide, duplicate, merge or delete layers — much like you can do in other, more robust photo editing software. As of right now, the update is only available to users who are signed up to receive Windows Insider software builds. The features are not currently available to all Windows users, but are likely to be rolled out soon.

While it isn't the most groundbreaking thing, people who are still using MS Paint will find these features useful. And it's likely Microsoft will continue to update its Paint app, since the company has made it clear: MS Paint is here to stay.

Agility Robotics, the creator of the bipedal robot Digit, is opening a manufacturing plant in Salem, Oregon that will give the company the capacity to produce more than 10,000 humanoid robots a year. The 70,000 square foot factory coined “RoboFab” is set to open later this year and will employ upwards of 500 workers in Salem.

Agility Robotics says its facility will also employ its very own Digits, the iconic humanoid robot, in the new factory. The Digits will help move, load and unload warehouse goods.

The company says some customers can expect delivery of the first Digits in 2024, with general market availability in 2025. In a statement, Damion Shelton, Agility Robotics’ co-founder and CEO says that the ultimate goal of creating Digits is to “Solve difficult problems in today’s workforce like injuries, burnout, high turnover and unfillable labor gaps.”

The manufacturing of bipedal robots is something we have seen teased by competitors like Boston Dynamics’ Atlas and Tesla’s Optimus robot prototype. However, none have matured to the extent of being able to churn out thousands of robots like that being seen in this effort by Agility Robotics. Still, until these robots are actually in production, it's too soon to say if Agility Robotics’ warehouse robots, which are designed to fill a gap in the logistics and distribution industry, will actually surpass its competitors in this newly burgeoning market.

It's a big day for Apple users as the company is rolling out major operating system updates for most of its devices (Mac users need to wait a bit longer). Just ahead of the Apple Watch Series 9 and Apple Watch Ultra 2 arriving later this week, the company has released watchOS 10. If you have an Apple Watch Series 4 or above, you can install it now.

The biggest change is the introduction of widgets (which are a bit like Glances from Apple's original wearable) for every watch face, which include two new ones. You'll be able to use the Digital Crown to cycle through your widgets and see access features like timers, stopwatches and podcasts when those are active. 

The World Clock app should make it easier to understand the time of day in different parts of the world at a glimpse thanks to the addition of dynamic background colors. for various timezones. In the Activity app, you'll be able to rotate the crown to see more data via corner shortcuts. There's the option to connect to Bluetook bike sensors to help cyclists track more data too. The Compass, Mindfulness and Medications apps are all getting updates as well. 

Perhaps two of the biggest updates for most people are related to FaceTime. You can view a FaceTime video message on your Watch and join Group FaceTime audio calls.

The Apple Watch Series 9 and Apple Watch Ultra 2 will get some exclusive features powered by the new S9 SiP, including Siri requests that are processed on-device rather than through Apple's servers. They also support a new Double Tap feature Apple designed to make it easier to carry out the main action in each app. Both devices will be available on September 22.

iPadOS 17 is available now. The annual update lacks a single headline-grabbing feature, but the sum of its smaller changes enhances the experience of using Apple’s tablet. Changes include Stage Manager refinements, along with Lock Screen additions and interactive widgets to match the iPhone’s new features from a year ago.

You can install iPadOS 17 on recent models. It supports the iPad Pro 12.9 (2nd-gen or later), iPad Pro 10.5, iPad Pro 11 (1st-gen or later), iPad Air (3rd gen or later), standard iPad (6th gen or later) and iPad mini (5th gen or later). If you don’t know which device you have, you can navigate to Settings > General > About > Model Name to determine which one it is.

Once you know your device is eligible, you can head to Settings > General > About > Software Update to manually initiate the download and installation. If you had auto-updates turned on, it would install eventually, but perhaps not until later in the week.

iPadOS 17 catches up on a couple of iOS 16 features that didn’t make it to the iPad last year, including a revamped and more customizable Lock Screen (including an easier and more robust wallpaper picker) and interactive widgets. In addition, the Health app makes its way to the bigger screen and you can more easily adjust Stage Manager to fit your needs. Finally, iOS 17’s FaceTime and Messaging updates are included on the tablet software as well. You can read more about iPadOS 17’s features in Engadget’s full preview.

iOS 17 is here. Apple has made the annual update available to all users on eligible devices, meaning you can install it right now without bothering with beta programs. The 2023 iPhone software update includes significant updates to Messages, FaceTime, the keyboard and more.

You can install iOS 17 on any iPhone from 2018 or later. Once you know your device is eligible, you can head to Settings > General > About > Software Update to manually initiate the download and installation.

This year’s iOS upgrade includes audio message transcriptions and a rethinking of the Messages app. (iMessage apps and other tools now live behind a plus button next to the text entry field.) FaceTime adds video voicemails, and you can even take calls on an Apple TV, using an iPhone or iPad as the camera. StandBy mode is a new feature that turns your handset into a smart display when it’s charging and positioned horizontally. Meanwhile, NameDrop lets you quickly exchange contact info with new friends by tapping your devices together, and a new inline predictive text feature lets the keyboard predict and (optionally) finish your sentences for you.

You can read more about the new features in Engadget’s full iOS 17 preview. For more details on installing the update, you can read our tutorial.

Google is continuing its shift away from smart devices by discontinuing support for both Zoom and Google Meet on its Nest Hub Max, 9to5Google reported. Some users have started receiving notifications that they can no longer join meetings from the device beginning September 28. The news follows Zoom's July announcement that Nest Hub Max support will end for the video calling service on September 30 — guess Google really wanted the services gone by October.

We were fans of the Google Nest Hub Max when it first came out in 2019, giving it an 86 in our review for features like its high-quality display and sound. It initially only offered Google Duo, but the subsequent emergence of the pandemic led to the rollout of Zoom and Meet, and the device soon became known (and bought) for video calling. Now, those programs are on their way out. Plus, Google stopped all game and third-party voice app support in June, and its Nest Cam still hasn't moved over to the Google Home app.

Nest Hub Max owners aren't pleased with the changes: One Reddit user said, "What will it become? A giant paperweight." Another user mentioned seeking a refund since the video calling feature convinced them to buy the device.