Apple’s Worldwide Developers Conference next week promises to be a pivotal moment in the iPhone maker’s history. At WWDC, the Cupertino tech giant will showcase how it’s chosen to integrate AI technology into its devices and software, including through a historic partnership with OpenAI. As the big event nears, all sorts of leaks have emerged about what iOS 18 and its rumored AI-powered apps and features have in store.
Among the changes, Apple is said to be powering some of its new AI features with its Ajax LLM. Other reports indicate that Apple plans to process data from AI in a way that even employees won’t be able to access, which would help Apple continue to deliver on its promise of data privacy for its users.
Below, we’ll take a look at how Apple is said to be adding AI to its apps and services in the next big update for the iPhone, alongside other improvements and changes coming to iOS 18.
Siri’s AI-enabled future
- Apple’s digital assistant is prepared to get an AI revamp. The digital assistant will leverage Apple’s own large language models and will allow Siri to control individual features inside applications. This will work without any necessary setup by developers or users, like App Intents or Siri Shortcuts currently require. Instead, users will be able to ask Siri to do things like delete an email or edit a photo, for example.
- Some of Siri’s upgraded AI capabilities won’t be ready until next year, however. For example, the ability for Siri to handle tasks with multiple steps, is likely delayed.
- A more advanced Siri will also come to Apple Watch for on-the-go use. You could use Siri on your Watch to play music on another device, one report said.
- Siri will receive more natural-sounding voices.
- Siri will be able to summarize notifications that include people, companies, calendar events, locations, dates and more.
- Could Siri’s new look be hinted at in the animations below?
Apple Photos’ new look
- A new interface is being teased.
- People will also have the ability to retouch photos with AI, perhaps challenging Google Photos in this area.
- A “Clean Up” feature, for instance, would let you remove objects from your photos using generative AI technology, similar to Google’s Magic Eraser.
- One report noted that Apple made an internal-only application called Generative Playground that uses genAI to create and edit images. It’s unclear how this functionality will be presented to end users, though iMessage integration was spotted in the form of an app extension.
Safari with more AI
- AI recaps of Safari web pages and news articles will be available through a new Intelligent Search feature. (Watch out Arc?)
Notes injected with AI
- Users will be able to ask for AI recaps of Notes.
- GenAI will also help to transcribe audio in Notes.
- In-app audio recording will be supported alongside audio transcription and AI summarization.
- Math Notes will help users create graphs and solve equations through AI by recognizing the text of mathematical equations and then helping you to solve them.
- Notes users may also have the option to auto-complete their mathematical equations when typing.
- Project Greymatter is the code name for a set of AI tools that are being integrated into core like Safari, Photos and Notes, Bloomberg reported.
Voice Memos transcriptions
- Real-time transcription for voice memos is also coming.
iMessages’ gets an AI makeover
- Generative AI emojis will be supported, letting users create their own emojis with technology.
- AI recaps of missed texts will also be available.
- Overall deeper Siri integration is expected.
- Tapbacks will get new icons.
- Message effects for individual words will be supported in addition to effects for the message itself.
- Messages will offer suggested replies generated by Apple’s on-device Ajax LLM to make texting back easier.
- RCS support is also supported to arrive this year to bring read recipes, typing indicators and high-quality video and images when texting with Android users via iMessage.
Calendar refresh
- Apple’s LLM will be able to communicate with the Calendar app to check for events when composing responses to messages.
Mail with support for AI
- Mail will also get suggested email replies generated by Ajax.
New Settings interface
- Settings will hopefully get less confusing with a revamped interface and updates that include better organization and improved search.
Control Center updates
- A new Music widget will be available — possibly to feature larger artwork?
- Improvements to HomeKit for smart home integrations.
Notifications
- AI recaps of missed notifications will be available.
- Apple is working on something called “Enhanced” notifications.
Spotlight
- Spotlight is expected to get faster, more reliable search.
Home Screen updates
- iOS 18 will bring the ability to place app icons wherever you want, instead of having to align them to the grid without spaces in between them.
- Users will also be able to change the color of app icons, perhaps as Apple’s answer to Google’s Material You.
Maps with route creation
- Maps will support custom route creation in iOS 18 which lets users design their own routes for a trip.
Music with AI-powered playlists
- Apple Music may take on Spotify with its own AI-powered auto-generated playlists.
More improvements
Other apps with updates planned include Freeform, Xcode and Apple’s productivity apps, like Keynote and Pages, which may get genAI features.
The keynote will be focused on Apple’s software offerings and the developers that power them, including the latest versions of iOS, iPadOS, macOS, tvOS, visionOS and watchOS.
Hello and welcome back to TechCrunch Space. Unfortunately, Boeing’s Starliner launch was delayed yet again, this time due to issues with one of the three redundant computers used by United…
The court ruling said that Fearless Fund’s Strivers Grant likely violates the Civil Rights Act of 1866, which bans the use of race in contracts.
Instagram Threads is rolling out the ability for users to signal which sort of posts they wanted to see more or less of by swiping.
The Japanese billionaire who commissioned SpaceX for a private mission around the moon on a Starship rocket has abruptly canceled the project, citing ongoing uncertainties around when the launch vehicle…
Malicious actors are abusing generative AI music tools to create homophobic, racist, and propagandic songs — and publishing guides instructing others how to do so. According to ActiveFence, a service…
As WWDC 2024 nears, all sorts of rumors and leaks have emerged about what iOS 18 and its AI-powered apps and features have in store.
Dallas is the second city that Cruise is easing its way back into after pulling its entire U.S. fleet late last year.
Featured Article
Sonos Ace review: A high-priced contender
The Ace are a contender in a crowded market, but they’re still in search of that magic bullet to truly let them stand out from the pack.
12 hours ago
The change would see Instagram becoming more like the free version of YouTube, which requires users to view ads before and in the middle of watching videos.
Commerce platform Shopify has acquired Checkout Blocks, allowing Shopify Plus merchants to make no-code customizations in their checkout to enhance customer experience and potentially boost sales. Checkout Blocks, which debuted…
After the Digital Markets Act (DMA) forced Apple to allow third-party app stores for iOS in Europe, several developers have launched alternative stores, like the AltStore and MacPaw’s Setapp (currently…
Time is relentless and, right now, it’s no friend to procrastination-prone early-stage startup founders. The application window for Startup Battlefield 200 (SB 200) at TechCrunch Disrupt 2024 slams shut in…
Cloudera, the once high-flying Hadoop startup, raised $1 billion and went public in 2018 before being acquired by private equity for $5.3 billion in 2021. Today, the company announced that…
The global spend management sector is experiencing a tailwind of sorts. North America is arguably the biggest market in this space, but spend management companies have seen demand rise across…
Neural Concept lets designers model how components will perform before they can be manufactured.
The StrictlyVC roadtrip continues! Coming off of sold-out events in London, Los Angeles, and San Francisco, we’re heading to Washington, D.C. for a cozy-vc-packed, evening at the Woolly Mammoth Theatre…
X will now allow users to post consensually produced NSFW content as long as it is prominently labeled as such.
Ashby consolidates existing talent acquisition tools and leans heavily on AI to automate the more repetitive steps in the recruitment pipeline.
Spotify has announced it’s hiking subscriptions for customers in the U.S., the second such price increase in the space of a year. The music-streaming giant reports that premium pricing will…
Monzo has announced its 2024 financial results, revealing its first full-year pre-tax profit. The company also confirmed that it’s in the early stages of expanding into the broader European market…
Featured Article
Inside Apple’s efforts to build a better recycling robot
Last week, TechCrunch paid a visit to Apple’s Austin, Texas, manufacturing facilities. Since 2013, the company has built its Mac Pro desktop about 20 minutes north of downtown. The 400,000-square-foot facility sits in a maze of industry parks, a quick trip south from the company’s in-progress corporate campus. In recent years, the capital city has…
21 hours ago
Early attempts at making dedicated hardware to house artificial intelligence smarts have been criticized as, well, a bit rubbish. But here’s an AI gadget-in-the-making that’s all about rubbish, literally: Finnish…
Temasek has previously invested in Lenskart, and this new funding follows a $500 million investment by the Abu Dhabi Investment Authority last year.
Less than one year after its iOS launch, French startup ten ten has gone viral with a walkie talkie app that allows teens to send voice messages to their close…
Presumptive Republican presidential nominee Donald Trump now has an account on the short-form video app that he once tried to ban. Trump’s TikTok account, which launched on Saturday night, features…
With fewer than 400,000 inhabitants, Iceland receives more than its fair share of tourists — and of venture capital.
