Apple’s Worldwide Developers Conference next week promises to be a pivotal moment in the iPhone maker’s history. Though the Vision Pro debuted at last year’s event, don’t expect hardware to be the main attraction at WWDC 2024, which kicks off Monday at 10 a.m. PT.
WWDC is for developers, and much of the focus will be on iOS 18. The Cupertino tech giant will showcase how it’s chosen to integrate AI technology into its devices and software, including through a historic partnership with OpenAI. As the big event nears, all sorts of leaks have emerged about what iOS 18 and its rumored AI-powered apps and features have in store.
Among the changes, Apple is said to be powering some of its new AI features with its Ajax LLM, including suggested email replies. Other reports indicate that Apple plans to process data from AI in a way that even employees won’t be able to access, which would help Apple continue to deliver on its promise of data privacy for its users.
Below, we’ll take a look at how Apple is said to be adding AI to its apps and services in the next big update for the iPhone, alongside other improvements and changes coming to iOS 18.
Siri’s AI-enabled future
- Apple’s digital assistant is prepared to get an AI revamp. The digital assistant will leverage Apple’s own large language models and will allow Siri to control individual features inside applications. This will work without any necessary setup by developers or users, like App Intents or Siri Shortcuts currently require. Instead, users will be able to ask Siri to do things like delete an email or edit a photo.
- Some of Siri’s upgraded AI capabilities won’t be ready until next year. For example, the ability for Siri to handle tasks with multiple steps is likely delayed.
- A more advanced Siri will also come to Apple Watch for on-the-go use. You could use Siri on your Watch to play music on another device, one report said.
- Siri will receive more natural-sounding voices.
- Siri will be able to summarize notifications that include people, companies, calendar events, locations, dates and more.
- Could Siri’s new look be hinted at in the animations below?
Apple Photos’ new look
- A new interface is being teased.
- People will have the ability to retouch photos with AI, perhaps challenging Google Photos in this area.
- A “Clean Up” feature would, for instance, let you remove objects from your photos using generative AI technology, similar to Google’s Magic Eraser.
- One report noted that Apple made an internal-only application called Generative Playground that uses GenAI to create and edit images. It’s unclear how this functionality will be presented to end users, though iMessage integration was spotted in the form of an app extension.
Safari with more AI
- AI recaps of Safari web pages and news articles will be available through a new Intelligent Search feature. (Watch out, Arc?)
Notes injected with AI
- Users will be able to ask for AI recaps of Notes.
- GenAI will also help to transcribe audio in Notes.
- In-app audio recording will be supported alongside audio transcription and AI summarization.
- Math Notes will help users create graphs and solve equations through AI by recognizing the text of mathematical equations and then helping you to solve them.
- Notes users may also have the option to auto-complete their mathematical equations when typing.
- Project Greymatter is the code name for a set of AI tools that are being integrated into core like Safari, Photos and Notes, Bloomberg reported.
Voice Memos transcriptions
- Real-time transcription for voice memos is also coming.
iMessages’ gets an AI makeover
- Generative AI emojis will be supported, letting users create their own emojis with technology.
- AI recaps of missed texts will also be available.
- Overall deeper Siri integration is expected.
- Tapbacks will get new icons.
- Message effects for individual words will be supported in addition to effects for the message itself.
- Messages will offer suggested replies generated by Apple’s on-device Ajax LLM to make texting back easier.
- RCS support is also expected to arrive this year to bring read recipes, typing indicators and high-quality video and images when texting with Android users via iMessage.
Calendar refresh
- Apple’s LLM will be able to communicate with the Calendar app to check for events when composing responses to messages.
Mail with support for AI
- Mail will also get suggested email replies generated by Ajax.
- Project BlackPearl is the code name for the AI upgrade that’s enhancing Apple Mail.
- Search within Apple Mail will include information from Contacts, locations, and locally stored documents.
- Users may be able to ask Siri to make their emails “sound more professional” among other things.
New Settings interface
- Settings will hopefully get less confusing with a revamped interface and updates that include better organization and improved search.
Control Center updates
- A new Music widget will be available — possibly to feature larger artwork?
- Improvements to HomeKit for smart home integrations.
Notifications
- AI recaps of missed notifications will be available.
- Apple is working on something called “Enhanced” notifications.
Spotlight
- Spotlight is expected to get faster, more reliable search.
Home Screen updates
- iOS 18 will bring the ability to place app icons wherever you want, instead of having to align them to the grid without spaces in between them.
- Users will also be able to change the color of app icons, perhaps as Apple’s answer to Google’s Material You.
Maps with route creation
- Maps will support custom route creation in iOS 18, which lets users design their own routes for a trip.
Music with AI-powered playlists
- Apple Music may take on Spotify with its own AI-powered auto-generated playlists.
More improvements
Other apps with planned updates include Freeform, Xcode and Apple’s productivity apps, like Keynote and Pages, which may get GenAI features.
We’re launching an AI newsletter! Sign up here to start receiving it in your inboxes on June 5.
Boeing’s Starliner spacecraft has successfully delivered two astronauts to the International Space Station, a key milestone in the aerospace giant’s quest to certify the capsule for regular crewed missions. Starliner…
Rivian needs to sell its new revamped vehicles at a profit in order to sustain itself long enough to get to the cheaper mass market R2 SUV on the road.
In a research note, HSBC estimates that the Indian edtech giant Byju’s, once valued at $22 billion, is now worth nothing.
As WWDC 2024 nears, all sorts of rumors and leaks have emerged about what iOS 18 and its AI-powered apps and features have in store.
Apple’s annual list of what it considers the best and most innovative software available on its platform is turning its attention to the little guy.
Meta launched its Meta Verified program today along with other features, such as the ability to call large businesses and custom messages.
Last year, during the Q3 2023 earnings call, Mark Zuckerberg talked about leveraging AI to have business accounts respond to customers for purchase and support queries. Today, Meta announced AI-powered…
TikTok is testing streaks that are similar to Snapchat’s in order to boost engagement, including how long people stay on the app.
Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Your usual…
New York-based Revel has made a lot of pivots since initially launching in 2018 as a dockless e-moped sharing service. The BlackRock-backed startup briefly stepped into the e-bike subscription business.…
Google says apps offering AI features will have to prevent the generation of restricted content.
The British retailers association also takes aim at Amazon’s “Buy Box,” claiming that Amazon manipulated which retailers were selected for the coveted placement.
Twitch has come up with a solution for the ongoing copyright issues that DJs encounter on the platform. The company announced Thursday a new program that enables DJs to stream…
Google said today it is partnering with RapidSOS, a platform for emergency first responders, to enable users to contact 911 through RCS (Rich Messaging Service).
Long before product-led growth became a buzzword, Atlassian offered free tiers for virtually all of its productivity and developer tools. Today, that mostly means free access for up to 10…
Google has developed a new AI tool to help marine biologists better understand coral reef ecosystems and their health, which can aid in conversation efforts. The tool, SurfPerch, created with…
Only a few years ago, one of the hottest topics in enterprise software was ‘robotic process automation’ (RPA). It doesn’t feel like those services, which tried to automate a lot…
SpaceX achieved a key milestone in its Starship flight test campaign: returning the booster and the upper stage back to Earth.
There’s a lot of buzz about generative AI and what impact it might have on businesses. But look beyond the hype and high-profile deals like the one between OpenAI and…
Carlo Kobe and Scott Smith believed so strongly in the need for a debit card product designed specifically for Gen Zers that they dropped out of Harvard and Cornell at…
A new app called MyGlimpact is intended not only to help people understand their environmental footprint, but why they shouldn’t feel guilty about it.
Prolific Machines believes it has a way of transitioning away from molecules to something better: light.
It’s been 20 years since Shira Yevin, the lead singer of punk band Shiragirl drove a pink RV into the Vans Warped Tour grounds, the now-defunct punk rock festival notorious…
While the transport industry does use legacy software, many of these platforms are from an earlier era. Qargo hopes its newer technologies can help it leapfrog the competition.
When you look at how generative AI is being implemented across developer tools, the focus for the most part has been on generating code, as with GitHub Copilot. Greptile, an…
The models tended to answer questions inconsistently, which reflects biases embedded in the data used to train the models.
A growing number of businesses are embracing data models — abstract models that organize elements of data and standardize how they relate to one another. But as the data analytics…
