Apple has announced a series of new tools for artificial intelligence under its “Apple Intelligence” system, which extends over the iPhone, iPad, Mac, Apple Watch and Apple Vision Pro. The rollout includes a mix of communication, productivity and creative functions, many of which are powered by large language models on the devices that are designed to maintain the privacy of the users and to enable offline functionality.
One of the most important additives is live translation, aimed at bridging language gorges in real -time. Integrated in messages, Facetime and telephone, the tool offers automatic message translation and live captions on video and audio calls. All translations are processed on devices, so user interviews are held privately.
For users who want to experiment creatively, Image Playground and Genmoji have received remarkable upgrades. People can now combine emojis with descriptive instructions to make personalized Genmoji, or use chatgpt-driven image generation functions to produce visuals in specific styles such as oil painting or vector art. With the “Each Style” function, users can describe or upload a photo and receive a customized image. Apple has confirmed that data is only shared with chatgpt when they are explicitly authorized by the user.
The update also improves visual intelligence, so that users can communicate more intuitively with content on their screens. This includes identifying objects via the iPhone camera, collecting additional information from supported apps and streamlining tasks such as agenda items. For example, when an event is detected on the screen, Apple Intelligence can automatically prepare relevant details such as time and location and a calendar invitation.
Apple Intelligence is also opened for developers. They get access to the On-Device Foundation models, the company claims to be fully executed without an internet connection. This step is expected to facilitate a broader acceptance of intelligent functions in third -party apps.
By the end of the year, support for Apple Intelligence will spread to eight languages, including Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, traditional Chinese and Vietnamese.
These functions are now available for testing and will be rolled out wider to compatible devices later in the year.