Apple’s new Visible Intelligence function offers a fast option to discover info simply by pointing an iPhone 16’s digicam at an object in the true world. Then you’ll be able to ask ChatGPT to clarify what you’re , do a reverse picture search to seek out merchandise and look issues up visually, get info on a enterprise as you stroll down the road, rapidly add occasions to your calendar and determine crops and animals.
With the discharge of iOS 18.4, Apple added the aptitude to make use of Visible Intelligence on iPhone 15 Professional fashions. Right here’s the way it works.
How you can use Visible Intelligence
Apple’s Visible Intelligence function integrates real-world consciousness into iOS, utilizing AI to make your iPhone smarter about what it sees. Able to recognizing objects, textual content and scenes via the digicam, it unlocks new methods to work together with info immediately and intuitively.
Whereas Visible Intelligence depends closely on third events like ChatGPT and Google, its integration into the iPhone makes it a strong device for on a regular basis use. Apple’s new AI device places these extremely helpful info sources immediately at your fingertips.
Nevertheless, you will want the correct combo of {hardware} and software program. You want a tool that helps Apple Intelligence. Which means an iPhone 16 or iPhone 16 Professional mannequin operating iOS 18.2 or later. It additionally works with iPhone 15 Professional and iPhone 16e operating iOS 18.4 or later. Nevertheless, since neither of them comes with a Digital camera Management, you’ll must activate Visible Intelligence through the machine’s Motion button.
Desk of contents: How you can use Visible Intelligence on the iPhone 16
- Replace iOS and allow Apple Intelligence
- Click on and maintain the Digital camera Management
- Add it to the Motion button or Management Middle
- Look issues up by snapping an image
- Seize calendar occasions and search for companies
- Establish crops
- How does Visible Intelligence work?
- Extra Apple Intelligence options
Replace iOS and allow Apple Intelligence
The primary Apple Intelligence options turned accessible in iOS 18.1. Visible Intelligence debuted within the second spherical of Apple’s AI options, in iOS 18.2, with further capabilities in iOS 18.3. You may set up the updates by going to Settings > Normal > Software program Replace.
After you replace to 18.3, you’ll be prompted throughout setup to allow Apple Intelligence.
You’ll want iOS 18.4 to run Visible Intelligence on an iPhone 15 Professional or iPhone 16e.
Click on and maintain the Digital camera Management
You launch Visible Intelligence by clicking and holding the Digital camera Management, a gesture that mimics clicking and holding the aspect button to activate Siri. After clicking and holding the Digital camera Management, you’ll see a quick animation and an interface that appears just like the iPhone digicam, however with fewer controls.
Add it to the Motion button or Management Middle
On an iPhone 15 Professional or iPhone 16e, with out the Digital camera Management, you’ll be able to launch Visible Intelligence via the Motion button or Management Middle.
Go to Settings > Motion Button and choose the Visible Intelligence possibility. You may maintain the button to launch the function.
Alternatively, open Management Middle, faucet the + within the higher left and faucet Add a Management. Scroll all the way down to the “Apple Intelligence & Siri” part and add Visible Intelligence. You may place the button wherever you need.
Look issues up by snapping an image
Screenshot: D. Griffin Jones/Cult of Mac
Click on the Digital camera Management once more, or faucet one of many on-screen buttons, to search for no matter’s in view. The next two choices are all the time accessible:
- Ask will ship the image to ChatGPT. OpenAI’s chatbot would possibly be capable of clarify what you’re , and you’ll ask it follow-up questions for extra info. Making an attempt this out with a bunch of bizarre objects round my workplace, I got here away fairly impressed by what ChatGPT bought proper, however after all, I caught a number of errors. You may’t solely belief ChatGPT as your sole supply of data; you need to all the time fact-check for one thing necessary.
- Search makes use of a Google reverse-image search to determine the item. This proves helpful if you wish to discover a product or object on-line. Faucet on a consequence to open the hyperlink in Safari (or your most well-liked net browser).
Seize calendar occasions and search for companies
Screenshot: D. Griffin Jones/Cult of Mac
Visible Intelligence’s different good options are extra context-dependent:
- Occasions: You may level your iPhone 16 digicam at one thing with occasion info on it, like a poster or doc, and rapidly add the occasion to your calendar. If it’s a music competition or live performance, the device would possibly match it to an occasion and fill in particulars. It may turn into super-handy.
- Companies: Take an image of a restaurant, and Visible Intelligence will reference your location with Apple Maps info to search for the restaurant or enterprise you’re . You may see a cellphone quantity, web site, menu and extra. This looks as if it may show extremely helpful. For those who’re strolling down the road deciding the place to eat, you would possibly be capable of rapidly get info with out manually trying to find each title you see.
Establish crops
Screenshot: D. Griffin Jones/Cult of Mac
New in iOS 18.3, you’ll be able to determine crops. Snap an image of a plant, and also you’ll get both one, two or three completely different recommendations primarily based on its look.
In my testing, this sadly isn’t too correct, usually suggesting the fallacious plant. When it lists three completely different crops, it usually has the proper one someplace within the record — however until it’s labeled, you’ll be able to’t be certain which. To not point out, if it’s labeled, you seemingly received’t want to make use of the function within the first place.
Tapping on a plant brings up info from Wikipedia. Faucet once more to open the total article with particulars.
How does Visible Intelligence work?
Technically talking, none of those Visible Intelligence options are super-smart. ChatGPT and Google Reverse Picture Search are each third-party providers. Pulling info out of the iPhone digicam like occasions and cellphone numbers is predicated on Stay Textual content, a function the iPhone has had for years. And Visible Intelligence doesn’t use AI to do a lot when figuring out companies; it’s principally utilizing the iPhone’s GPS and compass with Apple Maps — any iPhone can do this.
Even the brand new plant identification function isn’t solely new. Open Pictures, seek for “plant,” carry up an image and swipe up — you’ll see a bit of data tag the place you’ll be able to search for the photographed plant. This function works on all older gadgets operating iOS 17.
Nevertheless, in apply, they’re nonetheless helpful, sensible options. It’s useful having the ability to entry Stay Textual content and visible look-up with a particular interface, with out the necessity to save a photograph to your library. I believe if Apple Intelligence wasn’t a giant advertising and branding push, Apple could be extra upfront about this being a handy repackaging of various third-party providers, slightly than framing it as a brand new AI expertise.
Extra Apple Intelligence options
We initially printed this text on Visible Intelligence on December 10, 2024. We up to date it with new info on January 27, 2025 and April 22, 2025.
