AI that sees

Is there an AI that can see images and answer questions?

Short answer

Yes. Choose a picture, ask about it, and the AI answers from what is in the image: its text, objects, charts and layout. In Ace Mobile you tap Add, pick a photo you already have or take a new one, then ask out loud or type. It reads clear text well and guesses at what it cannot make out, and every picture you choose is sent to the AI that answers.

The Ace BL for iPhone and iPad app also lets you take a photo or choose an image, then ask about it.

Free Play: 2,000 credits, no card. Ace by Black Label.

SEE IT DIFFERENTLY in silver serif letters over liquid chrome with cyan light

Pictures it is useful for

Ask Ace on a phone: the same workspace with the suggestion cards and the composer.
Ask Ace on a phone: the same workspace with the suggestion cards and the composer. Live at tryacee.com/account?space=chat.

What to ask, and when it works

AskWorks well whenWatch out for
“What does this say?”The text is sharp and big enough to readTiny print and decorative fonts
“Explain this chart.”The axis labels and legend are in the pictureCropped legends and unlabeled axes
“What is wrong in this screenshot?”The whole message is visibleText cut off at the edge
“What is this?”It is a common, clearly shown objectRare items and lookalikes
“Summarize this slide.”The slide fills most of the photoGlare from the projector

The pattern is simple: the AI does well with what a careful person could read from the same picture, and it fills gaps with guesses when the picture runs out.

Asking about a photo in Ace Mobile

  1. Open Ace Mobile in your phone’s browser and sign in with Google or your email.
  2. Tap Add, then choose a photo you already have or take a new one.
  3. Ask your question out loud or type it.
  4. Follow up without starting over: “what about the second line?”, “say it more simply”.
Ask Ace in the Ace web workspace: chat, library, study, tasks, computer and schools in one sidebar.
Ask Ace in the Ace web workspace: chat, library, study, tasks, computer and schools in one sidebar. Live at tryacee.com/account?space=chat.

Screenshot or photo of a screen?

When the thing is on your phone, take a screenshot rather than photographing the phone with another device: a screenshot has every pixel sharp, no glare and no angle. A photo of a computer monitor usually reads worse than a screenshot of the same thing, because of reflections, moiré stripes and tilted text. If you have to photograph a screen, turn the brightness up, shoot straight on and fill the frame with the part that matters. Compare screen frames and phone photos for visual AI.

Pictures already on your computer

If the image is open on your computer, there is no need to photograph it. The desktop app looks at the screen when you hold its hotkey, Ctrl + Shift on Windows or Command + Shift on a Mac, and ask, so a picture in a browser tab or an email attachment can be asked about where it is.

How Ace works: get the answer, finish the draft, keep the notes, keep things moving.
How Ace works: get the answer, finish the draft, keep the notes, keep things moving. Live at tryacee.com/how-it-works.

What happens to a picture you choose

Ace’s privacy policy lists photos, screenshots and camera images you choose among the content it processes, and names OpenAI as the provider that processes the pictures you choose to produce Ace’s answers. Before you send one, crop out what the question does not need: faces, addresses, account numbers, the rest of a group chat. A picture sent is a picture shared, whichever assistant receives it.

When the answer is off

Ask it to quote the text it read; that shows quickly whether the problem is the picture or the reasoning. If it misread, send a closer photo or type the unclear part yourself. If it guessed at an object, ask what in the picture it based that on, and treat any identification that matters as unconfirmed until you have checked it.

Pictures and your balance

Pictures come out of the same balance as everything else in Ace. Free Play starts with 2,000 credits and no card, and Ace’s pricing page notes that voice and images use credits too, with the amount depending on the request, model and service.

More from Ace

The full overview of how Ace helps with your screen is on tryacee.com/ai-on-screen.

Also asked

Can it read text from an image?

Yes, when the text is sharp enough that you could read it yourself. Zoom into the photo or retake it if the words are small.

Can I send a screenshot from my phone?

Yes. Choose it in Ace Mobile the same way as any other picture.

Does Ace keep the pictures I send?

The privacy policy says content you submit is used to produce the answer and kept as needed to provide your account and the features you use. For access or deletion requests, write to privacy@tryacee.com.

Do I need a computer for this?

No. The privacy policy notes that phone chat, hosted voice and selected-image questions can work without a paired computer.

What kinds of pictures can I ask an AI about?

Screenshots, pictures people send you, product photos and slides are all useful. That covers an error message or a confusing bill saved on your phone, a flyer or a menu someone sent, the ingredients list or the instructions on the back of a product, and slides and whiteboards you photographed in a class or a meeting.

Can I keep asking about the same photo without starting over?

Yes. In Ace Mobile, tap Add, choose a photo you already have or take a new one, and ask. Then follow up without starting over, for example “what about the second line?” or “say it more simply”. You can ask each question out loud or type it, in the same conversation.

Is a screenshot better than a photo of my screen?

Yes. A screenshot has every pixel sharp, with no glare and no angle, while a photo of a computer monitor usually reads worse because of reflections, moiré stripes and tilted text. If you have to photograph a screen, turn the brightness up, shoot straight on and fill the frame with the part that matters.

Do I need to photograph an image that is already open on my computer?

No. The desktop app looks at the screen when you hold its hotkey, Ctrl + Shift on Windows or Command + Shift on a Mac, and ask. A picture in a browser tab or an email attachment can be asked about right where it is, so there is no second device or camera involved.

What should I crop out of a photo before sending it to an AI?

Crop out whatever the question does not need: faces, addresses, account numbers and the rest of a group chat. Ace’s privacy policy lists photos, screenshots and camera images you choose among the content it processes, and names OpenAI as the provider that processes them. A picture sent is a picture shared, whichever assistant receives it.

How do I tell whether the AI misread my picture?

Ask it to quote the text it read; that shows quickly whether the problem is the picture or the reasoning. If it misread, send a closer photo or type the unclear part yourself. If it guessed at an object, ask what in the picture it based that on, and treat that identification as unconfirmed until you check it.

Can an AI that sees images identify a product from its photo?

Often, if it is a common, clearly shown object; with a “What is this?” question, watch out for rare items and lookalikes. A brand, a model number or a label in the picture is a better clue than a shape. When the picture runs out, the AI fills gaps with guesses.

Will it summarize a slide I photographed during a meeting?

Yes, when the slide fills most of the photo. Ask “Summarize this slide.” and watch out for glare from the projector. If the slide holds a chart, keep the axis labels and legend in the picture, since “Explain this chart.” works well with them and struggles with cropped legends and unlabeled axes.

More questions

Deal yourself in.

More about Ace

Who makes this guide