What AI is documented to do

Each record is one concrete thing a provider documents a model or agent can do — with the steps, the limits, the surfaces it runs on, and the official page benchr read it from. None of it has been tested by benchr yet.

These records describe what providers officially document. benchr has not run these capabilities itself, so nothing here is a test result. Each record shows the vendor page it was read from and the date.

Ledger updated: September 3, 2026

One screenshot in, a working page out

DocsDocumented in partTestNot tested by benchr

Building softwareQuickChat appDocs checked September 1, 2026

Hand a model a picture of a screen and get markup and styles back that reproduce the layout, spacing and copy closely enough to edit.

Open the full record →

Drive a real browser, not a scraper

DocsOfficially documentedTestNot tested by benchr

Agents, tools and MCPMediumAPIDocs checked September 1, 2026

The model gets a live browser: it navigates, reads the accessibility tree, clicks by element reference, fills forms and manages tabs, in a loop, until the task is done.

Open the full record →

Operate a desktop application

DocsOfficially documentedTestNot tested by benchr

Agents, tools and MCPDeepAPIDocs checked September 1, 2026

Screenshot, move, click, type. The model works a native application the way a person does, for software that never got an API.

Open the full record →

Get JSON that always matches your schema

DocsOfficially documentedTestNot tested by benchr

Building softwareQuickAPIDocs checked September 1, 2026

Supply a schema and the model's response adheres to it - no missing required key, no invented enum value, no defensive parser.

Open the full record →

Let the model write and run real code mid-answer

DocsOfficially documentedTestNot tested by benchr

Data and analysisQuickAPIDocs checked September 1, 2026

Instead of describing an analysis, the model executes it in a sandbox, reads the actual output, and corrects itself before answering.

Open the full record →

Read a 600-page PDF including its charts

DocsOfficially documentedTestNot tested by benchr

Documents and filesQuickAPIDocs checked September 1, 2026

Not OCR. The model reads the text and looks at each page, so a figure that only exists as a chart is still answerable.

Open the full record →

Answer from the live web with citations attached

DocsOfficially documentedTestNot tested by benchr

Research and the live webQuickAPIDocs checked September 1, 2026

The model decides when to search, the API runs the searches, and the final answer carries source URLs, titles and the exact quoted span.

Open the full record →

Give a model your own tools and data through MCP

DocsOfficially documentedTestNot tested by benchr

Agents, tools and MCPMediumAPIDocs checked September 1, 2026

One open protocol between an AI application and your systems, so a connector you write once works in every client that speaks it.

Open the full record →

Stop paying twice for the same file

DocsOfficially documentedTestNot tested by benchr

Cost and throughputQuickAPIDocs checked September 1, 2026

Mark the stable part of a prompt as cacheable and every later request reads it at 0.1x the input price instead of paying full price again.

Open the full record →

Run the whole job overnight at half price

DocsOfficially documentedTestNot tested by benchr

Cost and throughputQuickAPIDocs checked September 1, 2026

Submit many requests as one asynchronous batch, poll for completion, and pay 50% less than the same work sent one request at a time.

Open the full record →

Work through an entire repository, not a pasted file

DocsOfficially documentedTestNot tested by benchr

Building softwareMediumAgent / CLIDocs checked September 1, 2026

An agent that reads the codebase itself, edits across many files, runs the commands, reads the failures, and opens the pull request.

Open the full record →

Teach the model a procedure once and reuse it

DocsOfficially documentedTestNot tested by benchr

Agents, tools and MCPMediumAgent / CLIDocs checked September 1, 2026

A folder with a SKILL.md, optional reference files and scripts. The model reads the name and description always, the instructions only when your request matches.

Open the full record →

Transcribe a recording and label who said what

DocsOfficially documentedTestNot tested by benchr

Image, audio and videoQuickAPIDocs checked September 1, 2026

Speech to text is the easy half. The useful half is a transcript where each line is attributed to a speaker.

Open the full record →

Talk to it out loud and hear it answer

DocsOfficially documentedTestNot tested by benchr

Image, audio and videoDeepAPIDocs checked September 1, 2026

Not transcribe-then-answer-then-synthesise. One session on gpt-realtime-2.1 where audio goes in and audio comes back, with the turn-taking handled for you.

Open the full record →

Generate an image with legible text inside it

DocsOfficially documentedTestNot tested by benchr

Image, audio and videoQuickAPIDocs checked September 1, 2026

The failure everyone remembers from early image models - garbled lettering - is documented as a supported capability now, for infographics, menus, diagrams and marketing assets.

Open the full record →

Generate video from a prompt or a still

DocsDocumented in partTestNot tested by benchr

Image, audio and videoQuickAPIDocs checked September 1, 2026

Text or an image goes in, a short video comes out - and on one of the two documented models, with native audio.

Open the full record →

Fit a whole codebase in one prompt, and find its limit

DocsDocumented in partTestNot tested by benchr

Data and analysisQuickAPIDocs checked September 1, 2026

A whole codebase, a full deposition, an hour of video. The window is real; the retrieval behaviour inside it is the part people get wrong.

Open the full record →

Run a capable model on your own machine

DocsDocumented in partTestNot tested by benchr

Local and privateMediumLocalDocs checked September 3, 2026

Open-weight models on your own hardware, where the constraint is memory arithmetic rather than a price per token.

Open the full record →

Hand off a task and walk away from the machine

DocsOfficially documentedTestNot tested by benchr

Agents, tools and MCPMediumAgent / CLIDocs checked September 1, 2026

Start the work in the terminal, move it to the cloud, check it from a phone, and have it run again next Tuesday without you.

Open the full record →

Fine-tune a hosted OpenAI model

DocsDeprecatedTestNot tested by benchr

Building softwareDeepAPIDocs checked September 1, 2026

Closed to new users. The documentation states the fine-tuning platform is being wound down and is no longer accessible to new users, with existing users able to create jobs temporarily.

Open the full record →