benchr

Technique

Ask for the last page first

Documents One line First logged

  1. InA long document you just uploaded
  2. ThenAsk a question only the end can answer
  3. OutYou know whether the whole file arrived

What the move is

A thirty-second check that tells you whether the model actually has the whole document before you trust a summary of it.

Why it works

Partial ingestion does not announce itself. The answer about page 3 is identical in quality whether or not page 300 arrived.

Step by step

  1. Before asking anything substantive, ask for the last section heading and a figure from the final table.
  2. Ask for the page number alongside the answer.
  3. Open the document and check that one fact yourself.
  4. If it is wrong or vague, split the file before going any further.

Paste this

Before we start: what is the heading of the final section, and what is the last value in the last table? Give the page number for each. If you cannot see the end of the document, say so.

Make it yours

For a scanned document, ask what is in a specific figure or photograph rather than text — that tests the image path rather than the text path.

Variations

  • Ask for the first and last sentence of the document verbatim.
  • Ask how many pages it can see.

Works with

Where this leads

When it breaks

Capability

Goal

Workflow