Read images

Read receipts, screenshots, signs, labels, charts, calendars and handwriting from a photo or screenshot, and answer with the exact value.

Results

Model	Accuracy	Pass	Easy	Medium	Hard	Median latency	Tok/s	Job time
LFM2.5-VL 3B	85.0	85.0%	100.0%	80.0%	76.9%	2.45 s	114.3	1m 22s
MiMo-V2.6 Distill 9B	77.5	77.5%	91.7%	73.3%	69.2%	1.99 s	43.1	1m 26s
MiniCPM-V 4.7 1B	72.5	72.5%	100.0%	66.7%	53.8%	1.19 s	199.5	45.0 s

How it is scored

Exact match after normalization, by answer type: numbers (only one distinct number in the reply, tolerance 0.005), times (one time, compared in 24h), yes/no (first word), text (casefold/punctuation-insensitive; codes and phone numbers compared as letters+digits or digits only), choices (exact label), JSON (fraction of fields correct). Pass = score 1.0.

Temperature 0 · max 1024 output tokens.

System prompt every model got

You read images for the user. Look carefully at the attached image and answer the question about it. Give exactly the answer format the user asks for, with no explanation.

Every item

Final score per item (0-100). Click any row to see the prompt, the expected answer and every model's reply. Columns sort.

Item	Level	Prompt	Passed by	LFM2.5-VL 3B	MiMo-V2.6 Distill 9B	MiniCPM-V 4.7 1B
vision-001	easy	What is the total amount on this receipt? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-002	medium	How much sales tax was charged on this receipt? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-003	hard	The customer wrote a tip and a final total by hand on this restaurant receipt. What final total did they write…	3/3	100	100	100
vision-004	easy	What is the error code shown in this message? Reply with only the answer, no other words.	3/3	100	100	100
vision-005	medium	In this settings screen, is Bluetooth turned on? Reply with only Yes or No.	3/3	100	100	100
vision-006	medium	I want to close this spreadsheet and throw away my edits. Which button should I press? Reply with only the but…	1/3	0 ✗	100	0 ✗
vision-007	easy	I don't want to install this update right now, but I want to be asked again later. Which button should I press…	3/3	100	100	100
vision-008	easy	What is the Novapay verification code shown on this phone screen? Reply with only the answer, no other words.	3/3	100	100	100
vision-009	medium	According to this thermostat app, what is the current indoor temperature in degrees? Reply with only the numbe…	3/3	100	100	100
vision-010	medium	Is this bakery open at 6:30 PM on a Friday? Reply with only Yes or No.	2/3	100	100	0 ✗
vision-011	medium	What is the street name on this sign? Reply with only the street name as written (include the direction and st…	3/3	100	100	100
vision-012	medium	It is Saturday at 7:00 PM. Can I leave my car in front of this sign until 10:00 AM on Sunday? Reply with only …	0/3	0 ✗	0 ✗	0 ✗
vision-013	hard	These signs are posted together on one pole. It is Saturday at 6:00 PM and I need to park for 30 minutes. Is t…	2/3	100	100	0 ✗
vision-014	medium	These signs are posted together on one pole. Can I park here at 8:00 AM on a Tuesday? Reply with only Yes or N…	2/3	100	0 ✗	100
vision-015	hard	It is Friday at 3:30 PM. I want to leave my car parked here for one hour. Is that allowed by these signs? Repl…	2/3	100	0 ✗	100
vision-016	easy	What is the volume of this bottle in milliliters? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-017	medium	According to this label, what is the maximum number of tablets an adult may take in 24 hours? Reply with only …	3/3	100	100	100
vision-018	easy	How many calories are in one serving? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-019	hard	If I eat the entire container, how many grams of total sugars do I eat? Reply with only the number (no units o…	0/3	0 ✗	0 ✗	0 ✗
vision-020	hard	How many milligrams of sodium are in one serving? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-021	medium	What gate does this flight leave from, and what time does boarding start? Reply with only a JSON object like {…	3/3	100	100	100
vision-022	hard	What seat is this passenger assigned? Reply with only the answer, no other words.	3/3	100	100	100
vision-023	easy	Which month had the highest sales in this chart? Reply with only the month as written on the chart.	3/3	100	100	100
vision-024	medium	Read the chart: how many minutes of exercise were logged on Thursday? Reply with only the number (no units or …	2/3	100	100	0 ✗
vision-025	hard	How many regions in this chart had more than 50 installs? Reply with only the number (no units or currency sym…	2/3	100	100	0 ✗
vision-026	easy	In which year did this chart reach its lowest point? Reply with only the year.	3/3	100	100	100
vision-027	hard	In which month did the Online shop first have more orders than the Downtown store? Reply with only the month a…	3/3	100	100	100
vision-028	easy	What time does the Dentist appointment start? Reply with only the time, for example 3:15 PM.	2/3	100	0 ✗	100
vision-029	medium	How many events are on the calendar for Wednesday? Reply with only the number (no units or currency symbols).	0/3	0 ✗	0 ✗	0 ✗
vision-030	medium	On what day of the week is the piano recital? Reply with only the weekday name.	3/3	100	100	100
vision-031	easy	What phone number is written on this note? Reply with only the phone number.	3/3	100	100	100
vision-032	hard	On this shopping list, how many items are NOT crossed out? Reply with only the number (no units or currency sy…	0/3	0 ✗	0 ✗	0 ✗
vision-033	easy	What time does this note say to pick up Milo? Reply with only the time, for example 3:15 PM.	3/3	100	100	100
vision-034	easy	How much does the soup of the day cost? Reply with only the number (no units or currency symbols).	3/3	100	100	100
vision-035	hard	What is the Wi-Fi password written on this whiteboard? Reply with only the password, exactly as written.	3/3	100	100	100
vision-036	medium	What is the tracking number on this shipping label? Reply with only the tracking number.	2/3	100	0 ✗	100
vision-037	hard	What is the email address on this business card? Reply with only the email address.	3/3	100	100	100
vision-038	hard	I get to the Maple St & 3rd stop at 8:10 AM. What time does the next bus leave from that stop? Reply with only…	2/3	100	100	0 ✗
vision-039	hard	Two shelf tags, A and B, are shown. Which oats are cheaper per ounce? Reply with only the letter A or B.	0/3	0 ✗	0 ✗	0 ✗
vision-040	medium	How much is due on this bill, and by what date? Reply with only a JSON object like {"amount_due": 0.00, "due_d…	3/3	100	100	100

✗ marks a fail (below the job's pass bar). A dash means no valid result.

← All jobs