Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images

vision-033

easy handwritingphoto

The prompt

1 image attached (not shown).

user

What time does this note say to pick up Milo? Reply with only the time, for example 3:15 PM.
What we expected
{
  "answer": "17:45",
  "accept": [],
  "type": "time"
}

What each model answered

LFM2.5-VL 3B

✓ pass · score 100 · 2.15 s

5:45 PM
Scoring detail
{
  "type": "time",
  "parsed": "17:45",
  "explicit_ampm_or_24h": true
}

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 3.15 s

5:45 PM
Scoring detail
{
  "type": "time",
  "parsed": "17:45",
  "explicit_ampm_or_24h": true
}

MiniCPM-V 4.7 1B

✓ pass · score 100 · 1.24 s

5:45 pm!!
Scoring detail
{
  "type": "time",
  "parsed": "17:45",
  "explicit_ampm_or_24h": true
}

← vision-032All Read images itemsvision-034 →