Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images

vision-038

hard schedulereasoning

The prompt

1 image attached (not shown).

user

I get to the Maple St & 3rd stop at 8:10 AM. What time does the next bus leave from that stop? Reply with only the time, for example 3:15 PM.
What we expected
{
  "answer": "08:17",
  "accept": [],
  "type": "time"
}

What each model answered

LFM2.5-VL 3B

✓ pass · score 100 · 1.30 s

8:17
Scoring detail
{
  "type": "time",
  "parsed": "08:17",
  "explicit_ampm_or_24h": false
}

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 2.62 s

8:17 AM
Scoring detail
{
  "type": "time",
  "parsed": "08:17",
  "explicit_ampm_or_24h": true
}

MiniCPM-V 4.7 1B

✗ fail · score 0 · 0.97 s

8:37 AM
Scoring detail
{
  "type": "time",
  "parsed": "08:37",
  "explicit_ampm_or_24h": true
}

← vision-037All Read images itemsvision-039 →