Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-013
hard parking_signreasoning
The prompt
1 image attached (not shown).
user
These signs are posted together on one pole. It is Saturday at 6:00 PM and I need to park for 30 minutes. Is that allowed here? Reply with only Yes or No.
What we expected
{
"answer": "yes",
"accept": [],
"type": "yes_no"
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 2.86 s
Yes
Scoring detail
{
"type": "yes_no",
"first_token": "yes"
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 1.96 s
Yes
Scoring detail
{
"type": "yes_no",
"first_token": "yes"
}MiniCPM-V 4.7 1B
✗ fail · score 0 · 1.33 s
No.
Scoring detail
{
"type": "yes_no",
"first_token": "no"
}