Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-034
easy signhandwriting
The prompt
1 image attached (not shown).
user
How much does the soup of the day cost? Reply with only the number (no units or currency symbols).
What we expected
{
"answer": 6.5,
"accept": [],
"type": "number"
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 2.92 s
6.50
Scoring detail
{
"type": "number",
"parsed": 6.5
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 3.05 s
6.50
Scoring detail
{
"type": "number",
"parsed": 6.5
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.21 s
6.50
Scoring detail
{
"type": "number",
"parsed": 6.5
}