Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-017
medium product_labelsmall_text
The prompt
1 image attached (not shown).
user
According to this label, what is the maximum number of tablets an adult may take in 24 hours? Reply with only the number (no units or currency symbols).
What we expected
{
"answer": 3,
"accept": [],
"type": "number"
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 2.09 s
3
Scoring detail
{
"type": "number",
"parsed": 3
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 1.90 s
3
Scoring detail
{
"type": "number",
"parsed": 3
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.24 s
3
Scoring detail
{
"type": "number",
"parsed": 3
}