Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-036
medium labelphoto
The prompt
1 image attached (not shown).
user
What is the tracking number on this shipping label? Reply with only the tracking number.
What we expected
{
"answer": "PRC 7731 4096 2258",
"accept": [
"7731 4096 2258"
],
"type": "text",
"match": "alnum"
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 3.01 s
PRC 7731 4096 2258
Scoring detail
{
"type": "text",
"compact": "prc773140962258"
}MiMo-V2.6 Distill 9B
✗ fail · score 0 · 2.70 s
PRC 7734 4096 2258
Scoring detail
{
"type": "text",
"compact": "prc773440962258"
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.31 s
PRC 7731 4096 2258
Scoring detail
{
"type": "text",
"compact": "prc773140962258"
}