Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-040
medium billjson
The prompt
1 image attached (not shown).
user
How much is due on this bill, and by what date? Reply with only a JSON object like {"amount_due": 0.00, "due_date": "YYYY-MM-DD"}.What we expected
{
"answer": {
"amount_due": 142.38,
"due_date": "2026-11-14"
},
"accept": [],
"type": "json",
"fields": {
"amount_due": "number",
"due_date": "date"
}
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 3.08 s
{"amount_due": 142.38, "due_date": "2026-11-14"}Scoring detail
{
"fields": {
"amount_due": {
"ok": true,
"parsed": 142.38
},
"due_date": {
"ok": true,
"parsed": "2026-11-14"
}
}
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 3.23 s
{"amount_due": 142.38, "due_date": "2026-11-14"}Scoring detail
{
"fields": {
"amount_due": {
"ok": true,
"parsed": 142.38
},
"due_date": {
"ok": true,
"parsed": "2026-11-14"
}
}
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.42 s
{
"amount_due": "$142.38",
"due_date": "2026-11-14"
}Scoring detail
{
"fields": {
"amount_due": {
"ok": true,
"parsed": 142.38
},
"due_date": {
"ok": true,
"parsed": "2026-11-14"
}
}
}