Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-021
medium boarding_passjson
The prompt
1 image attached (not shown).
user
What gate does this flight leave from, and what time does boarding start? Reply with only a JSON object like {"gate": "...", "boarding_time": "..."}.What we expected
{
"answer": {
"gate": "C14",
"boarding_time": "06:45"
},
"accept": [],
"type": "json",
"fields": {
"gate": "text",
"boarding_time": "time"
}
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 4.73 s
{"gate": "C14", "boarding_time": "6:45 AM"}Scoring detail
{
"fields": {
"gate": {
"ok": true,
"compact": "c14"
},
"boarding_time": {
"ok": true,
"parsed": "06:45",
"explicit_ampm_or_24h": true
}
}
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 2.62 s
{"gate": "C14", "boarding_time": "6:45 AM"}Scoring detail
{
"fields": {
"gate": {
"ok": true,
"compact": "c14"
},
"boarding_time": {
"ok": true,
"parsed": "06:45",
"explicit_ampm_or_24h": true
}
}
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.10 s
{
"gate": "C14",
"boarding_time": "6:45 AM"
}Scoring detail
{
"fields": {
"gate": {
"ok": true,
"compact": "c14"
},
"boarding_time": {
"ok": true,
"parsed": "06:45",
"explicit_ampm_or_24h": true
}
}
}