Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-037
hard cardphoto
The prompt
1 image attached (not shown).
user
What is the email address on this business card? Reply with only the email address.
What we expected
{
"answer": "m.okafor@lindenrowstudio.com",
"accept": [],
"type": "text",
"match": "email"
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 1.35 s
m.okafor@lindenrowstudio.com
Scoring detail
{
"type": "text",
"emails_found": [
"m.okafor@lindenrowstudio.com"
]
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 2.09 s
m.okafor@lindenrowstudio.com
Scoring detail
{
"type": "text",
"emails_found": [
"m.okafor@lindenrowstudio.com"
]
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 0.81 s
m.okafor@lindenrowstudio.com
Scoring detail
{
"type": "text",
"emails_found": [
"m.okafor@lindenrowstudio.com"
]
}