Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Read images
vision-030
medium calendarreasoning
The prompt
1 image attached (not shown).
user
On what day of the week is the piano recital? Reply with only the weekday name.
What we expected
{
"answer": "Saturday",
"accept": [
"Sat"
],
"type": "choice",
"options": [
[
"Sunday",
"Sun"
],
[
"Monday",
"Mon"
],
[
"Tuesday",
"Tue",
"Tues"
],
[
"Wednesday",
"Wed"
],
[
"Thursday",
"Thu",
"Thurs"
],
[
"Friday",
"Fri"
],
[
"Saturday",
"Sat"
]
]
}What each model answered
LFM2.5-VL 3B
✓ pass · score 100 · 2.89 s
Saturday
Scoring detail
{
"type": "choice",
"normalized": "saturday"
}MiMo-V2.6 Distill 9B
✓ pass · score 100 · 3.52 s
Saturday
Scoring detail
{
"type": "choice",
"normalized": "saturday"
}MiniCPM-V 4.7 1B
✓ pass · score 100 · 1.69 s
Sat
Scoring detail
{
"type": "choice",
"normalized": "sat"
}