Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-001
easy inbox
The prompt
user
TASK: INBOX
From: Marcus Lee <marcus.lee@larkspuroutfitters.com>
To: Dana Whitfield <dana.whitfield@larkspuroutfitters.com>
Date: Mon, 19 Oct 2026 10:12 -0600
Subject: Q4 floor reset - which weekend works for you?
Hey Dana,
I'm putting together the crew schedule for the winter floor reset. We can do either Nov 7-8 or Nov 14-15. Which weekend works better for you? No rush, the schedule isn't due to the district office until the end of the month.
Thanks!
Marcus
Marcus Lee | Visual Merchandising Lead
Larkspur Outfitters - Store #12
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "reply_needed"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.67 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.62 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.75 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.44 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.32 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.24 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "reply_needed",
"correct": true
}
}MiniCPM5 2B
✗ fail · score 0 · 0.32 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "reply_needed",
"correct": false
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.16 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "reply_needed",
"correct": false
}
}