Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-005
easy inbox
The prompt
user
TASK: INBOX
From: ParcelJet <notify@parceljet.com>
To: dana.whitfield@inboxly.com
Date: Mon, 19 Oct 2026 14:05 -0400
Subject: Your package is on its way
Good news, Dana! Your package from Fernwood Home Goods has shipped.
Tracking number: PJ 7731 4420 9918
Estimated delivery: Thursday, October 22, by 8:00 PM
Track your package: https://www.parceljet.com/track?n=PJ773144209918
No signature is required.
ParcelJet | 1200 Logistics Pkwy, Memphis, TN 38118
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "fyi"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.69 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.65 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.71 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.45 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.30 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.22 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}MiniCPM5 2B
✓ pass · score 100 · 0.30 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}K2-Horizon 0.9B
✓ pass · score 100 · 0.16 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}