Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-024
medium inbox
The prompt
user
TASK: INBOX
From: ParcelJet Delivery <support@parceljet-redeliver.com>
To: dana.whitfield@inboxly.com
Date: Tue, 20 Oct 2026 07:33 +0000
Subject: Delivery attempt failed - action needed
ParcelJet
We tried to deliver your package today but no one was available to sign.
To schedule a new delivery, please pay the $1.99 redelivery fee within 48 hours:
https://parceljet-redeliver.com/schedule?id=PJ55120
Unclaimed packages are returned to the sender.
(c) 2026 ParcelJet. All rights reserved.
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "phishing"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.65 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.59 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Granite 4.2 8B
✗ fail · score 0 · 0.72 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.41 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.29 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 0 · 0.23 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}MiniCPM5 2B
✓ pass · score 100 · 0.33 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.15 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}