Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-004
easy inbox
The prompt
user
TASK: INBOX
From: Northbank Security Team <alerts@northbank-cu-secure.com>
To: dana.whitfield@inboxly.com
Date: Wed, 21 Oct 2026 02:17 +0000
Subject: URGENT: Your Northbank account has been SUSPENDED
Dear Valued Member,
We detected unusual activity and your online banking access has been suspended. To restore access you must verify your identity within 12 hours or your account will be permanently closed.
Verify now: http://northbank-cu-secure.com/member/verify
You will need your member number, online banking password and the 3-digit code on the back of your card.
Thank you,
Northbank Credit Union Security Department
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "phishing"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.69 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.63 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.74 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.44 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.30 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.22 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}MiniCPM5 2B
✓ pass · score 100 · 0.31 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.18 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}