Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-018
hard inbox
The prompt
user
TASK: INBOX
From: CloudVault <share@cloudvault.io>
To: dana.whitfield@larkspuroutfitters.com
Date: Wed, 21 Oct 2026 15:10 -0600
Subject: Marcus Lee shared "Q4 Bonus Structure - CONFIDENTIAL.xlsx" with you
Marcus Lee (marcus.lee@larkspuroutfitters.com) shared a file with you.
Q4 Bonus Structure - CONFIDENTIAL.xlsx
"Dana - please review before Friday's meeting"
[ Open in CloudVault ] https://cloudvault-docs.net/view/f/88213-q4bonus
You'll be asked to sign in with your CloudVault email and password to view this file.
CloudVault, Inc. | 410 Harbor Blvd, Oakland, CA 94607
You received this email because someone shared a file with you on CloudVault.
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "phishing"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.77 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.71 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.94 s
{
"label": "phishing"
}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.50 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Mellum2.1 12B-A2.5B
✗ fail · score 0 · 0.35 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "phishing",
"correct": false
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.24 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}MiniCPM5 2B
✓ pass · score 100 · 0.35 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}K2-Horizon 0.9B
✓ pass · score 100 · 0.17 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}