Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-004

easy inbox

The prompt

user

TASK: INBOX

From: Northbank Security Team <alerts@northbank-cu-secure.com>
To: dana.whitfield@inboxly.com
Date: Wed, 21 Oct 2026 02:17 +0000
Subject: URGENT: Your Northbank account has been SUSPENDED

Dear Valued Member,

We detected unusual activity and your online banking access has been suspended. To restore access you must verify your identity within 12 hours or your account will be permanently closed.

Verify now: http://northbank-cu-secure.com/member/verify

You will need your member number, online banking password and the 3-digit code on the back of your card.

Thank you,
Northbank Credit Union Security Department

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "phishing"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.69 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.63 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.74 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.44 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.30 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.22 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.31 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.18 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

← triage-003All Sort and triage itemstriage-005 →