Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-019

hard inbox

The prompt

user

TASK: INBOX

From: Northbank Credit Union <alerts@northbankcu.com>
To: dana.whitfield@inboxly.com
Date: Wed, 21 Oct 2026 21:58 -0600
Subject: We froze your debit card ending 4471

Dana,

We declined a $312.18 purchase at SUMMIT FUEL #88, Casper WY on your debit card ending 4471 and temporarily froze the card to protect you.

Your card will stay frozen until you tell us whether you made this purchase. To unfreeze it, open the Northbank mobile app and go to Cards > Review activity, or call the number on the back of your card.

We will never ask for your PIN or online banking password by email or text, and this email contains no links.

Northbank Credit Union Fraud Prevention
Federally insured by NCUA

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "urgent_action"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.76 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.70 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.85 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.50 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.35 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.24 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.34 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.16 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

← triage-018All Sort and triage itemstriage-020 →