Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-024

medium inbox

The prompt

user

TASK: INBOX

From: ParcelJet Delivery <support@parceljet-redeliver.com>
To: dana.whitfield@inboxly.com
Date: Tue, 20 Oct 2026 07:33 +0000
Subject: Delivery attempt failed - action needed

ParcelJet

We tried to deliver your package today but no one was available to sign.

To schedule a new delivery, please pay the $1.99 redelivery fee within 48 hours:
https://parceljet-redeliver.com/schedule?id=PJ55120

Unclaimed packages are returned to the sender.

(c) 2026 ParcelJet. All rights reserved.

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "phishing"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.65 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.59 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Granite 4.2 8B

✗ fail · score 0 · 0.72 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.41 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.29 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✗ fail · score 0 · 0.23 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.33 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.15 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

← triage-023All Sort and triage itemstriage-025 →