Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-022

easy inbox

The prompt

user

TASK: INBOX

From: AI Profit Signals <vip@quantumgains-alerts.net>
To: dana.whitfield@inboxly.com
Date: Sun, 18 Oct 2026 04:12 +0000
Subject: Dana, turn $250 into $10,000 by Friday???

Our AI trading robot made members 4,000% this year.
NO experience needed. NO risk.

Only 12 seats remain in the VIP group. Join now before the price goes up:
https://quantumgains-alerts.net/vip

To stop receiving these offers click here.

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "spam"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.62 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.59 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.68 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Spark-X2.5 4B

✗ fail · score 0 · 0.41 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "spam",
    "correct": false
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.30 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✗ fail · score 0 · 0.21 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "spam",
    "correct": false
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.30 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.14 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "spam",
    "correct": false
  }
}

← triage-021All Sort and triage itemstriage-023 →