Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-013

medium inbox

The prompt

user

TASK: INBOX

From: Derek Huang <derek@brightwatt-lighting.co>
To: dana.whitfield@larkspuroutfitters.com
Date: Tue, 20 Oct 2026 09:15 -0700
Subject: Re: Re: LED retrofit for Larkspur stores?

Hi Dana,

Just following up on my last two emails - I know you're busy! I'd still love to show you how BrightWatt's commercial LED panels could cut Larkspur's lighting bill by up to 60%.

Do you have 15 minutes this week for a quick call? Here's my calendar link: https://brightwatt-lighting.co/meet/derek

Best,
Derek Huang
Business Development, BrightWatt Lighting Solutions

> On Oct 13, Derek Huang wrote:
> Hi Dana, bumping this to the top of your inbox...
> > On Oct 6, Derek Huang wrote:
> > Hi Dana, I came across Larkspur Outfitters and wanted to introduce BrightWatt...

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "spam"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.79 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.72 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.84 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.52 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.35 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✗ fail · score 0 · 0.25 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "spam",
    "correct": false
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.34 s

{"label": "spam"}
Scoring detail
{
  "label": {
    "got": "spam",
    "expected": "spam",
    "correct": true
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.20 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "spam",
    "correct": false
  }
}

← triage-012All Sort and triage itemstriage-014 →