Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-001

easy inbox

The prompt

user

TASK: INBOX

From: Marcus Lee <marcus.lee@larkspuroutfitters.com>
To: Dana Whitfield <dana.whitfield@larkspuroutfitters.com>
Date: Mon, 19 Oct 2026 10:12 -0600
Subject: Q4 floor reset - which weekend works for you?

Hey Dana,

I'm putting together the crew schedule for the winter floor reset. We can do either Nov 7-8 or Nov 14-15. Which weekend works better for you? No rush, the schedule isn't due to the district office until the end of the month.

Thanks!
Marcus

Marcus Lee | Visual Merchandising Lead
Larkspur Outfitters - Store #12

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "reply_needed"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.67 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.62 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.75 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.44 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.32 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.24 s

{"label": "reply_needed"}
Scoring detail
{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

MiniCPM5 2B

✗ fail · score 0 · 0.32 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "reply_needed",
    "correct": false
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.16 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "reply_needed",
    "correct": false
  }
}

All Sort and triage itemstriage-002 →