Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-007

easy inbox

The prompt

user

TASK: INBOX

From: Tom Becker <tom.becker@larkspuroutfitters.com>
To: Dana Whitfield <dana.whitfield@larkspuroutfitters.com>; Marcus Lee <marcus.lee@larkspuroutfitters.com>
Date: Tue, 20 Oct 2026 16:48 -0600
Subject: Vendor meeting moved to next Tuesday

FYI - the Glenwood Packaging vendor meeting has moved from this Thursday to next Tuesday (Oct 27), same time (10 AM), same room. Nothing you need to do, I've already updated the calendar invite. No need to reply.

Tom

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "fyi"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.64 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.60 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.70 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.41 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.29 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.21 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.31 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.15 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

← triage-006All Sort and triage itemstriage-008 →