Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-006

easy inbox

The prompt

user

TASK: INBOX

From: IT Help Desk <it-help@larkspuroutfitters.com>
To: Dana Whitfield <dana.whitfield@larkspuroutfitters.com>
Date: Wed, 21 Oct 2026 08:30 -0600
Subject: ACTION REQUIRED: bring your laptop to IT by 3 PM tomorrow (Thu)

Hi Dana,

Your laptop (asset LO-2291) is one of 6 machines that did not receive the mandatory disk encryption update. Please bring it to the IT room (2nd floor, next to the break room) by 3:00 PM tomorrow, Thursday Oct 22. The update takes about 40 minutes.

Laptops that are not updated will be locked out of the company network starting Friday morning.

Thanks,
Ines Baptiste
IT Help Desk, Larkspur Outfitters

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "urgent_action"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.75 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.72 s

{"label": "urgent_action"}"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.85 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.51 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.33 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.24 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.32 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.17 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

← triage-005All Sort and triage itemstriage-007 →