Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-016

hard inbox

The prompt

user

TASK: INBOX

From: Tom Becker <tom.becker@larkspuroutfitters.com>
To: Dana Whitfield <dana.whitfield@larkspuroutfitters.com>
Date: Thu, 22 Oct 2026 08:05 -0600
Subject: URGENT - need your answer by noon

Dana,

Kelsey has a family emergency and can't work this Sunday. Can you cover the store opening at 8 AM on Sunday instead of your usual noon start? Just reply yes or no by noon today so I can finalize the schedule. If it's a no I'll ask Marcus.

Tom

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}

{
  "label": "reply_needed"
}

What each model answered

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "reply_needed",
    "correct": false
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "reply_needed",
    "correct": false
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "reply_needed",
    "correct": false
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "reply_needed",
    "correct": false
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "reply_needed",
    "correct": false
  }
}

← triage-015All Sort and triage itemstriage-017 →