Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-015

medium inbox

The prompt

user

TASK: INBOX

From: Priya Natarajan <priya.n@inboxly.com>
To: dana.whitfield@inboxly.com
Date: Mon, 19 Oct 2026 20:44 -0600
Subject: cabin weekend!!

hiii! ok so the cabin is officially booked for Nov 7-9 :)

are you still in? and are you bringing Leo or coming solo? I need a final headcount for the grocery list by next weekend, so no huge rush, just lmk.

also do you still have that big cast iron pan? would be clutch for pancakes

xo
P

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}

{
  "label": "reply_needed"
}

What each model answered

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "reply_needed",
    "correct": true
  }
}

{"label": "newsletter"}

{
  "label": {
    "got": "newsletter",
    "expected": "reply_needed",
    "correct": false
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "reply_needed",
    "correct": false
  }
}

← triage-014All Sort and triage itemstriage-016 →