Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-017

medium inbox

The prompt

user

TASK: INBOX

From: Kestrel Air <reservations@kestrelair.com>
To: dana.whitfield@inboxly.com
Date: Sat, 17 Oct 2026 18:22 -0500
Subject: Your trip confirmation - DEN to PDX - Confirmation K7Q2MX

Thank you for booking with Kestrel Air, Dana!

CONFIRMATION CODE: K7Q2MX

Flight KA 1186
Saturday, November 14, 2026
Depart: Denver (DEN) 9:40 AM
Arrive: Portland (PDX) 11:55 AM
Seat: 14C | Fare: Main Cabin

Total charged: $186.40 to Visa ending 2208

View or manage your trip: https://www.kestrelair.com/trips/K7Q2MX

Kestrel Air | 3000 Runway Dr, Dallas, TX 75261

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}

{
  "label": "fyi"
}

What each model answered

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "reply_needed"}

{
  "label": {
    "got": "reply_needed",
    "expected": "fyi",
    "correct": false
  }
}

{"label": "fyi"}

{
  "label": {
    "got": "fyi",
    "expected": "fyi",
    "correct": true
  }
}

{"label": "urgent_action"}

{
  "label": {
    "got": "urgent_action",
    "expected": "fyi",
    "correct": false
  }
}

← triage-016All Sort and triage itemstriage-018 →