Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-010

hard inbox

The prompt

user

TASK: INBOX

From: PayLoop <notifications@payloop.com>
To: dana.whitfield@larkspuroutfitters.com
Date: Wed, 21 Oct 2026 09:20 -0700
Subject: Your payout is on hold until you re-verify your bank account

Hi Dana,

Your payout of $8,412.30 scheduled for today is on hold because the bank account verification for Larkspur Outfitters (account ending 0937) has expired.

To release it, sign in to your dashboard and re-verify the account under Settings > Bank accounts:
https://dashboard.payloop.com/settings/bank

Payouts stay on hold until verification is complete. If you have questions, reply to this email or visit https://support.payloop.com.

PayLoop Merchant Support
PayLoop, Inc. | 500 Mission Street, Suite 1200, San Francisco, CA 94105

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "urgent_action"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.76 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.72 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.86 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.50 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.36 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.25 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.35 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.17 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "urgent_action",
    "correct": true
  }
}

← triage-009All Sort and triage itemstriage-011 →