Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-009

hard inbox

The prompt

user

TASK: INBOX

From: PayLoop <billing@payloop-billing.com>
To: dana.whitfield@larkspuroutfitters.com
Date: Wed, 21 Oct 2026 11:03 -0700
Subject: Action required: your payout is on hold

[PayLoop]

Hello Larkspur Outfitters,

As part of our routine compliance review, your most recent payout of $8,412.30 has been placed on hold. To release the funds, please sign in and confirm your business banking details within 24 hours.

  [ Sign in to PayLoop ]  https://payloop.com.account-review.co/login

If we don't hear from you, the payout will be returned to the original payers and your account may be restricted.

Thanks for choosing PayLoop,
The PayLoop Risk Team

PayLoop, Inc. | 500 Mission Street, Suite 1200, San Francisco, CA 94105
You're receiving this email because you have a PayLoop merchant account. Privacy Policy | Help Center
(c) 2026 PayLoop, Inc. All rights reserved.

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "phishing"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.87 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.80 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.97 s

{
  "label": "phishing"
}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.55 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.37 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✗ fail · score 0 · 0.27 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.37 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.18 s

{"label": "urgent_action"}
Scoring detail
{
  "label": {
    "got": "urgent_action",
    "expected": "phishing",
    "correct": false
  }
}

← triage-008All Sort and triage itemstriage-010 →