Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-009
hard inbox
The prompt
user
TASK: INBOX
From: PayLoop <billing@payloop-billing.com>
To: dana.whitfield@larkspuroutfitters.com
Date: Wed, 21 Oct 2026 11:03 -0700
Subject: Action required: your payout is on hold
[PayLoop]
Hello Larkspur Outfitters,
As part of our routine compliance review, your most recent payout of $8,412.30 has been placed on hold. To release the funds, please sign in and confirm your business banking details within 24 hours.
[ Sign in to PayLoop ] https://payloop.com.account-review.co/login
If we don't hear from you, the payout will be returned to the original payers and your account may be restricted.
Thanks for choosing PayLoop,
The PayLoop Risk Team
PayLoop, Inc. | 500 Mission Street, Suite 1200, San Francisco, CA 94105
You're receiving this email because you have a PayLoop merchant account. Privacy Policy | Help Center
(c) 2026 PayLoop, Inc. All rights reserved.
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "phishing"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.87 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.80 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.97 s
{
"label": "phishing"
}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.55 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.37 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 0 · 0.27 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}MiniCPM5 2B
✓ pass · score 100 · 0.37 s
{"label": "phishing"}Scoring detail
{
"label": {
"got": "phishing",
"expected": "phishing",
"correct": true
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.18 s
{"label": "urgent_action"}Scoring detail
{
"label": {
"got": "urgent_action",
"expected": "phishing",
"correct": false
}
}