Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-018

hard inbox

The prompt

user

TASK: INBOX

From: CloudVault <share@cloudvault.io>
To: dana.whitfield@larkspuroutfitters.com
Date: Wed, 21 Oct 2026 15:10 -0600
Subject: Marcus Lee shared "Q4 Bonus Structure - CONFIDENTIAL.xlsx" with you

Marcus Lee (marcus.lee@larkspuroutfitters.com) shared a file with you.

  Q4 Bonus Structure - CONFIDENTIAL.xlsx
  "Dana - please review before Friday's meeting"

  [ Open in CloudVault ]  https://cloudvault-docs.net/view/f/88213-q4bonus

You'll be asked to sign in with your CloudVault email and password to view this file.

CloudVault, Inc. | 410 Harbor Blvd, Oakland, CA 94607
You received this email because someone shared a file with you on CloudVault.

Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}
What we expected
{
  "label": "phishing"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.77 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.71 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.94 s

{
  "label": "phishing"
}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.50 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✗ fail · score 0 · 0.35 s

{"label": "fyi"}
Scoring detail
{
  "label": {
    "got": "fyi",
    "expected": "phishing",
    "correct": false
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.24 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.35 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.17 s

{"label": "phishing"}
Scoring detail
{
  "label": {
    "got": "phishing",
    "expected": "phishing",
    "correct": true
  }
}

← triage-017All Sort and triage itemstriage-019 →