Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-013
medium inbox
The prompt
user
TASK: INBOX
From: Derek Huang <derek@brightwatt-lighting.co>
To: dana.whitfield@larkspuroutfitters.com
Date: Tue, 20 Oct 2026 09:15 -0700
Subject: Re: Re: LED retrofit for Larkspur stores?
Hi Dana,
Just following up on my last two emails - I know you're busy! I'd still love to show you how BrightWatt's commercial LED panels could cut Larkspur's lighting bill by up to 60%.
Do you have 15 minutes this week for a quick call? Here's my calendar link: https://brightwatt-lighting.co/meet/derek
Best,
Derek Huang
Business Development, BrightWatt Lighting Solutions
> On Oct 13, Derek Huang wrote:
> Hi Dana, bumping this to the top of your inbox...
> > On Oct 6, Derek Huang wrote:
> > Hi Dana, I came across Larkspur Outfitters and wanted to introduce BrightWatt...
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "spam"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.79 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.72 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.84 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.52 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.35 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 0 · 0.25 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "spam",
"correct": false
}
}MiniCPM5 2B
✓ pass · score 100 · 0.34 s
{"label": "spam"}Scoring detail
{
"label": {
"got": "spam",
"expected": "spam",
"correct": true
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.20 s
{"label": "reply_needed"}Scoring detail
{
"label": {
"got": "reply_needed",
"expected": "spam",
"correct": false
}
}