Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-021
medium inbox
The prompt
user
TASK: INBOX
From: Harbor Health Clinic <noreply@harborhealthclinic.org>
To: dana.whitfield@inboxly.com
Date: Mon, 19 Oct 2026 16:30 -0600
Subject: New test results are available
Hello Dana,
Results from your recent lab visit on October 14 are now available in the Harbor Health patient portal (https://portal.harborhealthclinic.org).
No action is needed. If your provider wants to discuss your results or schedule a follow-up, the clinic will contact you.
Harbor Health Clinic
1450 Colfax Ave, Denver, CO 80218
Please do not reply to this message.
Reply with only a JSON object: {"label": "<urgent_action|reply_needed|fyi|newsletter|spam|phishing>"}What we expected
{
"label": "fyi"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 0.66 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.60 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.72 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.45 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.31 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.22 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}MiniCPM5 2B
✓ pass · score 100 · 0.33 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}K2-Horizon 0.9B
✓ pass · score 100 · 0.14 s
{"label": "fyi"}Scoring detail
{
"label": {
"got": "fyi",
"expected": "fyi",
"correct": true
}
}