Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-055

hard review

The prompt

user

TASK: REVIEW

Product: Alder Ergonomic Office Chair
Rating: 1/5 stars
Title: One star for the shipping nightmare
Review: Giving this one star because of the delivery: the box showed up three weeks late and completely crushed, and the courier just left it in the rain. That said, the chair itself is honestly great. It's sturdy, really comfortable for long workdays, and it went together in 15 minutes.

Reply with only a JSON object: {"label": "<positive|negative|mixed>"}
What we expected
{
  "label": "mixed"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.54 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.49 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.55 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.34 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.23 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.17 s

{"label": "mixed"}
Scoring detail
{
  "label": {
    "got": "mixed",
    "expected": "mixed",
    "correct": true
  }
}

MiniCPM5 2B

✗ fail · score 0 · 0.26 s

{"label": "negative"}
Scoring detail
{
  "label": {
    "got": "negative",
    "expected": "mixed",
    "correct": false
  }
}

K2-Horizon 0.9B

✗ fail · score 0 · 0.11 s

{"label": "negative"}
Scoring detail
{
  "label": {
    "got": "negative",
    "expected": "mixed",
    "correct": false
  }
}

← triage-054All Sort and triage itemstriage-056 →