Unified Memory

Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage

triage-050

hard review

The prompt

user

TASK: REVIEW

Product: Larchwood Ceramic Table Lamp
Rating: 5/5 stars
Title: Updated after the replacement
Review: ORIGINAL REVIEW (1 star): The base arrived cracked in two places. Packaging was flimsy.

UPDATE: The seller contacted me the same day and shipped a replacement that arrived in two days, packed in double boxes. The new lamp is perfect: beautiful glaze, warm soft light, and it looks even better than the photos. Thank you!

Reply with only a JSON object: {"label": "<positive|negative|mixed>"}
What we expected
{
  "label": "positive"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 0.54 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

Ornith-1.5 9B

✓ pass · score 100 · 0.46 s

{"label":"positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

Granite 4.2 8B

✓ pass · score 100 · 0.55 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

Spark-X2.5 4B

✓ pass · score 100 · 0.34 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 0.24 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 0.18 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

MiniCPM5 2B

✓ pass · score 100 · 0.26 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

K2-Horizon 0.9B

✓ pass · score 100 · 0.11 s

{"label": "positive"}
Scoring detail
{
  "label": {
    "got": "positive",
    "expected": "positive",
    "correct": true
  }
}

← triage-049All Sort and triage itemstriage-051 →