Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Sort and triage
triage-049
hard review
The prompt
user
TASK: REVIEW
Product: SweepBot S7 Robot Vacuum
Rating: 1/5 stars
Title: UPDATE: do not buy
Review: ORIGINAL REVIEW (5 stars): Love this little guy! Picks up all the dog hair, maps the house perfectly, and the app is so easy.
UPDATE 6 weeks later: It now drives in circles in the hallway and can't find its dock anymore, so it dies in random corners. I've emailed support three times in two weeks with no answer. Dropping to one star. Do not buy.
Reply with only a JSON object: {"label": "<positive|negative|mixed>"}What we expected
{
"label": "negative"
}What each model answered
MiMo-V2.6 Distill 9B
✗ fail · score 0 · 0.57 s
{"label":"mixed"}Scoring detail
{
"label": {
"got": "mixed",
"expected": "negative",
"correct": false
}
}Ornith-1.5 9B
✓ pass · score 100 · 0.54 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}Granite 4.2 8B
✓ pass · score 100 · 0.62 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}Spark-X2.5 4B
✓ pass · score 100 · 0.37 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.25 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.18 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}MiniCPM5 2B
✓ pass · score 100 · 0.29 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}K2-Horizon 0.9B
✓ pass · score 100 · 0.12 s
{"label": "negative"}Scoring detail
{
"label": {
"got": "negative",
"expected": "negative",
"correct": true
}
}