Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-035
easy shortenlisting
The prompt
user
Shorten the text below to at most 25 words. Keep the key facts (names, dates, times, amounts, numbers) accurate, and do not add anything new. Reply with only the shortened text, with no preamble and no word count. """ Selling my lightly used Trailhead 3-person tent. I've only taken it camping twice, and it's in great condition with no tears or stains. It comes with the rain fly, all twelve stakes, and the original carry bag. It sets up in about ten minutes with two people. Asking $120 or best offer. Pickup only, in the Eastwood neighborhood. Message me if you're interested! """
What we expected
{
"type": "shorten",
"source": "Selling my lightly used Trailhead 3-person tent. I've only taken it camping twice, and it's in great condition with no tears or stains. It comes with the rain fly, all twelve stakes, and the original carry bag. It sets up in about ten minutes with two people. Asking $120 or best offer. Pickup only, in the Eastwood neighborhood. Message me if you're interested!",
"max_words": 25,
"facts": [
{
"name": "Trailhead",
"any": [
"trailhead"
]
},
{
"name": "3-person",
"any": [
"3-person",
"3 person",
"three-person",
"three person"
]
},
{
"name": "tent",
"any": [
"tent"
]
},
{
"name": "rain fly",
"any": [
"rain fly",
"rainfly"
]
},
{
"name": "$120",
"any": [
"$120"
]
},
{
"name": "or best offer",
"any": [
"best offer",
"obo",
"o.b.o"
]
},
{
"name": "pickup only",
"any": [
"pickup",
"pick up",
"pick-up"
]
},
{
"name": "Eastwood",
"any": [
"eastwood"
]
}
],
"banned": [],
"banned_re": [],
"extra_numbers_ok": [
"12",
"10",
"2"
],
"reference": "Lightly used Trailhead 3-person tent, used twice, no tears. Includes rain fly, stakes, and bag. $120 or best offer. Pickup only in Eastwood."
}What each model answered
MiMo-V2.6 Distill 9B
✗ fail · score 65 (scripted checks 33, judges 9.7/10 from 3) · 4.04 s
Lightly used Trailhead 3-person tent, used twice, no tears or stains. Includes rain fly, all 12 stakes, and original carry bag. Sets up in ~10 min with two. $120 or best offer, pickup only in Eastwood. Message me.
Judge medians: Faithfulness 10 · Key information kept 10 · Readability 9
Scoring detail
{
"cleaned_words": 38,
"similarity_to_source": 0.535,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 0.5,
"checks": {
"facts": 1,
"numbers": 1,
"length": 0
}
}Ornith-1.5 9B
✗ fail · score 60 (scripted checks 33, judges 8.7/10 from 3) · 1.52 s
Selling my lightly used Trailhead 3-person tent, in great condition with rain fly, 12 stakes, and carry bag. Sets up in about 10 minutes. Asking $120 or best offer. Pickup only, Eastwood.
Judge medians: Faithfulness 9 · Key information kept 8 · Readability 9
Scoring detail
{
"cleaned_words": 32,
"similarity_to_source": 0.568,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 0.5,
"checks": {
"facts": 1,
"numbers": 1,
"length": 0
}
}Granite 4.2 8B
✗ fail · score 56 (scripted checks 33, judges 8.0/10 from 3) · 1.55 s
Selling lightly used Trailhead 3-person tent, used twice, great condition, includes rain fly, twelve stakes, carry bag, sets up in ten minutes, asking $120 or best offer, pickup only in Eastwood.
Judge medians: Faithfulness 7 · Key information kept 9 · Readability 8
Scoring detail
{
"cleaned_words": 31,
"similarity_to_source": 0.468,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 0.5,
"checks": {
"facts": 1,
"numbers": 1,
"length": 0
}
}Spark-X2.5 4B
✓ pass · score 93 (scripted checks 100, judges 8.7/10 from 3) · 0.86 s
Selling lightly used Trailhead 3-person tent, great condition, with rain fly, stakes, bag. $120 or best offer, pickup in Eastwood.
Judge medians: Faithfulness 10 · Key information kept 7 · Readability 9
Scoring detail
{
"cleaned_words": 20,
"similarity_to_source": 0.386,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 1,
"checks": {
"facts": 1,
"numbers": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✗ fail · score 81 (scripted checks 83, judges 8.0/10 from 3) · 0.67 s
Lightly used Trailhead 3‑person tent, set up twice, great condition, includes rain fly, stakes, carry bag. $120 or best offer, pickup Eastwood neighborhood. Message if interested.
Judge medians: Faithfulness 7 · Key information kept 8 · Readability 9
Scoring detail
{
"cleaned_words": 26,
"similarity_to_source": 0.427,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 1,
"checks": {
"facts": 1,
"numbers": 1,
"length": 0.5
}
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 78 (scripted checks 77, judges 8.0/10 from 3) · 0.51 s
Selling a lightly used 3-person Trailhead tent, used twice, with rain fly, 12 stakes, and carry bag. Sets up in 10 minutes. $120, pickup only in Eastwood.
Judge medians: Faithfulness 8 · Key information kept 7 · Readability 9
Scoring detail
{
"cleaned_words": 27,
"similarity_to_source": 0.378,
"facts_missing": [
"or best offer"
],
"new_numbers": [],
"max_words": 25,
"gate": 1,
"checks": {
"facts": 0.875,
"numbers": 1,
"length": 0.5
}
}MiniCPM5 2B
✗ fail · score 60 (scripted checks 30, judges 9.0/10 from 3) · 0.85 s
Selling a lightly used Trailhead 3-person tent. No tears or stains. Includes rain fly, all twelve stakes, and original carry bag. Sets up in ~10 minutes with two people. Asking $120. Pickup only, Eastwood neighborhood.
Judge medians: Faithfulness 10 · Key information kept 8 · Readability 9
Scoring detail
{
"cleaned_words": 35,
"similarity_to_source": 0.633,
"facts_missing": [
"or best offer"
],
"new_numbers": [],
"max_words": 25,
"gate": 0.5,
"checks": {
"facts": 0.875,
"numbers": 1,
"length": 0
}
}K2-Horizon 0.9B
✗ fail · score 61 (scripted checks 33, judges 9.0/10 from 3) · 0.33 s
Selling lightly used Trailhead 3-person tent, great condition, no tears or stains. Includes rain fly, 12 stakes, original carry bag. Sets up in 10 minutes with two people. $120 or best offer. Eastwood pickup.
Judge medians: Faithfulness 9 · Key information kept 9 · Readability 9
Scoring detail
{
"cleaned_words": 34,
"similarity_to_source": 0.577,
"facts_missing": [],
"new_numbers": [],
"max_words": 25,
"gate": 0.5,
"checks": {
"facts": 1,
"numbers": 1,
"length": 0
}
}