Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-030
hard toneformal-to-casual
The prompt
user
Rewrite the message below in a friendly, casual tone, like a message to friends or coworkers. Keep every fact (names, dates, times, amounts, reference numbers) as given, and do not add new facts or numbers. Reply with only the rewritten message, with no preamble or explanation. """ Pursuant to Section 4.2 of the Membership Agreement, members wishing to suspend their membership must submit a written request no fewer than 14 days prior to the requested suspension date. Suspensions may be granted for a minimum of 1 month and a maximum of 3 months per calendar year. A suspension fee of $10.00 per month shall apply. Requests may be submitted at the front desk or via email to memberservices@ironleafgym.example. """
What we expected
{
"type": "tone",
"style": "formal-to-casual",
"source": "Pursuant to Section 4.2 of the Membership Agreement, members wishing to suspend their membership must submit a written request no fewer than 14 days prior to the requested suspension date. Suspensions may be granted for a minimum of 1 month and a maximum of 3 months per calendar year. A suspension fee of $10.00 per month shall apply. Requests may be submitted at the front desk or via email to memberservices@ironleafgym.example.",
"facts": [
{
"name": "written request",
"any": [
"writing",
"written",
"write"
]
},
{
"name": "14 days ahead",
"any": [
"14 days"
]
},
{
"name": "min 1 month",
"any": [
"1 month",
"one month",
"a month",
"1-month",
"one-month"
],
"re": "\\b(?:1|one)\\s*(?:month)?\\s*(?:-|to|and|through|or)\\s*(?:3|three)\\b"
},
{
"name": "max 3 months",
"any": [
"3 months",
"three months",
"3-month",
"three-month"
]
},
{
"name": "per year",
"any": [
"year"
]
},
{
"name": "$10 per month",
"any": [
"$10"
]
},
{
"name": "front desk",
"any": [
"front desk"
]
},
{
"name": "email address",
"any": [
"memberservices@ironleafgym.example"
]
}
],
"banned": [
"pursuant",
"shall",
"prior to",
"no fewer than",
"wishing to",
"in accordance with",
"may be granted",
"may be submitted",
"hereby"
],
"banned_re": [],
"no_caps": false,
"caps_ok": [],
"extra_numbers_ok": [
"1"
],
"length_ratio": [
0.4,
2
],
"reference": "Need a break from the gym? No problem! You can pause your membership for anywhere from 1 month to 3 months each calendar year. Just let us know in writing at least 14 days before you want the pause to start. It costs $10 a month while your membership is on hold. You can drop off your request at the front desk or email us at memberservices@ironleafgym.example."
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 97 (scripted checks 100, judges 9.3/10 from 3) · 3.51 s
Hey everyone, just a quick heads-up: if you want to pause your membership, you'll need to send a written request at least 14 days before the date you'd like it to start. Suspensions can be approved for anywhere from 1 month up to 3 months per calendar year, and there's a $10.00 per month fee. You can drop your request off at the front desk or email it to memberservices@ironleafgym.example. Thanks!
Judge medians: Tone match 10 · Faithfulness 8 · Naturalness 10
Scoring detail
{
"cleaned_words": 71,
"similarity_to_source": 0.408,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Ornith-1.5 9B
✓ pass · score 97 (scripted checks 100, judges 9.3/10 from 3) · 2.71 s
Hi everyone, Just a quick heads-up about pausing your gym membership. If you'd like to suspend it, you'll need to send a written request at least 14 days before the date you want it to start. Suspensions can be for anywhere from 1 month up to 3 months per year, and there's a $10.00 fee for each month. You can drop off your request at the front desk or email it to memberservices@ironleafgym.example. Thanks!
Judge medians: Tone match 10 · Faithfulness 8 · Naturalness 10
Scoring detail
{
"cleaned_words": 74,
"similarity_to_source": 0.359,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1.042,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Granite 4.2 8B
✓ pass · score 97 (scripted checks 100, judges 9.3/10 from 3) · 2.94 s
Hey team, Just a quick heads‑up: if you want to pause your membership, you need to send a written request at least 14 days before the date you want to start the pause. You can pause for anywhere from 1 month up to 3 months in a calendar year. There’s a $10.00 monthly suspension fee. You can drop your request off at the front desk or email it to memberservices@ironleafgym.example. Thanks!
Judge medians: Tone match 10 · Faithfulness 8 · Naturalness 10
Scoring detail
{
"cleaned_words": 71,
"similarity_to_source": 0.366,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Spark-X2.5 4B
✓ pass · score 97 (scripted checks 100, judges 9.3/10 from 2) · 1.94 s
Hey everyone! If you want to pause your membership, you just need to send in a written request at least 14 days before your suspension date, per Section 4.2 of the Membership Agreement. Suspensions can be set for a minimum of 1 month and a maximum of 3 months each calendar year, and there'll be a $10.00 fee per month. You can submit your request at the front desk or by emailing memberservices@ironleafgym.example.
Judge medians: Tone match 9 · Faithfulness 9.5 · Naturalness 9.5
Scoring detail
{
"cleaned_words": 73,
"similarity_to_source": 0.375,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1.028,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✗ fail · score 77 (scripted checks 80, judges 7.3/10 from 3) · 1.24 s
Pursuant to Section 4.2 of the Membership Agreement, members wanting to pause their membership need to send a written request at least 14 days before the desired suspension date. You can pause your membership for at least one month and up to three months each calendar year, and there's a $10.00 fee per month while it's paused. Send your request to the front desk or email memberservices@ironleafgym.example.
Judge medians: Tone match 5 · Faithfulness 10 · Naturalness 7
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.478,
"facts_missing": [],
"banned_hits": [
"pursuant"
],
"new_numbers": [],
"length_ratio": 0.944,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 0,
"numbers": 1,
"changed": 1,
"length": 1
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 93 (scripted checks 100, judges 8.7/10 from 3) · 1.16 s
Hey everyone! Just wanted to share a quick update on our membership suspension policy. According to Section 4.2 of the Membership Agreement, if you want to suspend your membership, you'll need to submit a written request at least 14 days before the date you want the suspension to happen. The suspension can be for a minimum of 1 month and a maximum of 3 months per calendar year. There's also a $10.00 per month suspension fee. You can submit your request at the front desk or by email to memberservices@ironleafgym.example.
Judge medians: Tone match 8 · Faithfulness 9 · Naturalness 9
Scoring detail
{
"cleaned_words": 90,
"similarity_to_source": 0.571,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1.268,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}MiniCPM5 2B
✗ fail · score 87 (scripted checks 94, judges 8.0/10 from 3) · 1.49 s
So, if you want to take a break from your membership, just remember that under Section 4.2 of the Membership Agreement, you need to give at least 14 days' notice before you want to be suspended. Suspensions can last anywhere from 1 month to 3 months per year, and there's a $10.00 fee per month. You can reach out to us at the front desk or by emailing memberservices@ironleafgym.example.
Judge medians: Tone match 9 · Faithfulness 7 · Naturalness 8
Scoring detail
{
"cleaned_words": 69,
"similarity_to_source": 0.357,
"facts_missing": [
"written request"
],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.972,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 0.875,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}K2-Horizon 0.9B
✗ fail · score 82 (scripted checks 94, judges 7.0/10 from 3) · 0.43 s
Hey, so if you're thinking about stepping down from your membership, here’s the lowdown: you need to email memberservices@ironleafgym.example or drop by the front desk at least 14 days before the suspension date. They can grant it for anywhere from 1 to 3 months a year, and it’s $10 per month.
Judge medians: Tone match 9 · Faithfulness 5 · Naturalness 7
Scoring detail
{
"cleaned_words": 51,
"similarity_to_source": 0.082,
"facts_missing": [
"written request"
],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.718,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 0.875,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}