Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-025
medium toneformal-to-casual
The prompt
user
Rewrite the message below in a friendly, casual tone, like a message to friends or coworkers. Keep every fact (names, dates, times, amounts, reference numbers) as given, and do not add new facts or numbers. Reply with only the rewritten message, with no preamble or explanation. """ Notice to Residents: Please be advised that water service to the building will be temporarily interrupted on Tuesday, October 14, between the hours of 9:00 a.m. and 1:00 p.m., in order to facilitate the replacement of the main valve. Residents are advised to store water in advance. We apologize for any inconvenience. - Ridgeview Property Management """
What we expected
{
"type": "tone",
"style": "formal-to-casual",
"source": "Notice to Residents: Please be advised that water service to the building will be temporarily interrupted on Tuesday, October 14, between the hours of 9:00 a.m. and 1:00 p.m., in order to facilitate the replacement of the main valve. Residents are advised to store water in advance. We apologize for any inconvenience.\n- Ridgeview Property Management",
"facts": [
{
"name": "water off",
"any": [
"water"
]
},
{
"name": "Tuesday",
"any": [
"tuesday"
]
},
{
"name": "October 14",
"any": [
"october 14",
"oct 14",
"oct. 14"
]
},
{
"name": "9 am",
"any": [
"9:00",
"9 am",
"9am",
"9 a.m"
],
"re": "\\b9\\s*(?:a\\.?m\\.?)?\\s*(?:-|to|until|till|through|and)\\s*1\\b"
},
{
"name": "1 pm",
"any": [
"1:00",
"1 pm",
"1pm",
"1 p.m"
],
"re": "\\b9\\s*(?:a\\.?m\\.?)?\\s*(?:-|to|until|till|through|and)\\s*1\\b"
},
{
"name": "valve",
"any": [
"valve"
]
}
],
"banned": [
"please be advised",
"facilitate",
"residents are advised",
"we apologize for any inconvenience",
"notice to residents"
],
"banned_re": [],
"no_caps": false,
"caps_ok": [],
"extra_numbers_ok": [],
"length_ratio": [
0.4,
2
],
"reference": "Heads up, everyone! The water's getting shut off on Tuesday, October 14 from 9:00 a.m. to 1:00 p.m. while they replace the building's main valve. You might want to fill up some bottles or a pot the night before. (From Ridgeview Property Management.)"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 93 (scripted checks 100, judges 8.7/10 from 3) · 2.42 s
Heads up, neighbors! 🚰 Water service to the building will be temporarily interrupted on Tuesday, October 14, between 9:00 a.m. and 1:00 p.m., while we replace the main valve. Please store some water in advance. Thanks for your patience and understanding! - Ridgeview Property Management
Judge medians: Tone match 8 · Faithfulness 9 · Naturalness 9
Scoring detail
{
"cleaned_words": 43,
"similarity_to_source": 0.614,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.782,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Ornith-1.5 9B
✓ pass · score 97 (scripted checks 100, judges 9.3/10 from 3) · 2.38 s
Hi everyone, Just a heads-up: water service to the building will be temporarily interrupted on Tuesday, October 14, from 9:00 a.m. to 1:00 p.m. This is to replace the main valve, so please try to store some water in advance. We're really sorry for any inconvenience this may cause. Thanks, Ridgeview Property Management
Judge medians: Tone match 8 · Faithfulness 10 · Naturalness 10
Scoring detail
{
"cleaned_words": 53,
"similarity_to_source": 0.532,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.964,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Granite 4.2 8B
✓ pass · score 95 (scripted checks 100, judges 9.0/10 from 3) · 2.27 s
Hey everyone, Just a quick heads‑up: water service to the building will be off on Tuesday, October 14, from 9:00 a.m. to 1:00 p.m. while we replace the main valve. Please feel free to stash some water beforehand. Sorry for the hassle! Thanks, Ridgeview Property Management
Judge medians: Tone match 10 · Faithfulness 8 · Naturalness 9
Scoring detail
{
"cleaned_words": 46,
"similarity_to_source": 0.451,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.836,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Spark-X2.5 4B
✓ pass · score 98 (scripted checks 100, judges 9.7/10 from 3) · 1.62 s
Hey everyone, just a quick heads-up: water service to the building will be temporarily paused on Tuesday, October 14, from 9:00 a.m. to 1:00 p.m. to make sure we get the main valve replaced. Please make sure to store some water in advance. We're really sorry for any inconvenience this might cause! - Ridgeview Property Management
Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 9
Scoring detail
{
"cleaned_words": 55,
"similarity_to_source": 0.518,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 1,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 0.99 s
Hey everyone, just a heads‑up that the water to the building will be off temporarily on Tuesday, October 14 from 9:00 a.m. to 1:00 p.m. while they replace the main valve. Please grab some water beforehand. Sorry for the hassle! - Ridgeview Property Management
Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 10
Scoring detail
{
"cleaned_words": 43,
"similarity_to_source": 0.46,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.782,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 95 (scripted checks 100, judges 9.0/10 from 3) · 0.74 s
Hey everyone, just a quick heads-up: our water service to the building will be temporarily interrupted on Tuesday, October 14, between 9:00 a.m. and 1:00 p.m. This is so we can replace the main valve. Please store water in advance. We're sorry for any inconvenience. - Ridgeview Property Management
Judge medians: Tone match 8 · Faithfulness 10 · Naturalness 9
Scoring detail
{
"cleaned_words": 48,
"similarity_to_source": 0.61,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.873,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}MiniCPM5 2B
✓ pass · score 88 (scripted checks 100, judges 7.7/10 from 3) · 1.23 s
Hey there! Just a heads-up that water service to the building will be on hold on Tuesday, October 14, from 9:00 a.m. to 1:00 p.m. so we can swap out the main valve. Please make sure to keep water in your fridge ahead of time. Apologies for any small hiccups. - Ridgeview Property Management
Judge medians: Tone match 9 · Faithfulness 6 · Naturalness 8
Scoring detail
{
"cleaned_words": 53,
"similarity_to_source": 0.491,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.964,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}K2-Horizon 0.9B
✓ pass · score 92 (scripted checks 100, judges 8.3/10 from 3) · 0.30 s
Hey team, just a heads up—water service to our building will be down on Tuesday, October 14, from 9am to 1pm for a valve replacement. Please keep water in a jug or something handy. Sorry about the hiccup!
Judge medians: Tone match 9 · Faithfulness 7 · Naturalness 9
Scoring detail
{
"cleaned_words": 38,
"similarity_to_source": 0.255,
"facts_missing": [],
"banned_hits": [],
"new_numbers": [],
"length_ratio": 0.691,
"length_bounds": [
0.4,
2
],
"gate": 1,
"checks": {
"facts": 1,
"banned": 1,
"numbers": 1,
"changed": 1,
"length": 1
}
}