Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-013
hard proofreadnewsletter
The prompt
user
Proofread the text below. Fix spelling, grammar, and punctuation mistakes only. Do not rephrase sentences that are already correct, and keep names, numbers, wording, and layout otherwise the same. Reply with only the corrected text, with no preamble and no list of changes. """ Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winters ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him alot. Please stop by the facilities office on the 14th to wish him well. """
What we expected
{
"type": "proofread",
"source": "Staff Spotlight: Earl Haskins\n\nThis month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winters ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, \"If it ain't broke, don't fix it.\" Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him alot. Please stop by the facilities office on the 14th to wish him well.",
"errors": [
{
"wrong": "last winters ice storm",
"fixed": [
"last winter's ice storm"
]
},
{
"wrong": "Between you and I",
"fixed": [
"Between you and me"
]
},
{
"wrong": "alot",
"fixed": [
"a lot"
]
}
],
"preserve": [
"Earl Haskins",
"27 years",
"December",
"14th"
],
"must_keep": [
"If it ain't broke, don't fix it"
],
"length_ratio": [
0.8,
1.25
],
"reference": "Staff Spotlight: Earl Haskins\n\nThis month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, \"If it ain't broke, don't fix it.\" Between you and me, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well."
}What each model answered
MiMo-V2.6 Distill 9B
✗ fail · score 82 · 4.37 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.974,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.99,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.6667,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}Ornith-1.5 9B
✗ fail · score 82 · 3.38 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.974,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.99,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.6667,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}Granite 4.2 8B
✗ fail · score 82 · 3.56 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker, and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.963,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.979,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.6667,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}Spark-X2.5 4B
✗ fail · score 82 · 2.61 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker, and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.963,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.979,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.6667,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✗ fail · score 42 · 1.67 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winters ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.984,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.979,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 0.6667,
"checks": {
"errors": 0.3333,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 74 · 1.23 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winter's ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl is retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 97,
"similarity_to_source": 0.958,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.974,
"unknown_words": [
"is"
],
"reworded": false,
"unrequested_edits": [
{
"op": "replace",
"reference": "earl's",
"answer": "earl is"
}
]
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.021,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.6667,
"fidelity": 0.5,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}MiniCPM5 2B
✗ fail · score 42 · 1.93 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winters ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him a lot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 96,
"similarity_to_source": 0.984,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.979,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1.011,
"length_bounds": [
0.8,
1.25
],
"gate": 0.6667,
"checks": {
"errors": 0.3333,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.70 s
Staff Spotlight: Earl Haskins This month we're celebrating Earl Haskins, who has kept our buildings running for 27 years. Earl knows every boiler, every breaker and every squeaky door on campus. When the heating failed during last winters ice storm, he stayed overnight to keep the pipes from freezing. As Earl likes to say, "If it ain't broke, don't fix it." Between you and I, we think he could fix just about anything. Earl's retiring in December, and we'll miss him alot. Please stop by the facilities office on the 14th to wish him well.
Scoring detail
{
"cleaned_words": 95,
"similarity_to_source": 1,
"errors": [
{
"wrong": "last winters ice storm",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "Between you and I",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "alot",
"wrong_gone": false,
"fixed_present": false,
"score": 0
}
],
"fidelity": {
"similarity_to_reference": 0.963,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"must_keep_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 0,
"checks": {
"errors": 0,
"fidelity": 1,
"preserve": 1,
"must_keep": 1,
"length": 1
}
}