Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-005
easy proofreademail
The prompt
user
Proofread the text below. Fix spelling, grammar, and punctuation mistakes only. Do not rephrase sentences that are already correct, and keep names, numbers, wording, and layout otherwise the same. Reply with only the corrected text, with no preamble and no list of changes. """ Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provded, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on are website by 6:00 am. See you their! Dana Whitfield Clearwater Friends """
What we expected
{
"type": "proofread",
"source": "Dear volunteers,\n\nThank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provded, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on are website by 6:00 am.\n\nSee you their!\nDana Whitfield\nClearwater Friends",
"errors": [
{
"wrong": "provded",
"fixed": [
"provided"
]
},
{
"wrong": "on are website",
"fixed": [
"on our website"
]
},
{
"wrong": "See you their",
"fixed": [
"See you there"
]
}
],
"preserve": [
"May 18",
"Harlan Park",
"8:00",
"6:00",
"Dana Whitfield",
"Clearwater Friends"
],
"must_keep": [],
"length_ratio": [
0.8,
1.25
],
"reference": "Dear volunteers,\n\nThank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am.\n\nSee you there!\nDana Whitfield\nClearwater Friends"
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 3.13 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Ornith-1.5 9B
✓ pass · score 100 · 2.63 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Granite 4.2 8B
✓ pass · score 100 · 2.79 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Spark-X2.5 4B
✓ pass · score 100 · 1.87 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 1.27 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.94 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on our website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}MiniCPM5 2B
✗ fail · score 85 · 1.31 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on their website by 6:00 am. See you there! Dana Whitfield Clearwater Friends
Scoring detail
{
"cleaned_words": 67,
"similarity_to_source": 0.955,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": false,
"score": 0.25
},
{
"wrong": "See you their",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.985,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 0.75,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}K2-Horizon 0.9B
✗ fail · score 51 · 0.47 s
Dear volunteers, Thank you for signing up for the river cleanup on May 18. Please meet at the north parking lot of Harlan Park at 8:00 am. Gloves and bags will be provided, but bring a reusable water bottle and wear shoes that can get muddy. If it rains, we will post an update on the website by 6:00 am. See you their!
Scoring detail
{
"cleaned_words": 63,
"similarity_to_source": 0.938,
"errors": [
{
"wrong": "provded",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "on are website",
"wrong_gone": true,
"fixed_present": false,
"score": 0.25
},
{
"wrong": "See you their",
"wrong_gone": false,
"fixed_present": false,
"score": 0
}
],
"fidelity": {
"similarity_to_reference": 0.938,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [
"Dana Whitfield",
"Clearwater Friends"
],
"length_ratio": 0.94,
"length_bounds": [
0.8,
1.25
],
"gate": 0.8333,
"checks": {
"errors": 0.4167,
"fidelity": 1,
"preserve": 0.6667,
"length": 1
}
}