Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread
rewrite-002
easy proofreadnote
The prompt
user
Proofread the text below. Fix spelling, grammar, and punctuation mistakes only. Do not rephrase sentences that are already correct, and keep names, numbers, wording, and layout otherwise the same. Reply with only the corrected text, with no preamble and no list of changes. """ Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring you're laptop and the printed copys of the Q3 forecast. Lena said she will send the agenda tommorow morning. """
What we expected
{
"type": "proofread",
"source": "Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring you're laptop and the printed copys of the Q3 forecast. Lena said she will send the agenda tommorow morning.",
"errors": [
{
"wrong": "you're laptop",
"fixed": [
"your laptop"
]
},
{
"wrong": "copys",
"fixed": [
"copies"
]
},
{
"wrong": "tommorow",
"fixed": [
"tomorrow"
]
}
],
"preserve": [
"Marcus",
"Thursday",
"10:30",
"Lena",
"Q3"
],
"must_keep": [],
"length_ratio": [
0.8,
1.25
],
"reference": "Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning."
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 100 · 1.87 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Ornith-1.5 9B
✓ pass · score 100 · 1.58 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Granite 4.2 8B
✓ pass · score 100 · 1.56 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Spark-X2.5 4B
✓ pass · score 100 · 1.12 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Mellum2.1 12B-A2.5B
✓ pass · score 100 · 0.74 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 · 0.54 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda tomorrow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 0.925,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 1,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}MiniCPM5 2B
✗ fail · score 92 · 0.61 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring your laptop and the printed copies of the Q3 forecast. Lena said she will send the agenda to tomorrow morning.
Scoring detail
{
"cleaned_words": 41,
"similarity_to_source": 0.914,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "copys",
"wrong_gone": true,
"fixed_present": true,
"score": 1
},
{
"wrong": "tommorow",
"wrong_gone": true,
"fixed_present": true,
"score": 1
}
],
"fidelity": {
"similarity_to_reference": 0.988,
"unknown_words": [],
"reworded": false,
"unrequested_edits": [
{
"op": "insert",
"reference": "",
"answer": "to"
}
]
},
"preserve_missing": [],
"length_ratio": 1.025,
"length_bounds": [
0.8,
1.25
],
"gate": 1,
"checks": {
"errors": 1,
"fidelity": 0.5,
"preserve": 1,
"length": 1
}
}K2-Horizon 0.9B
✗ fail · score 0 · 0.30 s
Hey Marcus, just a reminder that the budget meeting got moved to Thursday at 10:30 in conference room B. Please bring you're laptop and the printed copys of the Q3 forecast. Lena said she will send the agenda tommorow morning.
Scoring detail
{
"cleaned_words": 40,
"similarity_to_source": 1,
"errors": [
{
"wrong": "you're laptop",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "copys",
"wrong_gone": false,
"fixed_present": false,
"score": 0
},
{
"wrong": "tommorow",
"wrong_gone": false,
"fixed_present": false,
"score": 0
}
],
"fidelity": {
"similarity_to_reference": 0.925,
"unknown_words": [],
"reworded": false,
"unrequested_edits": []
},
"preserve_missing": [],
"length_ratio": 1,
"length_bounds": [
0.8,
1.25
],
"gate": 0,
"checks": {
"errors": 0,
"fidelity": 1,
"preserve": 1,
"length": 1
}
}