Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread

rewrite-021

easy tonecasual-to-professional

The prompt

user

Rewrite the message below in a clear, professional tone suitable for a work email. Keep every fact (names, dates, times, amounts, reference numbers) as given, and do not add new facts or numbers. Reply with only the rewritten message, with no preamble or explanation.

"""
hi prof!! sorry i missed class today, was super sick. can u send me the slides from lecture 8? also is the essay still due on the 21st?? thx - jordan
"""

What we expected

{
  "type": "tone",
  "style": "casual-to-professional",
  "source": "hi prof!! sorry i missed class today, was super sick. can u send me the slides from lecture 8? also is the essay still due on the 21st?? thx - jordan",
  "facts": [
    {
      "name": "missed class",
      "any": [
        "missed class",
        "missed today's class",
        "missed the class",
        "missing class",
        "miss class",
        "absence",
        "absent",
        "unable to attend",
        "not able to attend",
        "couldn't make it",
        "could not make it",
        "couldn't attend",
        "could not attend",
        "wasn't able to attend",
        "was not able to attend",
        "missed your class",
        "missed lecture",
        "missed today's lecture",
        "missing today's class",
        "missing today's lecture",
        "missing your class",
        "missing the class",
        "missing lecture"
      ]
    },
    {
      "name": "slides",
      "any": [
        "slides"
      ]
    },
    {
      "name": "lecture 8",
      "any": [
        "lecture 8"
      ]
    },
    {
      "name": "essay",
      "any": [
        "essay"
      ]
    },
    {
      "name": "21st",
      "any": [
        "21st"
      ]
    },
    {
      "name": "Jordan",
      "any": [
        "jordan"
      ]
    }
  ],
  "banned": [
    "thx",
    "u",
    "!!",
    "??",
    "super sick",
    "hi prof"
  ],
  "banned_re": [],
  "no_caps": false,
  "caps_ok": [],
  "extra_numbers_ok": [],
  "length_ratio": [
    0.5,
    3
  ],
  "reference": "Dear Professor,\n\nI'm sorry I missed class today; I was quite ill. Could you please send me the slides from Lecture 8? I also wanted to confirm whether the essay is still due on the 21st.\n\nThank you,\nJordan"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 2) · 1.75 s

Hi Professor,

I apologize for missing class today; I was very ill. Could you please send me the slides from Lecture 8? Also, is the essay still due on the 21st?

Thank you,
Jordan

Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 10

Scoring detail

{
  "cleaned_words": 34,
  "similarity_to_source": 0.585,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.133,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Ornith-1.5 9B

✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 1.66 s

Dear Professor,

I am writing to apologize for missing class today, as I was feeling unwell. Could you please send me the slides from Lecture 8? Additionally, I would like to confirm whether the essay is still due on the 21st.

Thank you,

Jordan

Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 10

Scoring detail

{
  "cleaned_words": 44,
  "similarity_to_source": 0.48,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.467,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Granite 4.2 8B

✓ pass · score 98 (scripted checks 100, judges 9.7/10 from 3) · 1.84 s

Dear Professor,

I hope you are well. I missed today’s class due to illness. Could you please send me the slides from Lecture 8? Additionally, could you confirm whether the essay is still due on the 21st?

Thank you for your assistance.

Best regards,  
Jordan

Judge medians: Tone match 10 · Faithfulness 9 · Naturalness 10

Scoring detail

{
  "cleaned_words": 45,
  "similarity_to_source": 0.447,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.5,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Spark-X2.5 4B

✓ pass · score 98 (scripted checks 100, judges 9.7/10 from 3) · 1.12 s

Dear Professor,

I apologize for missing class today due to illness. Could you please send me the slides from Lecture 8? Additionally, may I confirm if the essay is still due on the 21st?

Thank you,
Jordan

Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 9

Scoring detail

{
  "cleaned_words": 37,
  "similarity_to_source": 0.471,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.233,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 0.69 s

Hi Professor,

I apologize for missing class today due to illness. Could you please send me the slides from Lecture 8? Additionally, is the essay still due on the 21st?

Thank you,
Jordan

Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 10

Scoring detail

{
  "cleaned_words": 33,
  "similarity_to_source": 0.562,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.1,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✗ fail · score 87 (scripted checks 80, judges 9.3/10 from 3) · 0.51 s

Hi Prof,

I apologize for missing class today due to illness. Could you please send me the slides from Lecture 8? Additionally, is the essay still due on the 21st?

Thank you,
Jordan

Judge medians: Tone match 9 · Faithfulness 10 · Naturalness 9

Scoring detail

{
  "cleaned_words": 33,
  "similarity_to_source": 0.562,
  "facts_missing": [],
  "banned_hits": [
    "hi prof"
  ],
  "new_numbers": [],
  "length_ratio": 1.1,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 0,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

MiniCPM5 2B

✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 0.76 s

Dear Professor, I apologize for missing class today, as I was feeling unwell. Could you please send me the slides from lecture 8? Additionally, is the essay still due on the 21st? Thank you – Jordan.

Judge medians: Tone match 10 · Faithfulness 10 · Naturalness 10

Scoring detail

{
  "cleaned_words": 35,
  "similarity_to_source": 0.567,
  "facts_missing": [],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.167,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

K2-Horizon 0.9B

✗ fail · score 90 (scripted checks 93, judges 8.7/10 from 3) · 0.28 s

Hi Professor,

I apologize for missing class today. I was very sick and was unable to attend. Could you please send me the slides from lecture 8? Also, is the essay still due on the 21st? Thank you.

Judge medians: Tone match 10 · Faithfulness 8 · Naturalness 8

Scoring detail

{
  "cleaned_words": 38,
  "similarity_to_source": 0.522,
  "facts_missing": [
    "Jordan"
  ],
  "banned_hits": [],
  "new_numbers": [],
  "length_ratio": 1.267,
  "length_bounds": [
    0.5,
    3
  ],
  "gate": 1,
  "checks": {
    "facts": 0.8333,
    "banned": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

← rewrite-020All Rewrite and proofread itemsrewrite-022 →