Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Rewrite and proofread

rewrite-023

medium tonecurt-to-warm

The prompt

user

Rewrite the message below so it sounds warm and friendly while keeping the same information. Keep every fact (names, dates, times, amounts, reference numbers) as given, and do not add new facts or numbers. Reply with only the rewritten message, with no preamble or explanation.

"""
Deshawn - re: Marketing Associate application. Position filled. Not moving forward with you. Resume stays on file 6 months.
- K. Moreno, Halcyon Outfitters
"""

What we expected

{
  "type": "tone",
  "style": "curt-to-warm",
  "source": "Deshawn - re: Marketing Associate application. Position filled. Not moving forward with you. Resume stays on file 6 months.\n- K. Moreno, Halcyon Outfitters",
  "facts": [
    {
      "name": "Deshawn",
      "any": [
        "deshawn"
      ]
    },
    {
      "name": "Marketing Associate",
      "any": [
        "marketing associate"
      ]
    },
    {
      "name": "not moving forward",
      "any": [
        "not moving forward",
        "won't be moving forward",
        "will not be moving forward",
        "not be moving forward",
        "another candidate",
        "other candidates",
        "different direction",
        "not to move forward",
        "move forward with other",
        "been filled",
        "has filled",
        "have filled"
      ]
    },
    {
      "name": "resume on file",
      "any": [
        "resume",
        "résumé"
      ]
    },
    {
      "name": "6 months",
      "any": [
        "6 months",
        "six months"
      ]
    },
    {
      "name": "Moreno",
      "any": [
        "moreno"
      ]
    },
    {
      "name": "Halcyon Outfitters",
      "any": [
        "halcyon outfitters"
      ]
    }
  ],
  "banned": [],
  "banned_re": [],
  "no_caps": false,
  "caps_ok": [],
  "extra_numbers_ok": [],
  "length_ratio": [
    1.2,
    6
  ],
  "reference": "Hi Deshawn,\n\nThank you so much for applying for the Marketing Associate position and for the time you put into your application. We've decided to fill the role with another candidate, so we won't be moving forward this time. We'll keep your resume on file for 6 months, and we'd be glad to hear from you again if another opening fits your experience.\n\nWishing you all the best,\nK. Moreno\nHalcyon Outfitters"
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 95 (scripted checks 100, judges 9.0/10 from 3) · 2.52 s

Hi Deshawn — thanks again for your interest in the Marketing Associate role at Halcyon Outfitters. The position has been filled, so we're not moving forward with your application at this time. Your resume will stay on file for six months. Best of luck, and we'll be in touch if anything changes. — K. Moreno, Halcyon Outfitters

Judge medians: Tone match 10 · Faithfulness 7 · Naturalness 10

Scoring detail

{
  "cleaned_words": 55,
  "similarity_to_source": 0.444,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 2.5,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Ornith-1.5 9B

✓ pass · score 93 (scripted checks 100, judges 8.7/10 from 3) · 1.81 s

Dear Deshawn,

Thank you for your application for the Marketing Associate position at Halcyon Outfitters. Unfortunately, we have filled the role and will not be moving forward with you. Your resume will remain on file for six months.

Best regards,
K. Moreno
Halcyon Outfitters

Judge medians: Tone match 7 · Faithfulness 10 · Naturalness 9

Scoring detail

{
  "cleaned_words": 44,
  "similarity_to_source": 0.441,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 2,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Granite 4.2 8B

✓ pass · score 98 (scripted checks 100, judges 9.7/10 from 3) · 2.17 s

Hi Deshawn,

I hope you're doing well. I'm writing to let you know that the Marketing Associate position you applied for has been filled, so we won't be moving forward with your application at this time. However, we'll keep your resume on file for the next six months.

Best regards,  
K. Moreno  
Halcyon Outfitters

Judge medians: Tone match 9 · Faithfulness 10 · Naturalness 10

Scoring detail

{
  "cleaned_words": 54,
  "similarity_to_source": 0.333,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 2.455,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Spark-X2.5 4B

✓ pass · score 82 (scripted checks 100, judges 6.3/10 from 3) · 1.50 s

Hi Deshawn,

Thank you for applying to be a Marketing Associate at Halcyon Outfitters. We are pleased to let you know that the position has been filled, so we are unable to move forward with your application at this time. Your resume will remain on file for the next six months.

K. Moreno
Halcyon Outfitters

Judge medians: Tone match 4 · Faithfulness 10 · Naturalness 5

Scoring detail

{
  "cleaned_words": 55,
  "similarity_to_source": 0.304,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 2.5,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Mellum2.1 12B-A2.5B

✗ fail · score 78 (scripted checks 100, judges 5.7/10 from 3) · 0.70 s

Deshawn, regarding your Marketing Associate application, we have decided not to move forward with your candidacy at this time. Your resume will remain on file for six months.

- K. Moreno, Halcyon Outfitters

Judge medians: Tone match 3 · Faithfulness 6 · Naturalness 8

Scoring detail

{
  "cleaned_words": 32,
  "similarity_to_source": 0.491,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 1.455,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 82 (scripted checks 100, judges 6.3/10 from 3) · 0.51 s

Deshawn - regarding your Marketing Associate application, the position has been filled. We're not moving forward with you at this time. Your resume remains on file for 6 months.

- K. Moreno, Halcyon Outfitters

Judge medians: Tone match 2 · Faithfulness 10 · Naturalness 7

Scoring detail

{
  "cleaned_words": 32,
  "similarity_to_source": 0.69,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 1.455,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 1,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 1,
    "length": 1
  }
}

MiniCPM5 2B

✗ fail · score 33 (scripted checks 19, judges 4.7/10 from 3) · 0.68 s

Deshawn - re: Marketing Associate application. Position filled. Not moving forward with you. Resume stays on file 6 months.
- K. Moreno, Halcyon Outfitters

Judge medians: Tone match 0 · Faithfulness 10 · Naturalness 4

Scoring detail

{
  "cleaned_words": 22,
  "similarity_to_source": 1,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 1,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 0.25,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 0,
    "length": 0
  }
}

K2-Horizon 0.9B

✗ fail · score 33 (scripted checks 19, judges 4.7/10 from 3) · 0.23 s

Deshawn - re: Marketing Associate application. Position filled. Not moving forward with you. Resume stays on file 6 months. - K. Moreno, Halcyon Outfitters

Judge medians: Tone match 0 · Faithfulness 10 · Naturalness 4

Scoring detail

{
  "cleaned_words": 22,
  "similarity_to_source": 1,
  "facts_missing": [],
  "new_numbers": [],
  "length_ratio": 1,
  "length_bounds": [
    1.2,
    6
  ],
  "gate": 0.25,
  "checks": {
    "facts": 1,
    "numbers": 1,
    "changed": 0,
    "length": 0
  }
}

← rewrite-022All Rewrite and proofread itemsrewrite-024 →