Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Translate
translate-029
hard en-zh-hansproduct
The prompt
user
Translate the following text into Simplified Chinese. Reply with only the translation. The Lumen Pro 15 laptop features a 15.6-inch 2.8K OLED display (120 Hz), 32 GB of RAM and a 1 TB SSD. It weighs 1.65 kg and the 72 Wh battery lasts up to 14 hours of video playback.
What we expected
{
"source_lang": "en",
"target_lang": "zh",
"register_note": null,
"source": "The Lumen Pro 15 laptop features a 15.6-inch 2.8K OLED display (120 Hz), 32 GB of RAM and a 1 TB SSD. It weighs 1.65 kg and the 72 Wh battery lasts up to 14 hours of video playback.",
"reference": "Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120Hz）、32GB 内存和 1TB 固态硬盘。重量为 1.65 千克，72Wh 电池可支持长达 14 小时的视频播放。",
"alt_references": [],
"must_keep": [
[
"Lumen Pro 15"
],
[
"15.6"
],
[
"2.8K"
],
[
"OLED"
],
[
"120Hz",
"120赫兹"
],
[
"32GB",
"32G"
],
[
"1TB",
"1T"
],
[
"1.65kg",
"1.65千克",
"1.65公斤"
],
[
"72Wh",
"72瓦时"
],
[
"14小时",
"十四小时",
"14个小时",
"十四个小时"
]
],
"register_check": null,
"avoid": []
}What each model answered
MiMo-V2.6 Distill 9B
✓ pass · score 98 (scripted checks 100, judges 9.5/10 from 3) · 2.10 s
Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120 Hz）、32 GB 内存和 1 TB SSD。整机重量 1.65 kg，72 Wh 电池续航最长可达 14 小时视频播放。
Judge medians: Adequacy 10 · Fluency and register 9
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120 Hz）、32 GB 内存和 1 TB SSD。整机重量 1.65 kg，72 Wh 电池续航最长可达 14 小时视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 71.93,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}Ornith-1.5 9B
✗ fail · score 94 (scripted checks 98, judges 9.0/10 from 3) · 1.53 s
明睿Pro 15笔记本电脑配备15.6英寸2.8K OLED显示屏（120Hz）、32GB内存和1TB固态硬盘。机身重1.65千克，72Wh电池续航最长可达14小时视频播放。
Judge medians: Adequacy 9 · Fluency and register 9
Scoring detail
{
"target_lang": "zh",
"cleaned": "明睿Pro 15笔记本电脑配备15.6英寸2.8K OLED显示屏（120Hz）、32GB内存和1TB固态硬盘。机身重1.65千克，72Wh电池续航最长可达14小时视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 77,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "11/12",
"failed_checks": [
{
"type": "keep",
"terms": [
"Lumen Pro 15"
],
"ok": false,
"found": null
}
],
"chrf_scaled": 1
}Granite 4.2 8B
✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 1.91 s
Lumen Pro 15笔记本电脑配备15.6英寸2.8K OLED显示屏（120Hz），32GB内存和1TB固态硬盘。它重1.65公斤，72Wh电池可支持最长14小时的视频播放。
Judge medians: Adequacy 10 · Fluency and register 10
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15笔记本电脑配备15.6英寸2.8K OLED显示屏（120Hz），32GB内存和1TB固态硬盘。它重1.65公斤，72Wh电池可支持最长14小时的视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 79.54,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}Spark-X2.5 4B
✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 1.23 s
Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120 Hz）、32 GB 内存和 1 TB SSD。其重 1.65 千克，72 Wh 电池可支持长达 14 小时的视频播放。
Judge medians: Adequacy 10 · Fluency and register 10
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120 Hz）、32 GB 内存和 1 TB SSD。其重 1.65 千克，72 Wh 电池可支持长达 14 小时的视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 88.47,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}Mellum2.1 12B-A2.5B
✓ pass · score 95 (scripted checks 100, judges 9.0/10 from 3) · 0.96 s
Lumen Pro 15 笔记本电脑配备了 15.6 英寸的 2.8K OLED 显示器（120 Hz）、32 GB 内存和 1 TB SSD 硬盘。其重量为 1.65 kg，72 Wh 电池可续航高达 14 小时视频播放。
Judge medians: Adequacy 10 · Fluency and register 8
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 笔记本电脑配备了 15.6 英寸的 2.8K OLED 显示器（120 Hz）、32 GB 内存和 1 TB SSD 硬盘。其重量为 1.65 kg，72 Wh 电池可续航高达 14 小时视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 66.08,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}Ling-3.0-tiny (7.9B-A1.3B)
✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 0.67 s
Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120Hz）、32GB 内存和 1TB 固态硬盘，重量为 1.65 公斤，72Wh 电池可支持长达 14 小时的视频播放。
Judge medians: Adequacy 10 · Fluency and register 10
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 笔记本电脑配备 15.6 英寸 2.8K OLED 显示屏（120Hz）、32GB 内存和 1TB 固态硬盘，重量为 1.65 公斤，72Wh 电池可支持长达 14 小时的视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 90.56,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}MiniCPM5 2B
✓ pass · score 100 (scripted checks 100, judges 10.0/10 from 3) · 0.76 s
Lumen Pro 15 笔记本电脑配备 15.6英寸 2.8K OLED 显示屏（120Hz）、32GB 内存和 1TB SSD，重量 1.65kg，72Wh 电池可支持长达 14 小时的视频播放。
Judge medians: Adequacy 10 · Fluency and register 10
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 笔记本电脑配备 15.6英寸 2.8K OLED 显示屏（120Hz）、32GB 内存和 1TB SSD，重量 1.65kg，72Wh 电池可支持长达 14 小时的视频播放。",
"detected_lang": "zh",
"lang_ok": true,
"chrf": 83.53,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "12/12",
"failed_checks": [],
"chrf_scaled": 1
}K2-Horizon 0.9B
✗ fail · score 0 (scripted checks 0, judges 0.0/10 from 3) · 0.25 s
Lumen Pro 15 15.6 2.8K OLED 120Hz 32GB 1TB SSD 1.65kg 72Wh 14h video playback
Judge medians: Adequacy 0 · Fluency and register 0
Scoring detail
{
"target_lang": "zh",
"cleaned": "Lumen Pro 15 15.6 2.8K OLED 120Hz 32GB 1TB SSD 1.65kg 72Wh 14h video playback",
"detected_lang": "unknown",
"lang_ok": false,
"chrf": 29.08,
"best_ref": 0,
"pass_bar": 30,
"checks_passed": "11/12",
"failed_checks": [
{
"type": "keep",
"terms": [
"14小时",
"十四小时",
"14个小时",
"十四个小时"
],
"ok": false,
"found": null
}
],
"chrf_scaled": 0.477,
"reason": "wrong language (detected unknown, expected zh)"
}