Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Assistant actions

assistant-actions-042

hard no_tool

The prompt

Tools offered: create_reminder, add_calendar_event, set_timer, set_alarm, control_light, set_thermostat, lock_door, send_message, play_music, get_weather, add_to_list, navigate_to

user

Do I really need a timer for hard-boiled eggs, or can I eyeball it? How long do they usually take?

What we expected

{
  "calls": [],
  "behavior": "no_tool",
  "text_contains_any": [
    "minute",
    "min"
  ]
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 3.62 s

A timer is much more reliable than eyeballing — the water temperature and heat level vary too much to judge by feel.

For large eggs:
- **Medium heat, covered** — about **9–10 minutes** for soft, jammy yolks; **11–12 minutes** for fully set yolks.
- Start the timer the moment the water reaches a rolling boil.
- Then immediately transfer to an ice bath for 5 minutes to stop cooking and make peeling easier.

If you want, I can set a timer for you — just tell me how many minutes you'd like.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

Ornith-1.5 9B

✓ pass · score 100 · 4.14 s

You can definitely eyeball it, but a timer is more reliable. Here's the quick guide:

- **Eggs at a rolling boil:** start the timer right when they go in.
- **Soft-boiled** (runny yolk, set white): 6–7 minutes
- **Medium** (slightly jammy yolk): 8–9 minutes
- **Hard-boiled** (fully set): 10–12 minutes

Tips for consistency:
- Use room-temperature eggs or lower the water before dropping them in.
- Add a splash of vinegar or salt to the water.
- Ice bath for 1 minute stops the cooking and makes peeling easier.

If you'd like, I can set a timer for you—just tell me how many eggs and how you like your yolks.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

Granite 4.2 8B

✓ pass · score 100 · 3.18 s

Hard-boiled eggs typically take about 10–12 minutes to cook in boiling water. For a timer, set it for 10 minutes (they’re usually done around then, with a minute or two extra for perfect tenderness). You can eyeball it too—when the eggs stop rocking in the water and the timer says ~10 minutes, they’re usually ready. Want me to set a timer for you? Just say “Set a timer for 10 minutes for eggs” and I’ll do it.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

Spark-X2.5 4B

✓ pass · score 100 · 2.75 s

No, you don't really need a timer for hard-boiled eggs — it's pretty reliable to eyeball it. The standard rule is **10 to 12 minutes**, depending on the size of the eggs and the heat of the water.

- **Smaller eggs** (like 6- or 7-oz): about **10 minutes**
- **Larger eggs** (8- or 10-oz): about **12 minutes**

The key is to start timing as soon as the water returns to a **rolling boil**, and let them cook for that set time. If you're in a hurry, 10 minutes is usually enough for most eggs to be firm and fully cooked.

Want me to set a timer for you while you boil the eggs?

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 2.68 s

Hard-boiled eggs usually take about 10–12 minutes of boiling time for firm yolks. You can eyeball it, but a timer helps ensure consistency.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 1.65 s

You don't *need* a timer, but a timer is a lot easier than eyeballing it — especially if you're making a bunch.

For hard-boiled eggs, the general rule is:
- **6–8 minutes** for a soft-boiled (slightly runny yolk)
- **10–12 minutes** for a hard-boiled (fully set yolk and white)

If you're using a clock or a timer, set it for **10 minutes** if you want them fully hard-boiled. If you're okay with a softer yolk, **7–8 minutes** works.

A quick tip: once the timer goes off, transfer them to ice water for a few minutes — that stops the cooking and makes peeling much easier.

Want me to set a timer for you next time you boil eggs?

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

MiniCPM5 2B

✓ pass · score 100 · 1.40 s

Great question! Hard-boiled eggs are a classic, but they do take a bit of time. Typically, they take about **10–12 minutes** to boil until firm, depending on your water temperature and pressure cooker (or pressure cooker vs. just a pot). If you're using a pressure cooker, you can get them down quickly, but if you're just boiling in a pot, you'll want to keep an eye on them.

So no need to set a timer unless you want to be extra careful — but if you do want one, I can set a 12-minute timer for you! Just let me know.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": true
}

K2-Horizon 0.9B

✗ fail · score 50 · 0.44 s

I don't have access to tools that can check cooking times or provide information about hard-boiled eggs. The tools I have available are for managing your home and phone—like setting timers, controlling lights, playing music, checking weather, and more. For accurate cooking times, I'd recommend checking a reliable recipe site or asking a cooking expert.

Scoring detail

{
  "n_calls": 0,
  "calls": [],
  "behavior": "no_tool",
  "answer_ok": false
}

← assistant-actions-041All Assistant actions itemsassistant-actions-043 →