Open Calculator

Parameter Golf Calculator

Why this calculator exists

This calculator helps you decide whether a model idea is worth running before you spend money/time on GPU training.

In the Parameter Golf challenge, your model must be:

1. Good enough (low validation bits-per-byte score, val_bpb), and
2. Small enough (artifact under 16,000,000 bytes), and
3. Fast enough (train/eval runtime limits).

This tool gives a fast pre-check for those constraints.

---

What is the goal?

The goal is to find input values that produce:

• val_bpb_pred as low as possible,
• artifact_ok = true,
• train_runtime_ok = true,
• eval_runtime_ok = true,
• and therefore eligible = true.

If eligible = false, your candidate likely fails challenge constraints and should be adjusted before expensive runs.

---

Inputs

Model shape inputs

• V: Vocabulary size (how many token IDs your tokenizer can output).
• d: Model width (hidden size).
• L: Numbe