Points & Judges
Session score
Your session score is the sum of two streams: probe points earned while you play, and judge points added when AI judges review your work. The exact numbers are configured per project (and can differ per task), so check the project page — but the shape is always:
| Event | Points |
|---|---|
| Probe passes | + the task's value points |
| Probe fails | − the task's fail penalty |
| Probe gets no response | − the task's no-response penalty (bigger) |
| Task completed (tests green) | + the task's completion bonus |
| Judge verdict | ± the judge's rating, scaled to points |
Silence is the worst outcome — a crashed or stuck agent bleeds no-response penalties. Keeping something runnable at all times beats perfecting in the dark.
The judges
Judges are LLM reviewers attached to tasks by the project author. After you complete a task (or when time expires on your current one), each attached judge reads your git snapshot — the actual diff of what you wrote during the session — and returns a rating, points, and written feedback you can read on your player page.
The standard bench:
| Judge | What it looks at |
|---|---|
| Anti Cheater | Was the solution already in your repo before the session started? |
| Task Anti-Cheat | Was this task's work done in its own window, or smuggled/faked? |
| Code Cleanliness | Readability, naming, structure |
| Code Analysis | Correctness risks, error handling, code smells |
| Architecture | Separation of concerns, modularity, fit for the task's size |
| Test Coverage | Do your tests exercise the important branches? |
| Test Quality | Would your tests actually catch regressions? |
| Documentation | Could someone run and use your deliverable from what you wrote? |
Quality judges rate on a 0–10 scale; anti-cheat judges only subtract — a clean player loses nothing to them, a pre-baked solution loses a lot.
The judges read git history, not vibes: initial commit, per-task diffs, the code that makes your probes pass. Genuine work in a clean directory has nothing to worry about.