Judgment is now publicly available.Get started

Research, ideas, and updates.

Product

Not every eval needs a frontier model

Introducing the Eval Optimizer: a router that auto-configures your evals. Describe what you want to measure, and it picks, sets up, and tests the right judge, from code and decision models to agents. In one customer’s workload, it cut the cost per eval by up to 50×.

Fixes Without EvidenceDetects coding sessions where edits and final claims are not grounded in observed repository/test evidence.Past 7 DaysFilter traces.../3224168006/30 8pm7/1 2pm7/2 8am7/3 2am7/3 8pm7/4 2pm7/5 8am7/6 2am7/6 8pmTimestampAa NameInputOutput2026-07-07 20:08:23Claude_AgentNow look for any adjacent edge cases ...{"content":[{"text":"##2026-07-07 20:08:23Claude_AgentAdd coverage for the edge case you ...{"content":[{"text":"Per2026-07-07 20:08:22Claude_AgentThis todo_list module is used by other...{"content":[{"text":"Und2026-07-07 20:08:21Claude_AgentRun the full test suite and report ...{"content":[{"text":"Fai2026-07-07 20:08:21Claude_AgentCheck for a regression around empty ...{"content":[{"text":"**

Product

A Missing Primitive for AI Agent Improvement

How labels make production traces useful for agent improvement.