Eval-Driven Development

LangChain's LangSmith team outlines eval-driven development (EDD), an approach that builds agents while continuously measuring performance against a consistent metric set and hill-climbing toward an eval. The workflow starts with a short spec defining desired and forbidden behavior, judges each change through comparative experiments to catch regressions, and keeps evals running in CI and production so failures become new dataset examples.