Evals & RL Environments posts

Braintrust vs LangSmith (and Langfuse) for Agent Evals: Offline, Online, and Datadog

Braintrust vs LangSmith vs Langfuse for offline and online agent evals, from someone who has run Braintrust evals on a chat agent and a retrieval system. Includes a comparison table as of October 2026.

Building RL Training Tasks for Coding Agents: Planted Bugs, Rollouts, and Grader Bugs

Notes from a spring 2026 contract building RL environments and training tasks for coding agents: what made a planted bug hard, how rollouts set difficulty, and why I audited the grader before believing a low score.