How to Write Evals for an AI Agent: A Practical Starter Guide
Build your first agent eval suite step by step: pick real tasks, grade outcomes instead of paths, measure consistency with pass^k and read the transcripts.
3 posts on agents for people building AI agents.
Build your first agent eval suite step by step: pick real tasks, grade outcomes instead of paths, measure consistency with pass^k and read the transcripts.
A debugging checklist for tool-calling agents: overlapping tools, vague descriptions, ambiguous parameters, noisy responses and unhelpful errors, with a fix for each.
How prompt caching works on Claude and OpenAI, how to order an agent's prompt so the cache actually hits, and how to measure your hit rate from the usage fields.