DigitalOcean 推出智能体静默失败检测与回放工具
DigitalOcean 推出 Signals 和 Simulations 两款工具，用于发现并回放智能体的静默失败。Signals 用低成本规则而非 AI 模型监控实时会话，识别用户重复提问、要求转人工或工具循环重试等异常信号，再交给 Simulations 用模拟用户对修复后的智能体重跑整段对话，让生产环境中的真实失败自动成为测试集。
Agent failures often pass every health check. A tool call hits the wrong database region, returns 200, and the user gets a slower, worse answer. Nothing alerts.
DigitalOcean’s new tools flag agent sessions that fail silently, then replay them against a fix before release.
Because, the clue behind an agent bug is often sitting in something nobody can search.
Signals watches every live session with cheap rules, not an AI model, that look for human trouble signs such as a user repeating themselves, asking for a human, or a tool being retried in a loop, then passes those sessions to Simulations, which replays them with a fake user against your fixed agent to check the whole conversation works before the fix ships.
Until now teams had to pay an LLM to grade every conversation, read transcripts by hand, or invent test cases from imagination, while here the real failures from production automatically become the test set.
https://x.com/digitalocean/status/2109658000612835374/video/1
来源：Rohan Paul · x.com