Settings
Runs
When agents fail, slow down or ask for help.
| Alert | Shared inbox | In the app | |
|---|---|---|---|
| Runs are failingMore than 5% of an agent's runs fail within 10 minutes | |||
| Latency is highp95 stays above 10 s for 15 minutes | |||
| An agent asks for a personA conversation is handed off |
Budget
Based on the monthly budget set for this workspace.
| Alert | Shared inbox | In the app | |
|---|---|---|---|
| Spend reaches 80%Sent once per month | |||
| Budget is exceededSent the moment spend passes the budget |
Evaluations
Quality checks that run after each deploy.
| Alert | Shared inbox | In the app | |
|---|---|---|---|
| A score dropsAny suite falls by 0.03 or more after a deploy | |||
| A case needs reviewA grader asks for a human decision |
Quiet hours
Hold email and chat alerts overnight. Budget alerts still come through.
On