3 traces · 9 checks
2026-10-20T08:08:51 UTC
PASS6individual checks
FAIL2individual checks
N/A1individual checks
ERROR0individual checks
Illustrative, hand-authored traces. Code rules executed locally. No model was called.
N/A means the rule does not apply. Errors are unresolved evaluations. Neither counts as PASS.
N/A means the rule does not apply. Errors are unresolved evaluations. Neither counts as PASS.
demo-supported-lookup
3 checks| Outcome | Evaluator | Evidence / reason |
|---|---|---|
| PASS | response-presentcode | The agent must return a non-empty final response. | check evaluated to False: not has_final_output |
| PASS | concise-responsecode | The final response must contain at most 160 characters. | check evaluated to False: len(final_content) > 160 |
| PASS | lookup-identifiercode | When lookup is called, each call must provide an identifier. | check evaluated to False: any(not call['input'].get('identifier') for call in lookup_calls) |
Inspect conversation & trace
Full normalized JSON
{
"id": "demo-supported-lookup",
"root": {
"name": "LangGraph",
"type": "CHAIN",
"input": {
"messages": [
{
"type": "human",
"content": "What is the status of order A-104?"
}
]
},
"output": {
"messages": [
{
"type": "ai",
"content": "Order A-104 has shipped. The lookup result confirms the status."
}
]
},
"steps": [
{
"type": "TOOL",
"name": "lookup",
"input": {
"identifier": "A-104"
},
"output": {
"status": "shipped"
},
"steps": []
}
]
}
}demo-missing-final-answer
3 checks| Outcome | Evaluator | Evidence / reason |
|---|---|---|
| FAIL | response-presentcode | The agent must return a non-empty final response. | check evaluated to True: not has_final_output |
| PASS | concise-responsecode | The final response must contain at most 160 characters. | check evaluated to False: len(final_content) > 160 |
| N/A | lookup-identifiercode | Scope tool:lookup was not activated. |
Inspect conversation & trace
Full normalized JSON
{
"id": "demo-missing-final-answer",
"root": {
"id": "conversation",
"parentObservationId": null,
"name": "LangGraph",
"type": "CHAIN",
"input": {
"messages": []
},
"output": {
"messages": [
{
"content": "Please summarize the result.",
"type": "human"
},
{
"content": "",
"type": "ai"
}
]
},
"steps": []
}
}demo-lookup-without-id
3 checks| Outcome | Evaluator | Evidence / reason |
|---|---|---|
| PASS | response-presentcode | The agent must return a non-empty final response. | check evaluated to False: not has_final_output |
| PASS | concise-responsecode | The final response must contain at most 160 characters. | check evaluated to False: len(final_content) > 160 |
| FAIL | lookup-identifiercode | When lookup is called, each call must provide an identifier. | check evaluated to True: any(not call['input'].get('identifier') for call in lookup_calls) |
Inspect conversation & trace
Full normalized JSON
{
"id": "demo-lookup-without-id",
"root": {
"name": "LangGraph",
"type": "CHAIN",
"input": {
"messages": [
{
"type": "human",
"content": "Check my order status."
}
]
},
"output": {
"messages": [
{
"type": "ai",
"content": "Please provide your order identifier so I can check its status."
}
]
},
"steps": [
{
"type": "TOOL",
"name": "lookup",
"input": {},
"output": {
"error": "missing identifier"
},
"steps": []
}
]
}
}