Context
PR adcontextprotocol/adcp#1782 fixed the Reporting compliance track by mapping it to the full_sales_flow scenario. This works but is imprecise — full_sales_flow only conditionally exercises get_media_buy_delivery, so an agent without that tool could still pass reporting via the rest of the flow.
Proposed
Add a dedicated reporting_flow scenario that specifically validates:
- Agent declares
reporting in supported_protocols
- Agent has
get_media_buy_delivery tool
- Tool returns valid delivery data with expected dimensions/metrics
- Currency field is present
Then update TRACK_SCENARIOS['reporting'] in the evaluator to use ['reporting_flow'] instead of ['full_sales_flow'].
Why
Precise compliance evaluation — each track should have scenarios that test exactly what that track requires, not piggyback on broader flows.
Context
PR adcontextprotocol/adcp#1782 fixed the Reporting compliance track by mapping it to the
full_sales_flowscenario. This works but is imprecise —full_sales_flowonly conditionally exercisesget_media_buy_delivery, so an agent without that tool could still pass reporting via the rest of the flow.Proposed
Add a dedicated
reporting_flowscenario that specifically validates:reportinginsupported_protocolsget_media_buy_deliverytoolThen update
TRACK_SCENARIOS['reporting']in the evaluator to use['reporting_flow']instead of['full_sales_flow'].Why
Precise compliance evaluation — each track should have scenarios that test exactly what that track requires, not piggyback on broader flows.