[observability] Observability Coverage Report - 2026-05-07

[github-actions[bot]]

Executive Summary

Analyzed 170 downloaded workflow runs for observability coverage. The requested window was the last 7 days; the MCP log fetch completed for parsed artifacts from 2026-05-06 13:46 UTC through 2026-05-06 23:59 UTC. A 100-run all-workflows fetch timed out after partial artifact download, then a 75-run fetch completed and supplied the dataset used here.
AWF Firewall coverage is 91.5%: 75 of 82 firewall-enabled runs had access.log artifacts. MCP Gateway telemetry coverage is 100.0%: all 75 MCP-enabled runs had rpc-messages.jsonl; no gateway.jsonl files were present in this sample, so the canonical JSON-RPC fallback was used throughout.

Key Alerts and Anomalies

🔴 Critical Issues:

• Missing firewall access.log: Super Linter Report §25442628138 (failure, 2026-05-06T14:48:03Z)
• Missing firewall access.log: Go Pattern Detector §25444290134 (success, 2026-05-06T15:18:20Z)
• Missing firewall access.log: Smoke CI §25444553809 (cancelled, 2026-05-06T15:23:14Z)
• Missing firewall access.log: Documentation Unbloat §25449195821 (failure, 2026-05-06T16:56:23Z)

⚠️ Warnings:

• Firewall artifacts not available yet for in-progress run: Daily Documentation Healer §25467911393
• Firewall artifacts not available yet for in-progress run: Semantic Function Refactoring §25467930693
• Firewall artifacts not available yet for in-progress run: Daily Observability Report for AWF Firewall and MCP Gateway §25467949679
• MCP telemetry file present but empty: Auto-Triage Issues §25442093321 (rpc-messages.jsonl)
• MCP telemetry file present but empty: Daily Issues Report Generator §25444166323 (rpc-messages.jsonl)
• MCP telemetry file present but empty: Smoke Pi §25444740266 (rpc-messages.jsonl)
• MCP telemetry file present but empty: Contribution Check §25450254117 (rpc-messages.jsonl)
• MCP telemetry file present but empty: Auto-Triage Issues §25455287514 (rpc-messages.jsonl)
• MCP telemetry file present but empty: Contribution Check §25461529863 (rpc-messages.jsonl)

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	82	75	91.5%	⚠️
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	75	75	100.0%	✅

Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Package Specification Librarian	§25439207993	✅	251	251	0	✅
Developer Documentation Consolidator	§25440125451	✅	302	302	0	✅
Daily Malicious Code Scan Agent	§25440126477	✅	123	123	0	✅
AI Moderator	§25440612096	✅	43	43	0	✅
Q	§25441712248	✅	616	616	0	✅
Auto-Triage Issues	§25442093321	✅	79	79	0	✅
Super Linter Report	§25442628138	❌	0	0	0	🔴
Architecture Guardian	§25443489560	✅	32	32	0	✅
Daily Fact About gh-aw	§25443512831	✅	13	13	0	✅
Dead Code Removal Agent	§25443535713	✅	639	639	0	✅
Daily Sub-Agent Optimizer	§25443535912	✅	603	603	0	✅
Daily Issues Report Generator	§25444166323	✅	15	15	0	✅
Go Pattern Detector	§25444290134	❌	0	0	0	🔴
Smoke CI	§25444553809	❌	0	0	0	🔴
Copilot Token Usage Optimizer	§25444570025	✅	271	271	0	✅
Design Decision Gate 🏗️	§25444587865	✅	37	37	0	✅
Matt Pocock Skills Reviewer	§25444587877	✅	34	34	0	✅
Test Quality Sentinel	§25444587838	✅	35	35	0	✅
Smoke CI	§25444622884	✅	11	11	0	✅
DeepReport - Intelligence Gathering Agent	§25444622992	✅	385	385	0	✅
Issue Triage Agent	§25444725822	✅	89	89	0	✅
Smoke Gemini	§25444740279	✅	577	289	288	✅
Smoke Copilot	§25444740273	✅	602	567	35	✅
Changeset Generator	§25444740213	✅	63	63	0	✅
Smoke Claude	§25444740277	✅	447	407	40	✅
Smoke Pi	§25444740266	✅	52	32	20	✅
Smoke Codex	§25444740353	✅	299	278	21	✅
Agent Container Smoke Test	§25444740214	✅	33	33	0	✅
Delight	§25444845368	✅	299	299	0	✅
Daily CLI Performance Agent	§25445152041	✅	222	222	0	✅
Breaking Change Checker	§25445290305	✅	58	58	0	✅
Daily Copilot PR Merged Report	§25445933963	✅	313	313	0	✅
The Daily Repository Chronicle	§25446408525	✅	812	812	0	✅
Agent Persona Explorer	§25446762227	✅	304	303	1	✅
Daily Security Observability Report	§25447469083	✅	1901	1901	0	✅
Slide Deck Maintainer	§25448425310	✅	232	232	0	✅
GEO Optimizer Daily Audit	§25449098311	✅	113	113	0	✅
Documentation Unbloat	§25449195821	❌	0	0	0	🔴
Contribution Check	§25450254117	✅	130	130	0	✅
AI Moderator	§25450724913	✅	40	40	0	✅
Smoke CI	§25450933657	✅	10	10	0	✅
Daily Secrets Analysis Agent	§25452470566	✅	125	125	0	✅
PR Triage Agent	§25454479534	✅	66	66	0	✅
Copilot Agent PR Analysis	§25454487709	✅	239	239	0	✅
Release	§25454542215	✅	207	207	0	✅
Daily Cache Strategy Analyzer	§25454924987	✅	503	501	2	✅
Daily Code Metrics and Trend Tracking Agent	§25455044957	✅	1562	1562	0	✅
Auto-Triage Issues	§25455287514	✅	178	178	0	✅
Daily Safe Output Integrator	§25455592425	✅	94	94	0	✅
[aw] Failure Investigator (6h)	§25455735783	✅	517	517	0	✅
Daily Grafana OTel Instrumentation Advisor	§25456746932	✅	349	349	0	✅
Smoke CI	§25456907436	✅	10	10	0	✅
Agent Container Smoke Test	§25457749827	✅	37	37	0	✅
Smoke CI	§25458052656	✅	10	10	0	✅
Daily SPDD Spec Planner	§25458416345	✅	183	183	0	✅
Smoke CI	§25458502142	✅	10	10	0	✅
Smoke CI	§25458742264	✅	10	10	0	✅
Daily Team Evolution Insights	§25459876996	✅	226	226	0	✅
Lockfile Statistics Analysis Agent	§25460000332	✅	495	495	0	✅
Smoke CI	§25460357033	✅	11	11	0	✅
Smoke CI	§25460505811	✅	10	10	0	✅
Copilot PR Prompt Pattern Analysis	§25460769779	✅	108	108	0	✅
Smoke CI	§25460774756	✅	11	11	0	✅
Daily Caveman Optimizer	§25460853277	✅	634	634	0	✅
Daily Project Performance Summary Generator (Using MCP Scripts)	§25461028598	✅	698	698	0	✅
Contribution Check	§25461529863	✅	189	189	0	✅
Agentic Workflow Audit Agent	§25462368704	✅	1659	1659	0	✅
Daily Regulatory Report Generator	§25462477764	✅	171	171	0	✅
AI Moderator	§25464846427	✅	33	33	0	✅
Issue Monster	§25465519347	✅	41	41	0	✅
Smoke CI	§25466510314	✅	10	10	0	✅
Smoke CI	§25466694060	✅	12	12	0	✅
Smoke CI	§25466719178	✅	10	10	0	✅
Issue Monster	§25466757771	✅	52	52	0	✅
AI Moderator	§25467218344	✅	40	40	0	✅
Daily Security Red Team Agent	§25467407563	✅	243	243	0	✅
Smoke CI	§25467415098	✅	11	11	0	✅
Issue Monster	§25467624330	✅	39	39	0	✅
AI Moderator	§25467696618	✅	48	48	0	✅
Daily Documentation Healer	§25467911393	❌	0	0	0	🔴
Semantic Function Refactoring	§25467930693	❌	0	0	0	🔴
Daily Observability Report for AWF Firewall and MCP Gateway	§25467949679	❌	0	0	0	🔴

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Super Linter Report	25442628138	2026-05-06T14:48:03Z	§25442628138
Go Pattern Detector	25444290134	2026-05-06T15:18:20Z	§25444290134
Smoke CI	25444553809	2026-05-06T15:23:14Z	§25444553809
Documentation Unbloat	25449195821	2026-05-06T16:56:23Z	§25449195821
Daily Documentation Healer	25467911393	2026-05-06T23:58:36Z	§25467911393
Semantic Function Refactoring	25467930693	2026-05-06T23:59:12Z	§25467930693
Daily Observability Report for AWF Firewall and MCP Gateway	25467949679	2026-05-06T23:59:48Z	§25467949679

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
Package Specification Librarian	§25439207993	rpc-messages.jsonl	6	safeoutputs, serena	1	0	✅
Developer Documentation Consolidator	§25440125451	rpc-messages.jsonl	8	safeoutputs, serena	2	0	✅
Daily Malicious Code Scan Agent	§25440126477	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
AI Moderator	§25440612096	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅
Q	§25441712248	rpc-messages.jsonl	38	agenticworkflows, safeoutputs, serena	16	0	✅
Auto-Triage Issues	§25442093321	rpc-messages.jsonl	0	None	0	0	⚠️
Architecture Guardian	§25443489560	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Daily Fact About gh-aw	§25443512831	rpc-messages.jsonl	2	safeoutputs	0	0	✅
Dead Code Removal Agent	§25443535713	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Daily Sub-Agent Optimizer	§25443535912	rpc-messages.jsonl	8	agenticworkflows, safeoutputs	2	0	✅
Daily Issues Report Generator	§25444166323	rpc-messages.jsonl	0	None	0	0	⚠️
Copilot Token Usage Optimizer	§25444570025	rpc-messages.jsonl	6	safeoutputs	2	0	✅
Design Decision Gate 🏗️	§25444587865	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Matt Pocock Skills Reviewer	§25444587877	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅
Test Quality Sentinel	§25444587838	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Smoke CI	§25444622884	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
DeepReport - Intelligence Gathering Agent	§25444622992	rpc-messages.jsonl	22	agenticworkflows, safeoutputs	9	0	✅
Issue Triage Agent	§25444725822	rpc-messages.jsonl	302	github, safeoutputs	142	0	✅
Smoke Gemini	§25444740279	rpc-messages.jsonl	6	github, mcpscripts, safeoutputs	0	0	✅
Smoke Copilot	§25444740273	rpc-messages.jsonl	96	agenticworkflows, mcpscripts, safeoutputs, serena	44	0	✅
Changeset Generator	§25444740213	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke Claude	§25444740277	rpc-messages.jsonl	92	agenticworkflows, github, mcpscripts, safeoutputs, serena, tavily	40	0	✅
Smoke Pi	§25444740266	rpc-messages.jsonl	0	None	0	0	⚠️
Smoke Codex	§25444740353	rpc-messages.jsonl	32	github, mcpscripts, safeoutputs, serena	12	0	✅
Agent Container Smoke Test	§25444740214	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Delight	§25444845368	rpc-messages.jsonl	6	safeoutputs	2	0	✅
Daily CLI Performance Agent	§25445152041	rpc-messages.jsonl	12	mcpscripts, safeoutputs	4	0	✅
Breaking Change Checker	§25445290305	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Daily Copilot PR Merged Report	§25445933963	rpc-messages.jsonl	138	mcpscripts, safeoutputs	67	0	✅
The Daily Repository Chronicle	§25446408525	rpc-messages.jsonl	8	safeoutputs	3	0	✅
Agent Persona Explorer	§25446762227	rpc-messages.jsonl	10	agenticworkflows, github, safeoutputs	2	0	✅
Daily Security Observability Report	§25447469083	rpc-messages.jsonl	88	agenticworkflows, safeoutputs	42	0	✅
Slide Deck Maintainer	§25448425310	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
GEO Optimizer Daily Audit	§25449098311	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Contribution Check	§25450254117	rpc-messages.jsonl	0	None	0	0	⚠️
AI Moderator	§25450724913	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅
Smoke CI	§25450933657	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Daily Secrets Analysis Agent	§25452470566	rpc-messages.jsonl	4	safeoutputs	1	0	✅
PR Triage Agent	§25454479534	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Copilot Agent PR Analysis	§25454487709	rpc-messages.jsonl	10	github, safeoutputs	3	0	✅
Release	§25454542215	rpc-messages.jsonl	28	github, safeoutputs	12	0	✅
Daily Cache Strategy Analyzer	§25454924987	rpc-messages.jsonl	10	agenticworkflows, safeoutputs	3	0	✅
Daily Code Metrics and Trend Tracking Agent	§25455044957	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅
Auto-Triage Issues	§25455287514	rpc-messages.jsonl	0	None	0	0	⚠️
Daily Safe Output Integrator	§25455592425	rpc-messages.jsonl	4	safeoutputs	1	0	✅
[aw] Failure Investigator (6h)	§25455735783	rpc-messages.jsonl	22	agenticworkflows, safeoutputs	9	0	✅
Daily Grafana OTel Instrumentation Advisor	§25456746932	rpc-messages.jsonl	32	grafana, safeoutputs	14	0	✅
Smoke CI	§25456907436	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Agent Container Smoke Test	§25457749827	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25458052656	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Daily SPDD Spec Planner	§25458416345	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Smoke CI	§25458502142	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25458742264	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Daily Team Evolution Insights	§25459876996	rpc-messages.jsonl	30	github, safeoutputs	12	0	✅
Lockfile Statistics Analysis Agent	§25460000332	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25460357033	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25460505811	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Copilot PR Prompt Pattern Analysis	§25460769779	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25460774756	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Daily Caveman Optimizer	§25460853277	rpc-messages.jsonl	6	safeoutputs	2	0	✅
Daily Project Performance Summary Generator (Using MCP Scripts)	§25461028598	rpc-messages.jsonl	22	mcpscripts, safeoutputs	9	0	✅
Contribution Check	§25461529863	rpc-messages.jsonl	0	None	0	0	⚠️
Agentic Workflow Audit Agent	§25462368704	rpc-messages.jsonl	18	agenticworkflows, github, safeoutputs	6	0	✅
Daily Regulatory Report Generator	§25462477764	rpc-messages.jsonl	14	github, mcpscripts, safeoutputs	4	0	✅
AI Moderator	§25464846427	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅
Issue Monster	§25465519347	rpc-messages.jsonl	14	safeoutputs	6	0	✅
Smoke CI	§25466510314	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25466694060	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Smoke CI	§25466719178	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Issue Monster	§25466757771	rpc-messages.jsonl	14	safeoutputs	6	0	✅
AI Moderator	§25467218344	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅
Daily Security Red Team Agent	§25467407563	rpc-messages.jsonl	4	safeoutputs	1	0	✅
Smoke CI	§25467415098	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅
Issue Monster	§25467624330	rpc-messages.jsonl	14	safeoutputs	6	0	✅
AI Moderator	§25467696618	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

No MCP-enabled runs were missing both telemetry files.

Telemetry Quality Analysis

Firewall Log Quality

• Raw access.log entries analyzed: 18936
• Parsed firewall request summary: 2562 requests; 2154 allowed; 408 blocked (15.9%)
• Domains observed in parsed firewall summaries: 33 unique
• Most accessed domains: api.githubcopilot.com:443 (776), github.com:443 (568), api.anthropic.com:443 (528), localhost:8080 (273), api.openai.com:443 (101)

Gateway Log Quality

• Telemetry source: rpc-messages.jsonl canonical fallback for all MCP-enabled runs in this sample; gateway.jsonl was not present.
• Total JSON-RPC entries analyzed: 1376
• MCP servers used: github, safeoutputs, mcpscripts, agenticworkflows, serena, grafana, tavily
• Total MCP tool calls: 547
• MCP response errors: 0 (0.0%)
• Average response time: N/A from this fallback sample; request/response IDs were absent or not pairable in the captured JSON-RPC messages.

Healthy Runs Summary

157 of 170 analyzed runs had complete required observability for the components they used.

Recommended Actions

1. Investigate the completed firewall-enabled runs missing access.log, prioritizing failed runs because network telemetry is most useful there.
2. Keep treating rpc-messages.jsonl as valid MCP telemetry; no MCP-enabled run in this sample lacked both gateway and JSON-RPC logs.
3. Add or preserve a structured gateway.jsonl artifact where possible so duration and status metrics are available without JSON-RPC pairing.
4. Exclude in-progress runs from critical missing-artifact alerts or mark them pending until artifact upload has completed.

Historical Trends

No previous trend dataset was available in the downloaded artifacts. This report can serve as the baseline for future daily comparisons.

References:

• §25449195821
• §25447469083
• §25467949679

---

Analysis window: Last 7 days requested | Parsed artifact window: 2026-05-06 13:46 UTC to 2026-05-06 23:59 UTC | Runs analyzed: 170

Warning

Firewall blocked 2 domains

The following domains were blocked by the firewall during workflow execution:

• api.github.com
• github.com

💡 Tip: api.github.com is blocked because GitHub API access uses the built-in GitHub tools by default. Instead of adding api.github.com to network.allowed, use tools.github.mode: gh-proxy for direct pre-authenticated GitHub CLI access without requiring network access to api.github.com:

tools:
  github:
    mode: gh-proxy

See GitHub Tools for more information on gh-proxy mode.

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.github.com"
    - "github.com"

See Network Configuration for more information.

Generated by Daily Observability Report for AWF Firewall and MCP Gateway · ◷

• expires on May 8, 2026, 12:12 AM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #30912.