[observability] Observability Coverage Report - 2026-05-08

[github-actions[bot]]

Executive Summary

Analyzed 76 artifact-rich workflow runs downloaded for the last 7 days. The MCP Gateway telemetry path is broadly healthy: 70/70 MCP-enabled runs (100.0%) included either gateway.jsonl or the canonical rpc-messages.jsonl fallback.

Firewall observability needs attention. 70/76 firewall-enabled runs (92.1%) included an extracted Squid access.log; 6 firewall-enabled runs were missing that critical artifact in the downloaded logs. The all-runs fetch hit the bridge timeout twice, so this report is based on the completed partial artifact corpus saved under /tmp/gh-aw/aw-mcp/logs/.

Key Alerts and Anomalies

🔴 Critical Issues:

• Firewall access log missing: Daily Observability Report for AWF Firewall and MCP Gateway run §25528766474 (2026-05-08T00:01:01Z)
• Firewall access log missing: Semantic Function Refactoring run §25528751299 (2026-05-08T00:00:32Z)
• Firewall access log missing: Daily Documentation Healer run §25528717446 (2026-05-07T23:59:33Z)
• Firewall access log missing: Smoke CI run §25521394926 (2026-05-07T20:51:35Z)
• Firewall access log missing: Documentation Unbloat run §25510316635 (2026-05-07T17:01:42Z)
• Firewall access log missing: Go Pattern Detector run §25504975077 (2026-05-07T15:19:45Z)

⚠️ Warnings:

• MCP telemetry file present but empty or incomplete: Contribution Check run §25522374874 using rpc-messages.jsonl
• MCP telemetry file present but empty or incomplete: Auto-Triage Issues run §25516212977 using rpc-messages.jsonl
• MCP telemetry file present but empty or incomplete: Contribution Check run §25511415054 using rpc-messages.jsonl
• MCP telemetry file present but empty or incomplete: Daily Issues Report Generator run §25504870703 using rpc-messages.jsonl

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	76	70	92.1%	⚠️
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	70	70	100.0%	⚠️

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Daily Observability Report for AWF Firewall and MCP Gateway	§25528766474	❌	0	0	0	🔴 Critical
Semantic Function Refactoring	§25528751299	❌	0	0	0	🔴 Critical
Daily Documentation Healer	§25528717446	❌	0	0	0	🔴 Critical
Daily Security Red Team Agent	§25528212583	✅	290	42	0	✅ Healthy
Smoke CI	§25526028165	✅	10	2	0	✅ Healthy
Smoke CI	§25524174688	✅	11	2	0	✅ Healthy
Smoke CI	§25524101173	✅	12	2	0	✅ Healthy
Smoke CI	§25523683128	✅	11	2	0	✅ Healthy
Daily Regulatory Report Generator	§25523248778	✅	286	26	0	✅ Healthy
Agentic Workflow Audit Agent	§25523103999	✅	1493	142	0	✅ Healthy
Contribution Check	§25522374874	✅	221	37	0	✅ Healthy
Daily Project Performance Summary Generator (Using MCP Scripts)	§25521941526	✅	671	42	0	✅ Healthy
Daily Caveman Optimizer	§25521785574	✅	764	39	0	✅ Healthy
Copilot PR Prompt Pattern Analysis	§25521679271	✅	204	17	0	✅ Healthy
Smoke CI	§25521524342	✅	10	2	0	✅ Healthy
Issue Monster	§25521460118	✅	49	7	0	✅ Healthy
Smoke CI	§25521394926	❌	0	0	0	🔴 Critical
Smoke CI	§25521360963	✅	10	2	0	✅ Healthy
Smoke CI	§25520823818	✅	10	2	0	✅ Healthy
Lockfile Statistics Analysis Agent	§25520763761	✅	299	26	0	✅ Healthy
Daily Team Evolution Insights	§25520672323	✅	220	22	0	✅ Healthy
AI Moderator	§25520046866	✅	47	11	0	✅ Healthy
Issue Monster	§25519104147	✅	49	6	0	✅ Healthy
Smoke CI	§25518635407	✅	11	2	0	✅ Healthy
[aw] Failure Investigator (6h)	§25516906282	✅	718	59	0	✅ Healthy
Daily Safe Output Integrator	§25516603709	✅	69	8	0	✅ Healthy
Auto-Triage Issues	§25516212977	✅	108	5	0	✅ Healthy
Release	§25516149401	✅	224	22	0	✅ Healthy
Smoke CI	§25516130559	✅	10	2	0	✅ Healthy
Daily Code Metrics and Trend Tracking Agent	§25515977550	✅	2000	644	0	✅ Healthy
Daily Cache Strategy Analyzer	§25515905982	✅	286	30	2	✅ Healthy
Scout	§25515750847	✅	119	21	0	✅ Healthy
Plan Command	§25515511106	✅	107	10	0	✅ Healthy
Copilot Agent PR Analysis	§25515440811	✅	262	25	0	✅ Healthy
PR Triage Agent	§25515426243	✅	65	9	0	✅ Healthy
Smoke CI	§25514404245	✅	12	2	0	✅ Healthy
Daily Secrets Analysis Agent	§25513557638	✅	111	10	0	✅ Healthy
AI Moderator	§25513518428	✅	50	11	0	✅ Healthy
Q	§25513190408	✅	174	18	0	✅ Healthy
AI Moderator	§25512718015	✅	44	10	0	✅ Healthy
Smoke CI	§25511936798	✅	11	2	0	✅ Healthy
Matt Pocock Skills Reviewer	§25511931212	✅	36	5	0	✅ Healthy
Test Quality Sentinel	§25511931229	✅	64	6	0	✅ Healthy
Design Decision Gate 🏗️	§25511931259	✅	37	11	0	✅ Healthy
Contribution Check	§25511415054	✅	165	27	0	✅ Healthy
Documentation Unbloat	§25510316635	❌	0	0	0	🔴 Critical
GEO Optimizer Daily Audit	§25510221783	✅	124	13	0	✅ Healthy
AI Moderator	§25509907591	✅	34	9	0	✅ Healthy
AI Moderator	§25509841134	✅	38	10	0	✅ Healthy
Slide Deck Maintainer	§25509536869	✅	196	35	0	✅ Healthy
Daily SPDD Spec Planner	§25508539487	✅	176	16	0	✅ Healthy
Daily Security Observability Report	§25508525029	✅	1468	81	0	✅ Healthy
Smoke CI	§25508172125	✅	10	2	0	✅ Healthy
Matt Pocock Skills Reviewer	§25507834501	✅	235	25	0	✅ Healthy
Test Quality Sentinel	§25507834502	✅	205	19	0	✅ Healthy
Design Decision Gate 🏗️	§25507834511	✅	36	11	0	✅ Healthy
Agent Persona Explorer	§25507644807	✅	187	31	0	✅ Healthy
The Daily Repository Chronicle	§25507231626	✅	1137	57	0	✅ Healthy
Daily Copilot PR Merged Report	§25506712299	✅	282	25	0	✅ Healthy
Breaking Change Checker	§25506023748	✅	98	14	0	✅ Healthy
Daily CLI Performance Agent	§25505901943	✅	238	26	0	✅ Healthy
AI Moderator	§25505838374	✅	31	9	0	✅ Healthy
Delight	§25505510720	✅	370	34	0	✅ Healthy
AI Moderator	§25505509676	✅	30	9	0	✅ Healthy
Issue Triage Agent	§25505386877	✅	102	12	0	✅ Healthy
AI Moderator	§25505346606	✅	43	10	0	✅ Healthy
DeepReport - Intelligence Gathering Agent	§25505251838	✅	546	54	0	✅ Healthy
Copilot Token Usage Optimizer	§25505231992	✅	312	28	0	✅ Healthy
Go Pattern Detector	§25504975077	❌	0	0	0	🔴 Critical
Daily Issues Report Generator	§25504870703	✅	15	2	0	✅ Healthy
Daily Sub-Agent Optimizer	§25504179816	✅	595	52	0	✅ Healthy
Dead Code Removal Agent	§25504175612	✅	317	42	0	✅ Healthy
Daily Fact About gh-aw	§25504135437	✅	15	2	0	✅ Healthy
Architecture Guardian	§25504113526	✅	28	5	0	✅ Healthy
AI Moderator	§25504004585	✅	41	10	0	✅ Healthy
AI Moderator	§25503565148	✅	48	11	0	✅ Healthy

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Daily Observability Report for AWF Firewall and MCP Gateway	25528766474	2026-05-08T00:01:01Z	§25528766474
Semantic Function Refactoring	25528751299	2026-05-08T00:00:32Z	§25528751299
Daily Documentation Healer	25528717446	2026-05-07T23:59:33Z	§25528717446
Smoke CI	25521394926	2026-05-07T20:51:35Z	§25521394926
Documentation Unbloat	25510316635	2026-05-07T17:01:42Z	§25510316635
Go Pattern Detector	25504975077	2026-05-07T15:19:45Z	§25504975077

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
Daily Security Red Team Agent	§25528212583	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Smoke CI	§25526028165	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Smoke CI	§25524174688	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Smoke CI	§25524101173	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Smoke CI	§25523683128	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Daily Regulatory Report Generator	§25523248778	rpc-messages.jsonl	22	github, mcpscripts, safeoutputs	8	0	✅ Healthy
Agentic Workflow Audit Agent	§25523103999	rpc-messages.jsonl	46	agenticworkflows, github, safeoutputs	20	0	✅ Healthy
Contribution Check	§25522374874	rpc-messages.jsonl	0	None detected	0	0	⚠️ Warning
Daily Project Performance Summary Generator (Using MCP Scripts)	§25521941526	rpc-messages.jsonl	32	mcpscripts, safeoutputs	14	0	✅ Healthy
Daily Caveman Optimizer	§25521785574	rpc-messages.jsonl	6	safeoutputs	2	0	✅ Healthy
Copilot PR Prompt Pattern Analysis	§25521679271	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Smoke CI	§25521524342	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Issue Monster	§25521460118	rpc-messages.jsonl	14	safeoutputs	6	0	✅ Healthy
Smoke CI	§25521360963	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Smoke CI	§25520823818	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Lockfile Statistics Analysis Agent	§25520763761	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Daily Team Evolution Insights	§25520672323	rpc-messages.jsonl	55	github, safeoutputs	20	0	✅ Healthy
AI Moderator	§25520046866	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Issue Monster	§25519104147	rpc-messages.jsonl	14	safeoutputs	6	0	✅ Healthy
Smoke CI	§25518635407	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
[aw] Failure Investigator (6h)	§25516906282	rpc-messages.jsonl	26	agenticworkflows, safeoutputs	11	0	✅ Healthy
Daily Safe Output Integrator	§25516603709	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Auto-Triage Issues	§25516212977	rpc-messages.jsonl	0	None detected	0	0	⚠️ Warning
Release	§25516149401	rpc-messages.jsonl	87	github, safeoutputs	40	0	✅ Healthy
Smoke CI	§25516130559	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Daily Code Metrics and Trend Tracking Agent	§25515977550	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅ Healthy
Daily Cache Strategy Analyzer	§25515905982	rpc-messages.jsonl	12	agenticworkflows, safeoutputs	4	0	✅ Healthy
Scout	§25515750847	rpc-messages.jsonl	30	arxiv, markitdown, microsoftdocs, safeoutputs	10	0	✅ Healthy
Plan Command	§25515511106	rpc-messages.jsonl	14	safeoutputs	6	0	✅ Healthy
Copilot Agent PR Analysis	§25515440811	rpc-messages.jsonl	10	github, safeoutputs	3	0	✅ Healthy
PR Triage Agent	§25515426243	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Smoke CI	§25514404245	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Daily Secrets Analysis Agent	§25513557638	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
AI Moderator	§25513518428	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Q	§25513190408	rpc-messages.jsonl	14	agenticworkflows, safeoutputs, serena	4	0	✅ Healthy
AI Moderator	§25512718015	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅ Healthy
Smoke CI	§25511936798	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Matt Pocock Skills Reviewer	§25511931212	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Test Quality Sentinel	§25511931229	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Design Decision Gate 🏗️	§25511931259	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Contribution Check	§25511415054	rpc-messages.jsonl	0	None detected	0	0	⚠️ Warning
GEO Optimizer Daily Audit	§25510221783	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
AI Moderator	§25509907591	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
AI Moderator	§25509841134	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Slide Deck Maintainer	§25509536869	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Daily SPDD Spec Planner	§25508539487	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Daily Security Observability Report	§25508525029	rpc-messages.jsonl	64	agenticworkflows, safeoutputs	30	0	✅ Healthy
Smoke CI	§25508172125	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
Matt Pocock Skills Reviewer	§25507834501	rpc-messages.jsonl	36	github, safeoutputs	16	0	✅ Healthy
Test Quality Sentinel	§25507834502	rpc-messages.jsonl	6	safeoutputs	2	0	✅ Healthy
Design Decision Gate 🏗️	§25507834511	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Agent Persona Explorer	§25507644807	rpc-messages.jsonl	8	agenticworkflows, github, safeoutputs	1	0	✅ Healthy
The Daily Repository Chronicle	§25507231626	rpc-messages.jsonl	8	safeoutputs	3	0	✅ Healthy
Daily Copilot PR Merged Report	§25506712299	rpc-messages.jsonl	170	mcpscripts, safeoutputs	83	0	✅ Healthy
Breaking Change Checker	§25506023748	rpc-messages.jsonl	4	safeoutputs	1	0	✅ Healthy
Daily CLI Performance Agent	§25505901943	rpc-messages.jsonl	6	mcpscripts, safeoutputs	1	0	✅ Healthy
AI Moderator	§25505838374	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Delight	§25505510720	rpc-messages.jsonl	12	safeoutputs	5	0	✅ Healthy
AI Moderator	§25505509676	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy
Issue Triage Agent	§25505386877	rpc-messages.jsonl	298	github, safeoutputs	139	0	✅ Healthy
AI Moderator	§25505346606	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅ Healthy
DeepReport - Intelligence Gathering Agent	§25505251838	rpc-messages.jsonl	24	agenticworkflows, safeoutputs	10	0	✅ Healthy
Copilot Token Usage Optimizer	§25505231992	rpc-messages.jsonl	6	safeoutputs	2	0	✅ Healthy
Daily Issues Report Generator	§25504870703	rpc-messages.jsonl	0	None detected	0	0	⚠️ Warning
Daily Sub-Agent Optimizer	§25504179816	rpc-messages.jsonl	8	agenticworkflows, safeoutputs	2	0	✅ Healthy
Dead Code Removal Agent	§25504175612	rpc-messages.jsonl	6	safeoutputs	2	0	✅ Healthy
Daily Fact About gh-aw	§25504135437	rpc-messages.jsonl	2	safeoutputs	0	0	✅ Healthy
Architecture Guardian	§25504113526	rpc-messages.jsonl	6	github, safeoutputs	1	0	✅ Healthy
AI Moderator	§25504004585	rpc-messages.jsonl	18	github, safeoutputs	7	0	✅ Healthy
AI Moderator	§25503565148	rpc-messages.jsonl	12	github, safeoutputs	4	0	✅ Healthy

Missing MCP Telemetry

Workflow	Run ID	Date	Link
None	-	-	-

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 16307
• Request counts from parsed summaries: 2024 allowed, 2 blocked
• Blocked request rate: 0.10%
• Most accessed domains: api.githubcopilot.com:443 (675), github.com:443 (584), api.anthropic.com:443 (569), api.openai.com:443 (88), proxy.golang.org:443 (17)

Gateway Log Quality

• Telemetry source observed: rpc-messages.jsonl canonical fallback; no gateway.jsonl files were present in this corpus
• Total MCP telemetry entries analyzed: 1340
• Total MCP tool calls: 536
• MCP errors recorded: 0
• Average response time: N/A from this report because the observed fallback telemetry did not expose paired duration fields reliably
• MCP servers used: safeoutputs (66 runs), github (36 runs), agenticworkflows (8 runs), mcpscripts (4 runs), arxiv (1 runs), markitdown (1 runs), microsoftdocs (1 runs), tavily (1 runs)

Healthy Runs Summary

• Runs with complete required observability for enabled components: 66/76
• Agent stdio logs present: 70 runs
• Agent output artifacts present: 72 runs
• Safe output artifacts present: 67 runs

Recommended Actions

1. Investigate the six firewall-enabled runs missing extracted access.log artifacts and confirm whether upload, artifact selection, or post-run extraction skipped the Squid logs.
2. Keep treating rpc-messages.jsonl as valid MCP telemetry, but add a quality check for empty files so warnings surface before debugging data is needed.
3. Tune the observability report fetch path to avoid the 120-second bridge timeout, likely by paginating or requesting only metadata plus firewall/MCP artifacts in smaller batches.

📊 Historical Trends

Historical comparison data was not present in the downloaded artifact corpus for this run. Store daily coverage percentages as a small JSON artifact to make week-over-week trend reporting deterministic.

Context: Analysis window: last 7 days | Runs analyzed: 76 | Generated: 2026-05-08

References: §25528766474, §25528751299, §25528717446

Warning

Firewall blocked 2 domains

The following domains were blocked by the firewall during workflow execution:

• api.github.com
• github.com

💡 Tip: api.github.com is blocked because GitHub API access uses the built-in GitHub tools by default. Instead of adding api.github.com to network.allowed, use tools.github.mode: gh-proxy for direct pre-authenticated GitHub CLI access without requiring network access to api.github.com:

tools:
  github:
    mode: gh-proxy

See GitHub Tools for more information on gh-proxy mode.

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.github.com"
    - "github.com"

See Network Configuration for more information.

Generated by Daily Observability Report for AWF Firewall and MCP Gateway · ◷

• expires on May 9, 2026, 12:12 AM UTC