[observability] Observability Coverage Report - 2026-03-17

[github-actions[bot]]

Executive Summary

Observability coverage was analyzed for the requested 7-day window using downloaded run artifacts. The available dataset in this window contained 37 agentic runs (all firewall-enabled), with 29 runs containing MCP artifacts.

Firewall observability is below target: access.log coverage is 78.38% (29/37). MCP telemetry coverage is healthy: 100% (29/29 MCP-enabled runs) had telemetry via rpc-messages.jsonl (canonical fallback). No MCP-enabled run was missing both gateway.jsonl and rpc-messages.jsonl.

Key Alerts and Anomalies

🔴 Critical Issues:

• 8 firewall-enabled runs are missing sandbox/firewall/logs/access.log.
• This creates a direct debugging blind spot for network egress incidents in those runs.

⚠️ Warnings:

• No MCP telemetry absence warnings.
• gateway.jsonl was not present in analyzed runs; telemetry relied on rpc-messages.jsonl.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	37 (firewall_enabled_workflows)	29	78.38%	🔴
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	29 (mcp_enabled_workflows)	29	100.00%	✅

📋 Detailed Run Analysis

Firewall-Enabled Runs (By Workflow)

Workflow	Runs	access.log Present	Missing	access.log Entries
AI Moderator	2	2	0	25
Agent Container Smoke Test	7	5	2	49
Auto-Triage Issues	2	2	0	23
Changeset Generator	7	5	2	235
Contribution Check	1	1	0	12
Copilot PR Prompt Pattern Analysis	1	1	0	47
Daily Documentation Updater	1	1	0	13
Daily Observability Report for AWF Firewall and MCP Gateway	1	0	1	0
Documentation Noob Tester	1	0	1	0
Duplicate Code Detector	1	1	0	27
GitHub Remote MCP Authentication Test	1	1	0	59
Go Fan	1	1	0	12
Multi-Device Docs Tester	1	1	0	72
Scout	1	1	0	18
Smoke Codex	7	5	2	83
Workflow Health Manager - Meta-Orchestrator	1	1	0	43
jsweep - JavaScript Unbloater	1	1	0	62

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Agent Container Smoke Test	23176727939	2026-03-17	§23176727939
Changeset Generator	23176727951	2026-03-17	§23176727951
Smoke Codex	23176727955	2026-03-17	§23176727955
Changeset Generator	23177074336	2026-03-17	§23177074336
Smoke Codex	23177074351	2026-03-17	§23177074351
Agent Container Smoke Test	23177074391	2026-03-17	§23177074391
Daily Observability Report for AWF Firewall and MCP Gateway	23183855172	2026-03-17	§23183855172
Documentation Noob Tester	23184025926	2026-03-17	§23184025926

MCP-Enabled Runs (By Workflow)

Workflow	Runs	Telemetry OK	Source	Tool Calls	Status
AI Moderator	2	2	rpc-messages.jsonl	25	✅
Agent Container Smoke Test	5	5	rpc-messages.jsonl	5	✅
Auto-Triage Issues	2	2	rpc-messages.jsonl	84	✅
Changeset Generator	5	5	rpc-messages.jsonl	5	✅
Contribution Check	1	1	rpc-messages.jsonl	3	✅
Copilot PR Prompt Pattern Analysis	1	1	rpc-messages.jsonl	7	✅
Daily Documentation Updater	1	1	rpc-messages.jsonl	7	✅
Duplicate Code Detector	1	1	rpc-messages.jsonl	33	✅
GitHub Remote MCP Authentication Test	1	1	rpc-messages.jsonl	2	✅
Go Fan	1	1	rpc-messages.jsonl	13	✅
Multi-Device Docs Tester	1	1	rpc-messages.jsonl	9	✅
Scout	1	1	rpc-messages.jsonl	9	✅
Smoke Codex	5	5	rpc-messages.jsonl	35	✅
Workflow Health Manager - Meta-Orchestrator	1	1	rpc-messages.jsonl	34	✅
jsweep - JavaScript Unbloater	1	1	rpc-messages.jsonl	1	✅

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

No missing MCP telemetry runs detected.

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 780
• Domains accessed: 11 unique
• Blocked requests: 89 (11.41%)
• Most accessed domains: api.githubcopilot.com:443, api.openai.com:443, api.anthropic.com:443

Gateway Log Quality

• Telemetry source: rpc-messages.jsonl (canonical fallback) in all MCP-enabled runs
• gateway.jsonl presence: 0 runs in analyzed dataset
• Total MCP request/tool-call volume observed: 272
• MCP servers observed: safeoutputs, github, playwright, serena, web-fetch
• MCP failure count: 0
• Average response time: N/A from available summarized RPC metadata

Healthy Runs Summary

• Firewall healthy runs: 29/37
• MCP telemetry healthy runs: 29/29
• Runs with complete firewall+MCP observability (where MCP was enabled): 21

Recommended Actions

1. Add a required post-run check that fails firewall-enabled workflows when sandbox/firewall/logs/access.log is absent.
2. Add artifact-presence assertions in conclusion/safe-output steps so observability gaps are surfaced before workflow completion.
3. Enable structured gateway.jsonl alongside RPC logs where supported to improve response-time and field-level analysis.

📊 Historical Trends

• Available analyzed runs in this window were timestamped between 2026-03-17T02:29:40Z and 2026-03-17T07:53:53Z.
• Extend trend reporting once multi-day run slices are present in the queried 7-day window.

References:

• §23183855172
• §23182991466
• §23177074336

AI generated by Daily Observability Report for AWF Firewall and MCP Gateway · history

• expires on Mar 18, 2026, 8:09 AM UTC