Skip to content

docs(audit): full 2026-07-15 codebase audit report#9641

Open
MarkusNeusinger wants to merge 3 commits into
mainfrom
claude/codebase-audit-optimization-27jz22
Open

docs(audit): full 2026-07-15 codebase audit report#9641
MarkusNeusinger wants to merge 3 commits into
mainfrom
claude/codebase-audit-optimization-27jz22

Conversation

@MarkusNeusinger

Copy link
Copy Markdown
Owner

Summary

Adds the persisted output of a full /audit run (16 specialist auditors + domain-routed adversarial cross-validation) under agentic/audits/2026-07-15-all.md and updates latest.md. This is audit-harness output — no source code changes.

Health Score 30/100 (formula floor — breadth-dominated, not a "broken repo"). The weak pillar is Correctness (C, 60); every other dimension is A-/B+.

Dimension Grade C/H/M
Security A- (89) 0/1/8
Speed A (93) 0/1/4
Looks A (90) 0/2/4
Modern A (91) 0/2/3
Correctness C (60) 1/7/9
Maintainability B+ (80) 0/1/17

Headline findings

  • Critical (live incident): self-amplifying heatmap-calendar generation retry loop ([heatmap-calendar] Basic Calendar Heatmap #1010) — ~1,200 Actions runs / 38h; the comment-counting attempt cap fails open under rate limiting.
  • High: pipeline/config drift against the 15-library reality (spec-create.yml quoted heredocs, impl-merge.yml stale 11-lib auto-close, evaluate-plot.py looks for plot.png vs emitted plot-{THEME}.png); dark-mode white-surface leaks (MUI Paper/Menu + overlay buttons); unauthenticated prompt-injection into write-privileged Claude agents; 97 reviewer-REJECTED implementations live on main.
  • Open-issue triage: 47 open issues categorized with a recommended top-10 work queue.

Coverage note

gcloud, Plausible, and PageSpeed-lab auditors ran degraded (no credentials / anonymous quota exhausted) in this environment — live GCP/analytics/lab-CWV posture is unverified this run and those grades reflect code-side evidence only.

Statistics

109 findings (1 critical, 14 high, 45 medium, 35 low, 14 positive). Cross-validation: 18 reviewed, 0 dropped, 1 downgraded. Baseline clean (ruff 0 issues, format OK).

🤖 Generated with Claude Code

https://claude.ai/code/session_014fhNUHgWcnq9EbJiJu3rD2


Generated by Claude Code

Full 16-auditor /audit run with domain-routed cross-validation.
109 findings (1 critical, 14 high, 45 medium); Health Score 30/100
with correctness (C, 60) as the weak pillar, all other dimensions A-/B+.

Headline items: live heatmap-calendar retry loop (#1010), pipeline/config
drift against the 15-library reality, dark-mode white-surface leaks, and
97 reviewer-rejected implementations live on main. Includes an open-issue
triage with a recommended work queue.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014fhNUHgWcnq9EbJiJu3rD2
Copilot AI review requested due to automatic review settings July 15, 2026 11:10

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the audit documentation set by adding the full persisted output of the 2026-07-15 /audit run and updating agentic/audits/latest.md to reflect that latest report.

Changes:

  • Added the full 2026-07-15 audit report (agentic/audits/2026-07-15-all.md).
  • Updated agentic/audits/latest.md to the 2026-07-15 audit content.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.

File Description
agentic/audits/latest.md Updates the “latest” audit report to the 2026-07-15 full-scope run output.
agentic/audits/2026-07-15-all.md Adds the full persisted audit report for 2026-07-15.

Comment thread agentic/audits/latest.md Outdated
Comment thread agentic/audits/2026-07-15-all.md Outdated
Comment thread agentic/audits/latest.md Outdated
Comment thread agentic/audits/2026-07-15-all.md Outdated
Address Copilot review on #9641:
- Fix header auditor breakdown to match the Coverage line (16 ran,
  14 returned findings, 4 degraded: gcloud/plausible/pagespeed blocked,
  seo structural-only).
- Add the audit-report entry under CHANGELOG [Unreleased] > Added.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014fhNUHgWcnq9EbJiJu3rD2
Copilot AI review requested due to automatic review settings July 15, 2026 11:16

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

Comment thread CHANGELOG.md Outdated
Separate the (#9641) PR reference from the "work queue" sentence per
Copilot review on #9641.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014fhNUHgWcnq9EbJiJu3rD2
Copilot AI review requested due to automatic review settings July 15, 2026 11:19

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants