Skip to content

Conversation

@bsbodden
Copy link
Collaborator

@bsbodden bsbodden commented Jan 2, 2026

Adds a script and Makefile task to detect breaking changes between two versions of the codebase by:

  • Analyzing git diff to find file renames, deleted files, and code changes
  • Running old tests against new code with iterative LLM-powered patching
  • Generating specific, actionable migration guides with exact code examples
  • Add public API export analysis (compares init.py exports between versions)
  • Add GitHub release notes fetching and LLM-based extraction
  • Implement patch cycle prevention via hash tracking
  • Improve error parsing with better context extraction
  • Generate comprehensive migration reports with:
    • Documented breaking changes from release notes
    • Required code changes from test analysis
    • Automated migration commands
    • Detailed analysis combining all sources

Usage:
make breaking-changes OLD_TAG=v0.12.0 NEW_TAG=v0.13.0

Requires OPENAI_API_KEY environment variable.

Adds a script and Makefile task to detect breaking changes between
two versions of the codebase by:
- Analyzing git diff to find file renames, deleted files, and code changes
- Running old tests against new code with iterative LLM-powered patching
- Generating specific, actionable migration guides with exact code examples
- Add public API export analysis (compares __init__.py exports between versions)
- Add GitHub release notes fetching and LLM-based extraction
- Implement patch cycle prevention via hash tracking
- Improve error parsing with better context extraction
- Generate comprehensive migration reports with:
  - Documented breaking changes from release notes
  - Required code changes from test analysis
  - Automated migration commands
  - Detailed analysis combining all sources

Usage:
  make breaking-changes OLD_TAG=v0.12.0 NEW_TAG=v0.13.0

Requires OPENAI_API_KEY environment variable.
@bsbodden bsbodden requested review from Copilot and tylerhutcherson and removed request for Copilot January 2, 2026 19:34
@bsbodden bsbodden requested a review from rbs333 January 2, 2026 19:45
@abrookins
Copy link
Collaborator

Looks very cool! At ~1k lines, does it warrant tests?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants