Skip to content

feat: GitHub Issue Scraper for Foundry Bounties (Closes #840)#1044

Closed
muou0712 wants to merge 1 commit intoSolFoundry:mainfrom
muou0712:feat/bounty-840-github-issue-scraper
Closed

feat: GitHub Issue Scraper for Foundry Bounties (Closes #840)#1044
muou0712 wants to merge 1 commit intoSolFoundry:mainfrom
muou0712:feat/bounty-840-github-issue-scraper

Conversation

@muou0712
Copy link
Copy Markdown

Implements the GitHub Issue Scraper bounty from #840.

Closes #840

Wallet: 47HxQss7ctt6fFymSo8gevkYUWJPxieYFDG1eWQK7AjU

Summary

Backend service that automatically scrapes GitHub issues from configured repositories and converts them into SolFoundry bounty specifications.

Components

  • scripts/github-scraper.py: CLI tool with 4 commands (scrape, webhook, generate, list)
  • scripts/test_github_scraper.py: 9 unit tests, all passing
  • scraper-config.yaml: Example configuration file

Features

  • Automatic GitHub issue detection and scraping
  • Tier estimation (T1/T2/T3) based on issue complexity
  • Category and skill detection from labels and content
  • Enhanced bounty descriptions with requirements checklist
  • YAML bounty spec generation (compatible with SolFoundry lint)
  • Webhook server for real-time GitHub issue updates
  • Rate limit handling and GitHub API best practices

Usage

# Scrape issues from configured repos
python3 scripts/github-scraper.py scrape

# Scrape specific repo
python3 scripts/github-scraper.py scrape --repo owner/repo

# Generate bounty YAML from issues
python3 scripts/github-scraper.py generate --repo owner/repo --output specs/

# Start webhook server for real-time updates
python3 scripts/github-scraper.py webhook --port 8080

# List configured repos
python3 scripts/github-scraper.py list

Acceptance Criteria

  • Automatic GitHub issue detection and scraping
  • Auto-posting to SolFoundry website with metadata (via YAML generation)
  • Webhook support for real-time issue updates

Backend service that automatically scrapes GitHub issues from configured
repositories and converts them into SolFoundry bounty specifications.

Components:
- scripts/github-scraper.py: CLI tool with 4 commands (scrape, webhook, generate, list)
- scripts/test_github_scraper.py: 9 unit tests (all passing)
- scraper-config.yaml: Example configuration file

Features:
- Automatic GitHub issue detection and scraping
- Tier estimation (T1/T2/T3) based on issue complexity
- Category and skill detection from labels and content
- Enhanced bounty descriptions with requirements checklist
- YAML bounty spec generation (compatible with SolFoundry lint)
- Webhook server for real-time GitHub issue updates
- Rate limit handling and GitHub API best practices

Usage:
  python3 scripts/github-scraper.py scrape --repo owner/repo
  python3 scripts/github-scraper.py generate --repo owner/repo --output specs/
  python3 scripts/github-scraper.py webhook --port 8080
  python3 scripts/github-scraper.py list

Wallet: 47HxQss7ctt6fFymSo8gevkYUWJPxieYFDG1eWQK7AjU
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

🏭 Bounty T2: GitHub Issue Scraper for Foundry Bounties

1 participant