Skip to content

Move Reddit subreddits: Tier A→C (240min), Tier B→D (720min) - #23

Merged
Devathmaj merged 2 commits into
mainfrom
chore/update-scraper-schedule
Sep 23, 2026
Merged

Devathmaj merged 2 commits into
mainfrom
chore/update-scraper-schedule

Conversation

@Devathmaj

@Devathmaj Devathmaj commented Sep 23, 2026 •

Copy link
Copy Markdown
Owner

Description

Moves Reddit subreddit polling tiers to reduce API load and align with signal quality:

  • Tier A → Tier C: 15min → 240min (4h) - High-value coupon subs (AWSCertifications, AzureCertification, Udemy, FreeUdemyCoupons)
  • Tier B → Tier D: 60min → 720min (12h) - All other certification subs

This reduces Reddit API/RSS requests by ~90% while maintaining coverage of high-signal sources.

Type of Change

  • Configuration / settings change
  • Documentation update

Affected Components

  • Scheduler / Dispatcher
  • Reddit Integration

Testing

  • Ran pytest — all tests pass (418 passed, 15 skipped)
  • Ran
    uff check . && ruff format . — no lint errors
  • Updated tier assertions in ests/test_bootstrap.py

Migration

  • This PR includes an Alembic migration (not applicable)

Additional Notes

Files Modified

  • �oucherbot/database/bootstrap.py — Tier logic: _reddit_tier() now returns C/D instead of A/B, cadence minutes updated
  • sources/Subreddit.txt — Documentation updated with new tier labels
  • sources/source.md — Updated reference to Tier C/D
  • ests/test_bootstrap.py — Updated test assertions for new tier assignments

Cadence Changes

Subreddit Old Tier New Tier Old Interval New Interval
AWSCertifications A C 15 min 240 min
AzureCertification A C 15 min 240 min
Udemy A C 15 min 240 min
FreeUdemyCoupons A C 15 min 240 min
O365Certification B D 60 min 720 min
CompTIA B D 60 min 720 min
(all others) B D 60 min 720 min

Summary by CodeRabbit

  • Changes
    • Reddit sources are now checked less frequently: selected subreddits every 4 hours and other subreddits every 12 hours, instead of every 15 minutes and 1 hour.
  • Documentation
    • Source information now describes using the Kodexis API key as a fallback when OAuth is disabled.

@coderabbitai

coderabbitai Bot commented Sep 23, 2026

Copy link
Copy Markdown

Review in Change Stack →

Navigate logical layers of code changes, visualize relationships, and explore their blast radius.

Note

Currently processing new changes in this PR. This may take a few minutes, please wait...

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: 8181f623-3259-4054-a12b-da3efd258694

📥 Commits

Reviewing files that changed from the base of the PR and between 8b5bc82 and b816006.

📒 Files selected for processing (4)
  • Sources/Subreddit.txt
  • Sources/source.md
  • tests/test_bootstrap.py
  • voucherbot/database/bootstrap.py
 _______________________________________________
< Finding your faults 10 times faster than Mom. >
 -----------------------------------------------
  \
   \   (\__/)
       (•ㅅ•)
       /   づ
✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@Devathmaj
Devathmaj merged commit ab4dc19 into main Sep 23, 2026
8 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant