Repository navigation
Add Kodexis Reddit API provider as fallback with exam/cert filter - #22
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds Kodexis Reddit API provider as a fallback when REDDIT_INGESTION_ENABLED=false. The Kodexis API fetches the latest posts (using sort=new filter) from configured subreddits, with built-in filtering to exclude exam/certification passed posts while preserving voucher-related terms like free exam and exam voucher.
Also removes the deprecated mcsa subreddit from the catalog.
Type of Change
Affected Components
Testing
Migration
Policy Checklist
If checked, confirm all of the following:
Explanation:
The Kodexis API is a third-party Reddit data provider that respects Reddits API terms. When REDDIT_INGESTION_ENABLED=false, the system now uses Kodexis (if API key configured) as a more reliable alternative to RSS feeds, with RSS as the final fallback. The exam/certification + pass filter reduces noise from self-promotional I passed! posts while preserving voucher signals.
Additional Notes
Files Added
Files Modified
Fallback Chain
Exam/Certification + Pass Filter
Blocks posts containing standalone exam or certification + pass/passed/passing, with exclusions for:
This preserves voucher signals while filtering out I passed my exam! self-reports.