feat: ingest GitHub issue comments in RAG pipeline#11
feat: ingest GitHub issue comments in RAG pipeline#11Sayan4496 wants to merge 1 commit intokubeflow:mainfrom
Conversation
Signed-off-by: Sayan Deyashi <deyashisayan2@gmail.com>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
is this similar to #8? |
|
Good question. This PR restructures comment ingestion into a separate pipeline component (download_github_issue_comments) to improve modularity and allow configurable comment enrichment as an independent stage in the RAG pipeline. The goal is to separate concerns: Issue retrieval Comment enrichment Chunking & embedding Happy to adjust this as a refactor of the existing component if that direction is preferred. |
Summary
Adds a new KFP component to ingest GitHub Issue comments and append them to issue content for indexing.
Changes
download_github_issue_commentsTesting
python -m py_compile pipelines/kubeflow-pipeline.py-Fixes Feat: Ingest GitHub Issue Comments into RAG pipeline #9