feat(utils): add cache-aware chat history compression and compaction - #1303
Open
gugu8intel-i9 wants to merge 2 commits into
Open
feat(utils): add cache-aware chat history compression and compaction#1303gugu8intel-i9 wants to merge 2 commits into
gugu8intel-i9 wants to merge 2 commits into
Conversation
Refactor comments and documentation in chat-compression.ts for clarity.
Refactor chat compression utility with improved type annotations and documentation. Update compression logic to enhance clarity and maintainability.
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
Contributor
|
The instinct here is good — cache-aware compaction that avoids invalidating a hot prefix (via But as submitted this isn't reviewable as a port candidate:
To make this portable: confirm the import, wire it into an actual call site (even a small one), add unit tests for the boundary/threshold logic, and drop the placeholder comment. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add src/utils/chat-compression.ts for context window compaction and history pruning. When conversations approach the limits of a model's token budget, this utility replaces a contiguous middle slice of message history with a structured synthetic summary, preserving critical conversational invariants.