Skip to content

feat: context window management — sliding window with auto-summarization#69

Open
DorianZheng wants to merge 14 commits intomainfrom
feature/context-window-management
Open

feat: context window management — sliding window with auto-summarization#69
DorianZheng wants to merge 14 commits intomainfrom
feature/context-window-management

Conversation

@DorianZheng
Copy link
Copy Markdown
Member

@DorianZheng DorianZheng commented Apr 25, 2026

Implements context window management per design. Monitors token utilization via rate_limit_event, compresses old messages at 80% threshold using Haiku, emits context_compressed event.

- Track context utilization from rate_limit_event SDK messages
- Compress conversation history when utilization >= 80%
- Use claude-haiku-4-5-20251001 for fast summarization
- Clear session ID after compression so Claude starts fresh
- Emit context_compressed event for UI indicator
- Add ContextCompressor class with unit tests
@DorianZheng DorianZheng force-pushed the feature/context-window-management branch from 9c4fa68 to bb8df11 Compare April 25, 2026 02:52
@DorianZheng DorianZheng force-pushed the feature/context-window-management branch from bb8df11 to 098a043 Compare April 25, 2026 02:52
@DorianZheng DorianZheng changed the title feat: context window management with auto-summarization feat: context window management — sliding window with auto-summarization Apr 25, 2026
@DorianZheng DorianZheng force-pushed the feature/context-window-management branch from 5d52ba3 to ea9efaa Compare April 25, 2026 05:09
…\n\n- Track context utilization from rate_limit_event (SDK provides 0.0-1.0)\n- At 80% utilization, compress oldest messages using claude-haiku-4-5-20251001\n- Keep most recent 20% verbatim; clear session ID for fresh context\n- Emit context_compressed event for Dune UI indicator\n- New ContextCompressor class with needsCompression() + compress()\n- Add setContextUtilization/getContextUtilization to AgentDb\n- Tests: needsCompression thresholds, compress() counts, Haiku format\n\nCloses work item: item-X6hOH_DrQ4NH3m7Jpcg2W
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant