Repository navigation
feat: compare cache reuse and prepare v0.7.0 - #46
Merged
Merged
Conversation
Signed-off-by: Vijay <evijay@gmail.com>
Signed-off-by: Vijay <evijay@gmail.com>
Signed-off-by: Vijay <evijay@gmail.com>
Signed-off-by: Vijay <evijay@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Prepare v0.7.0: compare recorded cache reuse before and after a change, then rank keys, teams or sessions by uncached-input growth.
usage_details=falseopts out. Absent writer paths stay NULL.inspect.Synthetic example:
The detail reads
Cache reads: 1,840 of 2,000 input tokens -> 1,220 of 2,000 (all requests report cache detail).One key adds 620 uncached input tokens. Keyed rankings and bounds compose the existing accounting and sketch implementations.Pinned Writer Evidence
The tests exercise LiteLLM v1.104.0's writer and native logging normalizers with synthetic responses, PostgreSQL, the read-only SQL projection and the importer. All eight supported stored call-type spellings are covered. Messages can normalize absent cache fields to zero; Responses leaves some detail paths absent. The guide records the observed table. These are offline writer/export tests, with no paid provider calls.
Verification
eedaa5a2a0878054e5ac1f069ad87275ac9167f4: race tests, vet, all 20 pinned database/privacy tests (no skips), 1,000 spend-reader fuzz executions and 10,000 diagnose fuzz executions pass with fresh caches.Approved Release Sequence
The maintainer approved merging and publishing v0.7.0 after final-head hosted checks. A signed, signed-off documentation commit dates the changelog and finalizes the cache guide. The existing v0.6.1 release remains unchanged.
After tag workflow checks, independently verify the draft release's artifacts before publication, then run the public-download SQL export -> fresh install -> investigate outsider check. Update site guides to v0.7.0 (trace-check uses the shipped capture without Go), collector recipes to separately verified v0.3.2 images, then the cache-check guide. The release checklist records that order.