Repository navigation
study: denser KLL/DDSketch grid and Hydra W 65536; §6.3 rerun - #213
Merged
Merged
Conversation
…sketches/--configs to add configs to an existing study Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01FhcWJExZcmVqS6r6rEtjis
…B do not fit) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
zzylol
force-pushed
the
eval/dense-grid
branch
from
October 14, 2026 01:52
65d8fc2 to
fad4bff
Compare
…, Hydra W 65536) Inputs: the new configs' curves appended to autosketch-vs-asap-inputs (raw records in raw/dense_*), 7 cost rows (63 in all), and 999 Hydra runs at W = 65536 (7,778 in all). Results: the 12 workloads at 95% (with plans) and at 90% and 99%, on #210's tables. CPU cost falls 0-1.4%, Fargate cost up to 13% (smaller KLL/DDSketch nearer the target). 90% still equals 95%. Hydra is never chosen, even at W = 65536. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
zzylol
marked this pull request as ready for review
October 14, 2026 02:19
…ce and claims - filtered_configs()/check_filters(): --sketches or --configs skips the exact rows; a misspelled name exits; tests for both. - The wide-merge comment says per fold, with operands 4x larger. - rqe-optimizer README: the -hydra row's 2026-10-14 rerun, the one solver-tolerance violation, e2e-rate10 planned on the pre-#213 grid. - -hydra README: rerun provenance moved to Reproduce; hydra-kll's figure marked unmerged, with the all-merge-counts value. - raw README: measurement dates, clnode130. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…comparability; rewrap Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
milindsrivastava1997
added a commit
that referenced
this pull request
Oct 14, 2026
…ry (#217) Regenerates rqe-optimizer/results/e2e-rate10 (classic, all, multigroup at shared = 1, 10 samples/s) on main: the denser grid's cost table and curves (#213), instant RQEs reading one scrape (#215), and one RQE per schema query (#216). Tables, --runs 3 results and --runs 1 plans; the README gives the RQE counts, costs, classic deployments and ASAPQuery's --data-ingestion-interval-ms 100. Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Denser config grid, measured for the new configs only, and the §6.3 rerun on it, on #210's workload (42 / 62 / 104 RQEs).
Code (
study_saturation.py)k∈ {25, 50, 100, 200, 400, 800} (was 50/200/800). DDSketch α adds 0.1.HYDRA_MAX_W): its grid at 65536 is about 20 GB, and its error has already saturated.--sketches/--configsmeasure only new configs, so they can be appended to an existing study (merge_study_parts.pyrefuses duplicate points).lg_k12/14/16, the precisions asap_sketchlib builds.Inputs (new configs only, appended)
autosketch-vs-asap-inputs/saturation/. Raw records are inraw/dense_*.Results: the 12 workloads at 95% (results, figures, plans) and at 90% and 99%, on clnode109/155/167/178. 0 RQEs dropped. One sanity check fails by solver tolerance: all-shared8 at 99%, Fargate frontier, 0.01% (see the targets README).
lg_k=12, and DDSketch α = 0.1 (0.048 error) meets both targets.🤖 Generated with Claude Code