feat(gre): observed Performance on the dashboard (pin bump + docs) - #54
Merged
Merged
Conversation
…oard Bumps the anki submodule pin to f15cubing/anki@b7cf7c2 (observed Performance on the GRE dashboard) and updates the codebase docs in the same change: - qt.md: new "Observed Performance" section (Exam Mode attempts side-file -> pooled Wilson range via CalibrationStrip), updated dashboard_data/ScoreSlot/ mediasrv notes, tests count 11->20, footer SHA bump; scoring-adapter honesty note clarified (synced card Performance still not_available -> follow-up) - models/performance.md: "Live surface" section (observed accuracy vs the calibrated, eval-only logistic+Platt model) - INDEX.md: dashboard row bumped + observed_performance code paths - STATUS.md: in-flight entry Pairs with f15cubing/anki#3. Read-only; three scores stay separate.
f15cubing
force-pushed
the
agent/gre-dashboard-performance
branch
from
July 5, 2026 18:40
7683740 to
46e3f3f
Compare
2 tasks
f15cubing
added a commit
that referenced
this pull request
Jul 5, 2026
…c demo items (#58) * docs(demo): refresh the demo plan to cover every merged feature + all spec demo items The Sunday-cut demo plan had drifted behind main. Made it a comprehensive superset (marked the spec-required 3-5 min core with a star; the rest is optional showcase): - Added the missing SPEC-REQUIRED "review session" scene (basic + interactive MCQ, FSRS-graded) -- it was only implied in pre-flight before. - Added the study feature (15%): the live interleaving toggle + the interactive "How this differs from FSRS" explainer, with the honest "ablation pre-registered, not yet run" caveat. - Added interactive MCQ cards and the timed Exam Mode shell (with honest capacity gating -- only the Mini preset the held-out bank can fill). - Updated the dashboard scene: Performance now shows an OBSERVED accuracy range from in-app Exam-Mode answers (PR #54), not the stale "not available". - Refreshed proofs: make bench now reports next-card p95 0.33ms alongside the mastery 650ms; added the re-runnable gates + interleave-report/ablation-analysis. - Fixed stale state (engine SHA ea3acae -> 4c991c9, "PRs #32-#36") and expanded the vs-base-Anki table + pre-flight + honesty framing + runnable-proofs list. The Milestone-1 appendix is preserved verbatim (its 2026-07-01 snapshot). Docs only. * docs(status): record demo-plan refresh (#58) --------- Co-authored-by: Felipe Caicedo <felipecaicedo@Felipes-MacBook-Pro.local>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Intent (fast lane)
Wire the GRE dashboard's Performance slot to a real score instead of the stale "Arrives Thursday" placeholder. Pure Qt-UI + a read-only view-model that pools the exam attempts Exam Mode already persists to a profile side-file and renders them as a Wilson range. No collection mutation, no scheduler/undo/store, three scores stay separate — so it rides the fast lane.
Summary
ankisubmodule pind11b424 → b7cf7c2(feat(gre): surface observed Performance on the dashboard anki#3), which:CalibrationStripload_exam_attempts()+observed_performance()todashboard_data.py;greDashboardDatareads the side-file best-effort (read-only)ScoreSlotgains anobservedstate; the no-fabrication guard still collapses any range-less state tonot_availableqt.md(§ Observed Performance + footer SHA),models/performance.md(§ Live surface — observed vs the calibrated eval-only model),INDEX.md(dashboard row),STATUS.md(in-flight).Honesty ceilings
Always a range, never a bare point; a give-up state (never a fabricated 0) with no attempts; scores never blended; deliberately the observed low-n surface, not the calibrated
scoring/performance.pymodel.Test plan
./ninja check_sveltegreen (anki PR)./ninja check_pytest_aqtgreen; dashboard test files 23/23 (9 new)OpChangesNotes / follow-ups
agent/exam-preset-fix(=d11b424); retarget to ankimainonce that merges.gre_scorecard(Android panel stillnot_available).dashboard_data.py/mediasrv.pyat the base is left untouched (additions are clean).Made with Cursor