Releases: DataKitchen/dataops-testgen
Releases · DataKitchen/dataops-testgen
5.33.3
Features
- mcp: hygiene issues — list, get, search, update + resource + prompt (TG-1029)
(a026cc1)
Bug Fixes
- ui: visual glitches in connections and test results (a4c557e)
- bigquery: error on freshness monitor when tolerance is null (a111764)
- logs: suppress streamlit warnings (61f8d0e)
- standalone: command argument precedence - add log path to config.env (e91277e)
- standalone: honor config.env for ports, hosts, and base URLs (e28d5a8)
- mcp: hygiene issues review feedback (TG-1029) (3c6d005)
- standalone: graceful shutdown of embedded postgres on signal (fde7321)
- standalone: resolve embedded host/port at connection-build time (4e7cc45)
- standalone: revert Windows signal forwarding to TerminateProcess (52a1c3d)
Documentation
- simplify README install section to point at docs site (043da3c)
Docker Image
datakitchen/dataops-testgen:v5.33.3
PyPI Package
5.32.2
Features
- api: OAuth 2.1 server with unified API+MCP process (d87622b)
- api: job execution queue with state machine and scheduler integration (6010938)
- api: add v1 execution endpoints for profiling, tests, and generation (1688707)
- api: add project-level permissions and sub-resource URL pattern (fb0f6db)
- api: add project-level permissions, sub-resource URLs, and job listing (71320f8)
- TG-1012: add MCP source data tools (194b88e)
- api: test definition export/import endpoints (TG-1020) (4a161f1)
- api: Redoc docs UI, OpenAPI metadata, import optimization (TG-1024) (db9e77f)
- api: add GET /test-runs and GET /profiling-runs endpoints (TG-1023) (bde3a6f)
- mcp: migrate run identifiers to job_execution_id (TG-1025) (45f5690)
- scheduler: unify job dispatch via single exec-job command (TG-1033) (c0d32f6)
- ui: add v2 component infrastructure and registration (7ea4d4d)
- ui: add new shared JS dialog and widget components (86a2e08)
- api: add static API docs build script (TG-1031) (5966a21)
- mcp: add test definition tools — list_tests, get_test, list_test_notes,
list_test_types (TG-1026) (0935291) - support standalone install with embedded postgres (767bd16)
- ui: show pending jobs in runs lists with job-centric queries (TG-1034) (d44643e)
- TG-1043: make OAuth refresh tokens usable for API automation (b202947)
- migrate run-page URLs to job_execution_id with dual-ID routing (TG-1046) (09ee0ba)
- mcp: cross-run analysis and trends (TG-1027) (bc1f6bc)
- JobExecution post-completion callbacks and run-score-update job (TG-1048) (1ceeb20)
- mcp: list_test_results rename + test_suite_id shortcut (TG-1055) (ee3ab2c)
- mcp: profiling L1 — table overview, column profiles, summary (TG-1028) (e63fa69)
- TG-1042: DQ score weighting for table importance and semantic data types (2d8d17b)
- TG-1045: add impact_dimension as DQ scoring classification axis (8d3acc0)
- mcp: execution tools — run, cancel, generate (TG-1030) (a819130)
- mcp: track inventory tool calls in Mixpanel (TG-1062) (e188d8b)
Bug Fixes
- api: address OAuth MR review feedback (d3e449e)
- bump Helm chart version to 1.2.0, update submodule (ccbd79e)
- lint errors in MCP test files (import sort, unused import) (741f410)
- TG-1012: address MR review feedback for MCP source data tools (6d84c26)
- sort imports in test_suite model (bc3b64f)
- use isnot(True) for monitor filter consistency (8deedf8)
- return run ID from handlers, fix functional test callers (TG-1033) (c35e417)
- api: address MR review feedback for run endpoints (TG-1023) (6708ce3)
- coalesce completed_at to NOW() in select_summary (TG-1035) (d04550a)
- test-types: fix LOV_All execution SQL for PostgreSQL and threshold quoting (ffdcb52)
- test-types: revert LOV_All threshold quoting to match template convention (ddcb68f)
- address MR review feedback (TG-1035) (cca26cb)
- set JE completed_at after handler runs in quick-start (TG-1035) (f406d53)
- models: improve database session handling and JSON serialization (9683e4d)
- test-types: fix LOV_All execution SQL for MSSQL and SAP HANA (b7aa1ad)
- ui: restore missing features and address review feedback in VanJS pages (4522760)
- test-types: fix LOV_All SQL for SAP HANA — use STRING_AGG not LISTAGG (c07b22f)
- mcp: address MR review feedback (TG-1026) (3a9ffca)
- test definitions: add missing profiling button (029560e)
- deps: bump pillow to 12.2.0 for CVE-2026-40192 (5a13588)
- mcp: exclude monitor suites from existing read tools (TG-1049) (32d3f47)
- mcp: surface thresholds in test run diff (TG-1027) (f44b447)
- ui: clear intervals before leaving the current page (de9e98e)
- mcp: close test_suite_id leak in get_failure_summary; normalize "Test run" label
(TG-1057) (543a9c8) - sqlalchemy 2.0 upgrade (bd632ec)
- test-suites: table group filter not working (d6d5d8e)
- pii: mask profiling dialogs based on user permissions (614659a)
- scores-details: broken issue report and query bug (f5bc0d9)
- profiling: hide button for non-column results (4eee69e)
- score-issues: support View for (none) category (b908fda)
- lint errors (5f25546)
- redshift and mssql warnings (9cd8e43)
- remove stale pinned version in dockerfile (e2bca92)
- minor tweaks to weighted scoring (a8f7187)
- ui: runs cache invalidation, toolbar stability, and related UI bugs (7a129a2)
- mcp: tighten get_failure_summary scope validation (TG-1058) (798b6d3)
- snowflake: make key-pair default - add deprecation warning for password (491d448)
- display loading spinner for table group preview (90b0db1)
- profiling-run: don't display empty sections in email notifications (9846922)
- make text consistent for Add/Save (5ef8186)
- hide SAP Hana option for Docker deployment (842c9e2)
- app-logs: filter by text not working (5f1b229)
- synapse: disable pre-connection queries (a6e01b9)
- ui: visual glitches and inconsistencies (6a80d6a)
- input-validation cleanup across MCP tools and API list_jobs (a93fc1a)
- mcp: TG-1028 reviewer feedback — hygiene-issue rename, PII parsing, perf scoping
(c01f6b2) - impact dimensions: updates from review (b50260c)
- mcp: queries failing in sqlalchemy 2 (d401287)
- monitors: exclude dropped columns from freshness fingerprint generation (23b7c7c)
- monitors: regenerate monitors that fail validation (e82c35c)
- errors in test results and edit table monitor dialog (7d7334e)
- run dialogs: remove CLI command - delete unused duplicate files (3b0ea29)
- demo: trigger test failures on dimension table for weighted scoring (fb3f6b7)
- improve standalone version (5c63163)
- address review feedback (8ba2b38)
- subprocess not started correctly in standalone on some systems (a6a1f4b)
- runs: jobs not deleted when parent entity deleted (29b8fe9)
- pass termination signal correctly in Windows (642e691)
- standalone: quick-start not working on windows (c320b9e)
Refactors
- TG-1010: extract source data logic into shared service (4c51670)
- extract query caching from model layer to UI service (74ac75b)
- add TestType cache proxy, fix stale cache docs (3dc22b6)
- TG-1012: extract shared MCP tool utilities into common module (7807486)
- api: address MR review — enums, monitor filter, project_code index (ad58f6e)
- migrate run status readers to job_executions (TG-1035) (63f908a)
- normalize cancelled -> canceled spelling (American English) (e94523c)
- ui: delete duplicate frontend JS components and utilities (182c699)
- ui: update static JS components and utilities (c86234d)
- ui: update main.js and frontend page JS entry points (462aa11)
- queries: add pagination, filtering, and sorting to query modules (6e5ac42)
- dialogs: migrate dialog base classes and shared dialogs to v2 pattern (27dfaf8)
- ui: migrate simple pages to v2 components (0cd444c)
- ui: migrate profiling and data catalog pages to v2 components (3323ce6)
- ui: migrate test workflow pages to v2 components (b4647c8)
- ui: migrate monitoring and table group pages to v2 components (cbbf55d)
- ui: add shared VanJS dialog components for data catalog (59d6164)
- ui: add application logs VanJS dialog and widget (929a303)
- ui: migrate data catalog dialogs from st.dialog to VanJS (3de8c86)
- ui: migrate profiling results dialog in score details to VanJS (abdf660)
- ui: migrate connections setup wizard dialog to VanJS (a83511f)
- ui: remove dead code from v1 Streamlit components and dialogs (1456a24)
- ui: add loading indicators to connection and table group actions (79c4acc)
- mcp: add ParamFieldsMixin and display_name property (TG-1026) (90231f4)
- mcp: replace ad-hoc markdown with MdDoc builder (efa18c7)
- deploy: rename build_docs to build_api_docs (TG-1031) (3c23625)
- upgrade to python 3.13 (01c4d59)
- make codebase compatible with Python 3.11 (7625c0b)
- mcp: typed exception for not-found-or-inaccessible (TG-1057) (45636fc)
- mcp: TG-1030 reviewer feedback — transition self-loop, resolve_test_suite (4b63c02)
Documentation
- enable mcp by default - add build script for reference doc (0d32f88)
Miscellaneous
- ui: remove leftover Streamlit.setFrameHeight calls from v2 pages (4927d42)
Docker Image
datakitchen/dataops-testgen:v5.32.2
PyPI Package
testgen-1.2.0
A Helm chart for Kubernetes
5.9.5
Bug Fixes
- sqlalchemy warning (7a10ee1)
- source data ORDER BY for Standardized_Value_Matches hygiene issue (f07c561)
Docker Image
datakitchen/dataops-testgen:v5.9.5
PyPI Package
5.9.4
Features
- ui: add flagged status to test definitions (TG-976 Phase 1) (07a5a0f)
- ui: add notes dialog, review column, and sorting improvements (TG-980) (84b0ad1)
- mcp: add MCP server foundation with JWT auth and ping tool (c123552)
- mcp: add P0 tools, resources, prompts and model extensions (8f69936)
- projects: add a project membership to handle user role in a project (6533624)
- plugins: support multiple pages per plugin spec (6c232ef)
- auth: scope sidebar projects to user memberships (e654258)
- ui: add Dialog component; fix Portal stacking context (b0c96a3)
- ui: add disabled prop to Toggle; add notIn form validator (356ba70)
- mcp: polish inspector output and add validation (2761ffa)
- catalog: add CSV import/export for metadata (62e490b)
- mcp: enforce project-level permission scoping on all tools (f4e876a)
- support oauth for databricks (cffe34c)
- add support for Oracle 12c+ (085e45d)
- add support for SAP HANA (4b993b5)
- add safe_rerun to prevent data loss on Streamlit rerun (a0be715)
- mcp: sanitize errors at tool/resource/prompt boundary (8e5e7b2)
- pii masking, xde, hash fingerprints (8bdaa83)
- test suites: add search filter (ffb41a9)
- wizards: make steppers clickable (14f5e8c)
Bug Fixes
- resolve ruff linting issues (import sorting, dict literals, unused import) (b57e70f)
- improve upgrade commands to update revision after each script (0db6fdb)
- ui: misc JS fixes (08a6a8a)
- ui: mirror utils.js JSDoc type improvement to static copy (9b4e120)
- ui: visual inconsistencies and navigation bug (e2e95df)
- ui: hide portal when main content scrolls (3100ae7)
- navigation: add project/permission checks and redirects (f1d29e1)
- ui: address MR review feedback for CSV metadata import (TG-988) (cb1c9dc)
- ui: skip entire row on CDE error, not just the field (TG-988) (e694400)
- ui: fix auth base class kwarg, review column spacing, and grants (e3b0581)
- ui: address MR review feedback for notes dialog (TG-976) (1f2a5f8)
- discrepancies between flavors in hygiene issues and test types (e13a7f5)
- sql server: make Dupe Rows test case sensitive (0e6be25)
- discrepancies in Weekly Record Count test (911f81a)
- edit-monitors: bugs in form - validate required fields (24e6299)
- data catalog: remove test suite links for catalog role (351d54d)
- update doc links (8e68494)
- monitors: generate freshness monitors when profiling data already exists (8b39bbb)
- use database_session() context manager for schedule query (de20ee0)
- always clear cache in safe_rerun (671e702)
- TG-1005: correct Daily_Record_Ct operator and Email_Format lookup regexes (adc7883)
- TG-1005: make MSSQL calendar gap lookups consistent with other flavors (5b2d69d)
- TG-1005: fix cross-flavor test type bugs found by validation suite (b1100e0)
- ui: render portals/tooltips on top of Streamlit dialogs (3b18a69)
- ui: add support for caption in select options (9e7ce46)
- monitor: use excluded days from schedule if active (31c0361)
- remove summary from edit table group dialog (36aa858)
- data catalog: add help text (a326e67)
- updates to pii masking and xdes (0146128)
- scheduler shutdown race — check _stopping before blocking on _reload_event (4cdb3f2)
- database urls detected as emails (592ce63)
- data catalog: improve flag styling (39c82cf)
- monitor generation fails to find test suite (8d3667b)
- edge case in column history dialog (6c82a06)
- schedules dialog: bug in pausing/deleting (7f105d5)
- run tests: hide button in dialog after clicking link (2ead7ac)
- table group: remove stepper from edit dialog (62e1b4c)
- truncate timestamps to date in Daily_Record_Ct measure formula (1019526)
- cast timestamps to date in Daily_Record_Ct source data lookup (Databricks) (25636ca)
- ui: portals were closing when a nested portal opened (f5747aa)
- emails: move app links to left (2512c9e)
- update error text to be consistent (8d461c3)
- test definitions: handle empty suite (04dbd1b)
- scorecard: error on adding notification (b94c506)
- copy/move tests: unique key constraints (1dfbfd9)
- data catalog: prefix icons disappear after saving (104e0b8)
- missing imports (66f244e)
Refactors
- remove pydantic and streamlit-pydantic dependencies (002d5da)
- hide MCP behind feature flag and standardize boolean settings (87f7205)
- decouple RBAC from enterprise plugin via PluginHook (67749e4)
- mcp: rewrite server instructions and handle plugin load errors (c73dfcc)
- mcp: hide internal test_type codes from user-facing output (cacab09)
- mcp: replace global admin bypass with role-based permissions (99e8781)
- profiling: replace yaml files with TG- conditional SQL templates (f50b454)
- flavor: make FlavorService stateless with explicit params (094a15b)
- introduce database_session context manager (f82e34c)
- replace st.rerun with safe_rerun in UI code (e43a3ab)
- track writes via after_flush, clear cache in safe_rerun (292f1ab)
- remove cache-clearing side effects from model mutations (ff7917f)
- remove redundant cache clears from view callsites (df62103)
- remove explicit commits from model mutations (5732304)
Miscellaneous
Docker Image
datakitchen/dataops-testgen:v5.9.4
PyPI Package
5.0.2
Bug Fixes
- handle duplicates before applying unique index (509541e)
Docker Image
datakitchen/dataops-testgen:v5.0.2
PyPI Package
5.0.1
Features
- add standard generation set (46d0c11)
- monitors: add volume trend and metric trend tests (4c92f14)
- monitors: add test threshold prediction (20d0c77)
- monitor: use the new table component for the monitor list (ecbd0ea)
- add table monitor dialog and enable monitor suite (9b4f797)
- monitors: display volume trend chart (27c5c6c)
- monitors: display schema anomalies by table (caa52cd)
- monitors: add settings and delete dialogs (3da24e6)
- monitors: use SARIMAX to support excluding weekends and holidays (c2584e8)
- table groups: add standard and monitor suite wizard steps (5cad913)
- connections: add standard and monitor suite steps to wizard (ab25af6)
- monitors: display prediction in volume trend chart (4b78b96)
- monitors: enable notification settings for monitors (edf41c1)
- freshness: add new test - regenerate monitors when needed (a1df201)
- notifications: warn users of duplicate notification deliveries (ae09a53)
- monitors: indicate training mode - display tables when no results (12c38d9)
- monitors: configuration for regenerating freshness (badb908)
- quick-start: Adding Monitoring features (8cc2b04)
- quick-start: Improving monitor data as QA feedback (5570cee)
- monitors: add Table Monitors dialog + misc fixes (cea61bb)
- charts: Replacing the bitnami charts and images (753a7cc)
- monitors: add metric monitors (50319d4)
- monitors: display predicted table freshness events (e1a3455)
- monitors: display threshold lines for volume and metric charts (3774dba)
- ui: add starting at/on offset to cron schedule editor (b975f6f)
- monitors: allow filtering by anomaly types (75533ee)
- monitors: add toggle to show more history in dialog (60ff579)
- monitors: add deep-link to table trends dialog (8c707a0)
- monitors: freshness monitor with gap-based thresholds and schedule inference (7b98b84)
Bug Fixes
- generation set: add dupe rows to standard (a2a47d0)
- monitors: miscellaneous fixes and enhancements (70ab739)
- css: make toolbar styles consistent (aea7e71)
- monitors: remove monitor schedules from test run schedules dialog (c3d3ced)
- monitors: bugs in cli, models and prediction (a10a6b3)
- monitors: update holiday codes and timezones (cfd3b92)
- charts: offset schema chart lines when too short (26e3081)
- security: Fix Docker Scout vulnerabilities (e87b017)
- quick-start: persist the SMTP settings (a210134)
- monitors: filter out undefined items in timestamps list (d043cb5)
- parse dates from int or str properly (c29a3f1)
- profiling: add missing column to CTE (c1b3cdb)
- monitors: sort the points to draw the volume chart path (ac1d0e2)
- monitors: freshness results used for prediction (136db77)
- monitors: misc display updates (9e5cd3d)
- quick-start: update monitor iterations (d3f3936)
- rendering errors in a couple pages (91f04aa)
- Fix Observability export (3283d83)
- monitors: improve tooltips in charts - fix state bug in threshold form (74f0412)
- monitors: improve loading and form (b5c75e3)
- monitors: fix charts height calculation (d9a22a0)
- monitors: configuration and quick start improvements (fce03aa)
- ui: improve loading performance (111fdca)
- monitors: update form states after saving (7318a53)
- ui: lazy load plugin components (a5f6203)
- test-types: update text strings to match docs (ec9c26d)
- monitors: misc style and quick start updates (904767c)
- monitors: conditionally display ticks decimals (74a3655)
- monitors: table trend chart x axis ticks overlap (751236b)
- freshness: numeric overflow errors (883016f)
- test result: history graph broken when NaN values present (50955af)
- emails: bugs in test run and monitor run templates (50666bb)
- add email source to mixpanel events (507c4bb)
- monitors: handle errored monitors (d2ac510)
- tests: fix 28 broken unit tests and restructure test suite (48ad053)
- monitors: handle dropped and re-added tables (80d40e4)
- ui: misc changes to hygiene issues and test results (b2f0381)
- monitors: widen prediction thresholds (09f3319)
- docs: update help links on all pages (74f6a21)
- monitors: reset pagination on filtering (9bc11bc)
- monitors: error on empty state (43e8156)
- data-catalog: display new table/column names in bold (74b4da1)
- monitors: tooltip position in dialog (3add174)
- tests: NULL condition for tolerances applies to 0 values (a501c4f)
- monitors: match anomaly summary in email with UI (92e065d)
- quick-start: update data for freshness anomaly (225d268)
- monitors: constrain volume lower bound for cumulative tables (064ad0c)
- monitors: constrain prediction for volume monitor to be non-negative (5118316)
- monitors: prevent overconfident prediction bounds (67a1afb)
- upgrade script missing schema (075e557)
Refactors
- schedules: reuse logic to sample cron expressions (6ee5df8)
- monitors: add job key for monitor suites (b9765e1)
- wizards: update summary step (1e87866)
- autogeneration: generate volume and schema tests without profiling (087befe)
- table groups: display progress in creation wizard (b9dc4f2)
- notifications: reset form only on edit (de34c5e)
- notifications: sort alphabetically based on the scope (ace6f79)
- monitors: open table monitor charts from anomaly tags (05897cb)
- monitors: display markers on volume chart (91af3f4)
- monitors: expand schema chart markers clickable area (69970a9)
- monitors: visual changes to the table trend charts (8e818ca)
- monitors: use multi-barchart for schema changes (5441dd6)
- monitors: allow hiding changes columns (35c540a)
- monitors: allow sorting by anomalies count (f78c126)
- monitors: dynamic tick width for trends chart (7a04e44)
- monitors: add legend to table trends charts (8ab8065)
Miscellaneous
- move sql templates to yaml files (b2ecbc9)
- work around Streamlit loading of v2 components (26cc8e2)
- monitors: limit shown prediction points to <= lookback (d0c12d0)
- check changes in styling after st upgrade (f2f81cf)
Docker Image
datakitchen/dataops-testgen:v5.0.1
PyPI Package
testgen-services-1.0.1
A Helm chart for Kubernetes
testgen-services-1.0.0
A Helm chart for Kubernetes
testgen-1.1.0
A Helm chart for Kubernetes