Update dependency ingestr to v1#814
Closed
renovate[bot] wants to merge 1 commit into
Closed
Conversation
1abd973 to
057972e
Compare
057972e to
e49f616
Compare
Contributor
|
ingestr v1 changed implementation and license. omniload picked up the ingestr v0 code base and is carrying it into the future. Advice: Please close this PR. /cc @florinutz, @kneth |
8f265cb to
a4060d0
Compare
a4060d0 to
fab8e69
Compare
Contributor
Author
Renovate Ignore NotificationBecause you closed this PR without merging, Renovate will ignore this update. You will not get PRs for any future If you accidentally closed this PR, or if you changed your mind: rename this PR to get a fresh replacement PR. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
>=0.13.61,<0.15→>=0.13.61,<1.1Release Notes
bruin-data/ingestr (ingestr)
v1.0.40Compare Source
Changelog
9ba29ceAdd Braze source8502a04Add braze to server connector catalog612d400Address Greptile review on braze source898ed83Fix KPI window off-by-one dropping the start dayd50946fMerge pull request #849 from bruin-data/iremcaginyurtturk/check-braze-sourcev1.0.39Compare Source
Changelog
3a8f656Add CLI parity to server UI (#839)282b4bbAdd MongoDB CDC schemes to server connector catalog4945020Add MongoDB CDC source (#837)dcf1291Add Twilio source0a97571Add ingestr load timestamp column (#833)d104fceAdd streaming queue broker sources (#829)893caf1Merge pull request #844 from bruin-data/iremcaginyurtturk/fix-mongodb-cdc-catalogcdeaacaMerge pull request #845 from bruin-data/iremcaginyurtturk/twilio-vs-sendgrid-sourcea788c9cMerge remote-tracking branch 'origin/main' into iremcaginyurtturk/twilio-vs-sendgrid-sourcee23cd52Optimize MongoDB benchmark ingestion paths (#841)246ff95Use dedicated catalog entry for MongoDB CDC76d4fb8Use target schema for DuckDB replace staging (#842)7145b2bfix schema evolution arrow ownership (#840)31c4a81fix: restore curl in OCI image for health check workflows (#836)e0bd731restore streaming transform coverage (#838)eb41508twilio: add to connector catalog78a45b6twilio: make isValidTable accept granularity modifiersv1.0.38Compare Source
Changelog
1a2c073Add SQL Server Change Tracking source (#808)e01a6fbAdd SharePoint source (#817)193c6f1Address review: protect synthetic event keys and tighten cancellationf152c7fAlign football-data research doc with shipped implementationc78926aDrop date_from/date_to URI params in favor of the interval62b14baDrop plan-quota rate-limit line from api-football docs626d5fcFix stale primary keys after removing flatten helpers0030b00Lower api-football rate-limit burst to stay under the free-tier cap9ff39a7Merge for fixture-derived api-football tables that honor the interval16f6072Merge pull request #823 from bruin-data/prod-test-failures02ffea1Merge pull request #826 from bruin-data/iremcaginyurtturk/api-football-schema-inference895fda3Merge pull request #827 from bruin-data/fix/streaming-test-lint511102aMerge pull request #828 from bruin-data/iremcaginyurtturk/football-data-schema-inference82fb804Merge pull request #830 from bruin-data/iremcaginyurtturk/api-football-apifootball-scheme89ca011Merge pull request #831 from bruin-data/iremcaginyurtturk/balldontlie-rename6f2e7b9Merge pull request #832 from bruin-data/iremcaginyurtturk/footballdata-drop-date-params741dddeModernize api-football: any over interface{}, maps.Copy3ad5577Protect match_events synthetic keys from API field collisionsf50c106Refactor BallDontLie source: schema inference, replace strategy, rename scheme to balldontliea0eafa4Refactor api-football source to use schema inference3b9be04Refactor football-data source to use schema inference82ac40fRename source scheme to footballdata2a1a6ecUpdate api-football.md66d8cb7Update api-football.mdb1bf33eUse apifootball scheme (no hyphen) for api-football sourceb8db3e6Use merge only for incrementally-loadable api-football tables6aa7fb9[codex] speed up license policy checks (#822)226b8ddfeat: added history tables for existing objects, added case & casehis… (#699)18470cafix licenses testc93985afix tests52174fdfix(strategy): correct type in streaming_test flush loopv1.0.37Compare Source
Changelog
44df12fDrop dates URI param from ESPN source5283683Merge pull request #821 from bruin-data/iremcaginyurtturk/espn-drop-dates-uri-paramv1.0.36Compare Source
Changelog
3e636d7Add ESPN sourcea3b9362Drop unused normalize helpers from ESPN source572b438Merge pull request #737 from bruin-data/cursor/remove-dlt-docs-links-40c21750772Merge pull request #819 from bruin-data/arsalann/espn-sourcef644f68Merge remote-tracking branch 'origin/main' into cursor/remove-dlt-docs-links-40c2a28d287Refactor ESPN source to use schema inference and per-table strategiese0220aeTreat missing scoreboard events key as empty resulte7cc32fUpdate espn.mdbc01141docs(athena): add missing workgroup configuration stepd147f0adocs(espn): clarify no authentication requiredf6f4eabdocs(slack): document both user and bot token paths89fcc3afix salesforce access token docs (#820)v1.0.35Compare Source
Changelog
79d649cAdd --stream flag for continuous (streaming) ingestion (#797)b7dc31cAdd Monday items source and board scoping (#812)3a18ddeAdd trim whitespace ingestion option (#811)5626ba7Fill unchanged TOAST columns from prior rows in the Postgres CDC decoder (#804)2864222Merge pull request #760 from bruin-data/feat/sendgrid-source78be2c2Merge pull request #815 from bruin-data/bensuyurtturk/bru-4971-vuln-high-githubcomdockerdocker-in-ingestr-cve-2026-34040f3bc287Merge pull request #818 from bruin-data/iremcaginyurtturk/monday-api-token-rename09cd360Organize platform docs overview (#816)ec56939Update sendgrid.md18ea755[codex] Add MySQL CDC source support (#810)fc6f547[codex] Add World Cup soccer data sources (#740)992b383chore(sendgrid): trim comments to 1-2 lines2cc8851chore: stop tracking generated imports.gen.go (gitignored)c019cd8docs(sendgrid): align with house style and add sidebar entry6f306e7feat(sendgrid): add blocks, invalid_emails, spam_reports, unsubscribes tables9135f06feat(sendgrid): add suppression_groups, suppression_group_members, templatesf4a2ddcfeat(sendgrid): batch messages via recursive date-range bisectioncd4c598feat(sendgrid): make interval-end exclusive (half-open [start, end))d5c4abbfeat(sendgrid): recover >1000 same-second messages via msg_id prefix partition6d26b9bfeat(source): add sendgrid source8303913fix pg primary key logs (#803)df9e927fix strategy test truncate fixture (#814)484de9cfix(deps): bump testcontainers-go to v0.42.0 to drop vulnerable docker/docker (CVE-2026-34040)e41d478fix(monday): standardize on api_token, fix scoped-updates test, expand docs5d90753fix(sendgrid): keep rows with null/unparseable incremental key instead of droppingc49c965fix(sendgrid): warn when messages page limit is hitb0b236frefactor(sendgrid): config-driven structure, fix single_sends page size, add testsbb3b11arefactor(sendgrid): drop email_activity_query, make stats granularity a table suffix9a30a4atest(sendgrid): make messages bisection unit-testable and cover itff995c9update docv1.0.34Compare Source
Changelog
aa9bd1bAdd Spark benchmark and optimize MSSQL writes (#802)b0ebcdcMerge pull request #807 from bruin-data/TanayBensuYurtturk/fix-mssql-query-decimal-scale0cf0d02fix(mssql): preserve decimal scale for custom-query sourcesv1.0.33Compare Source
Changelog
d2595eaAdd native Db2 source (#790)4478022Fix Databricks JSON array decoding (#794)fc9d66cHandle duplicate BigQuery query jobs (#798)bf9bde8Merge pull request #793 from bruin-data/run-docker-after-release9ffc92bMerge pull request #799 from bruin-data/bensuyurtturk/bq-parquet-cast05138c5Support multipart SQL Server source tables (#796)bf9ab07ci: gate release on docker-test6535ef5fix(bigquery): cast load-job batches to the staging table schema31cb559scd2 test fixv1.0.32Compare Source
Changelog
31d6492Address review: case-insensitive BigQuery unchanged-cols check, clarify schema-flow and Redshift containment comments0cfa7d6Fix CI failures37049d9Fix CI with staging ingest schema46c175bFix PG CDC merge wipes unchanged TOAST/JSONB columns Fixes #706392d751Fix SET NULL workaround0610721Fix comments4f16480Fix duckdb implementation6dacf9dFix greptile issuesca9e3fbFix main-merge conflict resolution for the composed CDC merges0779646Fix string escaping issues89ac3a3Keep _cdc_unchanged_cols out of merges on destinations that don't consume it3780466Keep _cdc_unchanged_cols staging-onlya1f0d24Merge branch 'main' into genora51/snowflake-toast-fix405d8dcMerge branch 'main' into genora51/snowflake-toast-fix5e1e7f1Merge branch 'main' into genora51/snowflake-toast-fix12ddd0bMerge pull request #788 from bruin-data/publish-docker-image-on-release5224a81Merge pull request #789 from bruin-data/pg-cdc-toast-preservation28a2236Merge upstream main into genora51/snowflake-toast-fix6b82723Merge upstream/main into genora51/snowflake-toast-fixf497210Validate SQL Server CDC source and fix CDC merge semantics across all destinations (#786)e82b7d6ci: gate docker-build on integration-testsa35bcfbci: gate release-unix on docker-test instead of docker-buildd8dfbbeci: publish docker image to GHCR on releasec8ddf02make the comparisons case-insensitivev1.0.31Compare Source
Changelog
14144b2Merge pull request #782 from bruin-data/TanayBensuYurtturk/paddle-source7851c38add new source: paddle4a96625test fix112185ctest secret fixv1.0.30Compare Source
Changelog
2886fa2ci: install uv with setup action (#785)v1.0.27Compare Source
Changelog
d499960Fix ClickHouse low-cardinality array mapping (#777)f3c214eMerge pull request #778 from bruin-data/iremcaginyurtturk/indeed-traffic-stats-pk3c59b8f[codex] fix snowflake parquet timestamp loading (#775)8aacc25fix(indeed): preserve per-(job × platform) rows in traffic_statsv1.0.26Compare Source
Changelog
a558339Merge pull request #767 from bruin-data/TanayBensuYurtturk/fix-rollup-path-traversalc72d9c3Merge pull request #769 from bruin-data/TanayBensuYurtturk/fix-postcss-xss41a1a3bMerge pull request #770 from bruin-data/add-tinyint-column-type09a995dfeat: add tinyint (8-bit integer) as a --column type50582fcfix(deps): bump rollup to ^4.59.0 to fix path traversal (GHSA-mw96-cpmx-2vgc)60f9b35fix(deps): force postcss >=8.5.10 to fix XSS in stringify (GHSA-qx2v-qp2m-jg93)efc2438fix: guard Int8Builder json.Number against out-of-range overflowe681e03fix: range-guard all Int8Builder numeric conversions98aa56arefactor: hoist int-narrowing guards to package functions; extend to Int16/Int32/Int64c5d758frefactor: use math.MinInt8/MaxInt8 instead of magic numbersv1.0.25Compare Source
Changelog
17ddab1Add CDC source and strategy groundwork (#732)ef41c18Database query built from user-controlled source3f68bcfMerge pull request #759 from bruin-data/TanayBensuYurtturk/fix-code-scanning-alertscbb65b9Merge pull request #761 from bruin-data/iremcaginyurtturk/fix-claude-md-go-contextafbfd71Merge pull request #764 from bruin-data/iremcaginyurtturk/ingestr-annotations-step-type71a3afcMerge pull request #765 from bruin-data/fix/mssql-uritoconnstring-casing2b90e9bbot1ce0b5cfix(annotation): tag schema-evolution ALTERs with ingestr_stepdfb940afix(mssql): align test with exported URIToConnString761dfc0more quotingv1.0.24Compare Source
Changelog
5e53a35Merge pull request #758 from bruin-data/patch/source-original-column-namesd043941fix(mssql,mysql): use original source column names for read queriesv1.0.23Compare Source
Changelog
846d1baMerge pull request #755 from bruin-data/fix-mssql-uuid-snowflake0f08bf2fix mssql uuid formattingv1.0.22Compare Source
Changelog
f751b24Merge pull request #723 from bruin-data/fix/alert-148-thrifteaefc47Merge pull request #724 from bruin-data/fix/alert-145-otel-sdk90ef3dfMerge pull request #725 from bruin-data/fix/alert-144-aws-s3729115cMerge pull request #726 from bruin-data/fix/alert-143-aws-kinesisf849ef4Merge pull request #727 from bruin-data/fix/alert-142-go-josecd7698fMerge pull request #728 from bruin-data/fix/alert-139-edwards255195adb170Merge pull request #744 from bruin-data/TanayBensuYurtturk/unify-replace-dedup70fbfecMerge pull request #747 from bruin-data/TanayBensuYurtturk/hubspot-service-key99fdf12Merge pull request #748 from bruin-data/iremcaginyurtturk/standardise-debug-log-formatf697b86Merge pull request #750 from bruin-data/descriptive-column-override-logs53c5e79Update benchmark script dependencies (#742)9f54265[codex] add prediction market sources (#739)d886803docs(hubspot): note service keys are in public beta2d6c919feat(hubspot): accept service keys as a credential5387c0cfeat(pipeline): print readable type names in column override logsbc9dc55fix(deps): bump aws-sdk-go-v2/service/kinesis to v1.43.531eb0f7fix(deps): bump filippo.io/edwards25519 to v1.1.1bc37813fix(deps): bump github.com/apache/thrift to v0.23.0eb6373efix(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 to v1.97.34b1d948fix(deps): bump github.com/go-jose/go-jose/v4 to v4.1.4d6e66f8fix(deps): bump go.opentelemetry.io/otel/sdk to v1.43.0b46cb30pass ik for multitable2b9b630refactor(debug): emit zap-compatible debug log format31781ferefactor(replace): unify primary-key deduplication across destinations09815e5test(schemaevolution): use String() for widen subtest name suffixesv1.0.21Compare Source
Changelog
196a3b2Add Wistia source (#738)v1.0.20Compare Source
Changelog
9ea79c5Add blobstore modified-date incremental loading (#705)82987d9Disable telemetry in CI and tests (#710)2d36cecMerge pull request #695 from bruin-data/fix/salesforce-account-systemmodstampc1fd55dMerge pull request #713 from bruin-data/iremcaginyurtturk/fix-trino-docs07bf5fbMerge pull request #714 from bruin-data/iremcaginyurtturk/separate-athena-trino-impl304fad8Merge pull request #717 from bruin-data/iremcaginyurtturk/fix-dependabot-vulnerabilitya7703d8Merge pull request #718 from bruin-data/iremcaginyurtturk/bump-pgx-5.9.23d9ff4dMerge pull request #720 from bruin-data/iremcaginyurtturk/trino-dest-improvements57a5255Support Salesforce client credentials auth (#656) (#676)b833eb2[codex] Add SQL Server benchmarks and bulk-copy writes (#711)46ffa24[codex] Add no-inference schema mode (#708)3c3cec0add agents.md (#709)8facf4afeat(trino auth): map verify=false to InsecureSkipVerify482ba86feat(trino dest): add mTLS, http_headers, and v0 param aliases3e8eb0dfix(benchmarks): bump nltk to 3.9.4 to address Zip Slip vulnerability098241afix(salesforce): use SystemModstamp as account incremental keyb8df771fix(trino auth): hash cert/key contents (not paths) for cache key8176753fix(trino auth): inherit DefaultTransport timeouts for custom HTTP client9b3d8aefix(trino auth): use Header.Set to avoid duplicated header valuesdaddbd5fix(trino source): type-aware incremental literals + UUID typingdde1277fix: bump github.com/jackc/pgx/v5 to v5.9.2 for memory-safety fix3cd45b9refactor(athena): split schema-evolution dialect out of trino packagev1.0.19Compare Source
Changelog
9087536Merge pull request #702 from bruin-data/TanayBensuYurtturk/excluded-column-dest-retention899685fMerge pull request #704 from bruin-data/feat/annotation-source-extractd091fc5bot3a99afadocs(annotation): clarify custom-query tagging commentsad26fa7exclude column72472c0feat(annotation): annotate custom-query and Snowflake source reads7b87577fix(annotation): tag Snowflake custom-query reads via QUERY_TAG7dd1ffarefactor(annotation): case-insensitive Snowflake dialect checkbd91e47refactor(annotation): inline Snowflake QUERY_TAG check, drop the interfacev1.0.18Compare Source
Changelog
7443d01Add MaxCompute source and destination (#677)28f71cbDedupe staging by primary key in delete+insert strategy159b841Fix unknown JSON string casting (#694)55a83a8Merge pull request #601 from bruin-data/iremcaginyurtturk/cratedb-source-docs027f13aMerge pull request #686 from bruin-data/patch/delete-insert-pk-dedup981445fMerge pull request #687 from bruin-data/TanayBensuYurtturk/bump-version-permissions9f5dd9eMerge pull request #693 from bruin-data/TanayBensuYurtturk/update-readme-supported-sourcesde359b5Merge pull request #701 from bruin-data/feat/annotation-etl-phase1d9c958Merge pull request #703 from bruin-data/TanayBensuYurtturk/bigquery-partition-by-error160922dUpdate CrateDB source docs to use PostgreSQL wire protocol09d1ddf[codex] Add MongoDB dlt benchmark setup (#689)be156c4bq partition by date error fix7271aa5case insensitive compared5c281bchaneg token back8d794eedocs(cratedb): drop empty-password colon in localhost URI examples31c5a77docs(cratedb): drop stale warning about unsupported materialization strategiesa270fb5feat(annotation): classify queries by ETL phase via type0aedd30fix(maxcompute): surface row iterator errors (#697)14a509drafactorb71582erefactoree524detest(annotation): use t.Errorf in typeForStep loop to report all casesv1.0.17Compare Source
Changelog
63e7834Merge pull request #692 from bruin-data/feat/salesforce-custom-incremental-keyf9b4a77chore: lint142b009feat(salesforce): allow overriding the incremental keyc77714afix(salesforce): default merge PK to Id when overriding incremental keyv1.0.16Compare Source
Changelog
9243f39Merge pull request #645 from bruin-data/feat/query-cost-annotations251cad8[codex] Add Cassandra source and destination (#678)880e07fadd azure sql source connector (#679)8e6e91afeat(annotation): always emit ingestr keys and fix ingestr_step key0bab06efeat: add query cost annotations for BigQuery & Snowflakev1.0.15Compare Source
Changelog
d095966Merge pull request #684 from bruin-data/iremcaginyurtturk/fix-batch-association-losse4566bbhubspot: retry POST associations and split batch on any non-2xxv1.0.13Compare Source
Changelog
2f7c005Add OneLake (Microsoft Fabric) destinationc0481f3Add license audit checks1cb397cAdd source_column field to map source→destination column names in ingestr assets168b65dDownload manually audited license modules41629f7Fix DropTable mutating shared state without a locke6f4a20Fix SCD2 close: resolve scd* indices from target schemaa2976f5Fix deterministic license generation0efb47cMerge pull request #669 from bruin-data/audit-go-licenses-elv2-buslConfiguration
📅 Schedule: (UTC)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.