Skip to content

Tooling bird migration pipeline#245

Open
aseering wants to merge 1 commit intoGoogleCloudPlatform:mainfrom
aseering:tooling-bird-migration-pipeline
Open

Tooling bird migration pipeline#245
aseering wants to merge 1 commit intoGoogleCloudPlatform:mainfrom
aseering:tooling-bird-migration-pipeline

Conversation

@aseering
Copy link

I'm trying to run evalbench locally, against databases hosted on my machine. (Mostly for convenience when trying things out.) Most datasets have data files that can be downloaded/fetched and loaded. Bird doesn't; it's a SQLite database. Here are some tools that I used to import the schema and data into other engines that I'm playing with.

They're currently a bit of a mess. I can clean them up -- would it be worth doing so?, and how would you ideally like them to be structured?

@google-cla
Copy link

google-cla bot commented Feb 21, 2026

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@aseering aseering force-pushed the tooling-bird-migration-pipeline branch from 0a59c37 to 61348ae Compare February 21, 2026 03:55
- Migration tools: migrate_bird.py, check_migration_status.py, setup_air_travel.py, setup_bias_dbs.py
- Verification: check_benchmark_readiness.py, benchmark_verifier.py
- Orchestration: run_full_benchmark.sh, run_remaining_migrations.sh
- Provisioning: ensure_local_dbs.py, setup_spanner_dbs.sh
@aseering aseering force-pushed the tooling-bird-migration-pipeline branch from efa61fe to 3dffbbd Compare February 21, 2026 08:40
Copy link
Collaborator

@IsmailMehdi IsmailMehdi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@totoleon do you think this would be better in your conversion tool ?

@IsmailMehdi IsmailMehdi requested a review from totoleon February 23, 2026 18:46
Copy link
Collaborator

@IsmailMehdi IsmailMehdi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

love the idea, i have a few thoughts:

  • it's really 4 features together, migration, loading, multi eval, result
  • ideally we would need a readme for this stuff
  • can we make loading generic/config driven?
  • multi eval is really needed, maybe instead of a shell script we make it into the product
  • result consolidation is also needed, it would great if we could make it config driven

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants