feat(export): add collection export support (Weaviate 1.37+)#324
Open
mpartipilo wants to merge 5 commits intomainfrom
Open
feat(export): add collection export support (Weaviate 1.37+)#324mpartipilo wants to merge 5 commits intomainfrom
mpartipilo wants to merge 5 commits intomainfrom
Conversation
There was a problem hiding this comment.
Orca Security Scan Summary
| Status | Check | Issues by priority | |
|---|---|---|---|
| Infrastructure as Code | View in Orca | ||
| SAST | View in Orca | ||
| Secrets | View in Orca | ||
| Vulnerabilities | View in Orca |
Summary - Weaviate C# Client CoverageSummary
CoverageWeaviate.Client - 48.9%
Weaviate.Client.Analyzers - 0%
Weaviate.Client.VectorData - 50.3%
|
- Sync openapi.json from weaviate/weaviate v1.37.0 tag (removes Dto.Config from ExportCreateRequest; that field never existed in the stable release) - Regenerate Models.g.cs via NSwag to drop the now-removed Config DTO - Remove Config assignment from BuildExportCreateRequest in ExportClient - Add Path field to Export domain model (matches Python ExportCreateReturn.path) - Update PublicAPI.Unshipped.txt for the new Export constructor signature - Add volatile to BackupOperationBase state fields for thread safety - Document REST DTO generation workflow in CLAUDE.md Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
df57727 to
702d7ad
Compare
…326) Co-authored-by: Claude <noreply@anthropic.com>
…ts to use collection objects
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ExportClientto the C# client, matching the Python PR weaviate/weaviate-python-client#1981BackupClientpattern with operation-based pollingEXPORT_ENABLED=trueWhat's included
Domain models (
Models/Export.cs)ExportFileFormatenum (Parquet)ExportStatusenum (Started, Transferring, Success, Failed, Canceled)ShardExportStatusenum (Transferring, Success, Failed, Skipped)Exportrecord — returned by create/status; includesPath,ShardStatus,TookInMsShardExportProgressrecord — per-shard progress withSkipReasonExportCreateRequestrecord —Id,Backend,FileFormat,IncludeCollections,ExcludeCollectionsClient (
ExportClient.cs)client.Export.Create(request)— starts export, returnsExportOperationfor pollingclient.Export.CreateSync(request)— starts export and waits for completionclient.Export.GetStatus(backend, id)— checks status of an exportclient.Export.Cancel(backend, id)— cancels a running exportExportClient.Config— staticExportClientConfig(poll interval, timeout)REST layer (
Rest/Export.cs,Rest/Endpoints.cs)POST /export/{backend}— createGET /export/{backend}/{id}— statusDELETE /export/{backend}/{id}— cancel (accepts 204 and 409)Operation polling (
Models/ExportOperationBase.cs,Models/ExportOperation.cs)WaitForCompletion(timeout?)andCancel()IDisposable/IAsyncDisposablefor resource cleanupSpec — synced
openapi.jsonfromweaviate/weaviate v1.37.0(stable release removedConfigDTO from export request that appeared in a pre-release spec)Test plan
EXPORT_ENABLED=true(seesrc/Weaviate.Client.Tests/Integration/TestExports.cs)🤖 Generated with Claude Code