Skip to content

[Feature] Support Mosaic file format #236

Description

@lxy-9602

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Apache Paimon Java 2.0 supports Mosaic, a hybrid format designed for wide tables using column bucketing and parallel I/O. Paimon C++ cannot currently access tables using this format.

Solution

Add Mosaic support to the Paimon C++ file-format SPI:

  • Register the mosaic file-format factory.
  • Implement compatible schema, reader, writer, and statistics handling.
  • Support column projection and Mosaic column-bucket metadata.
  • Add C++ round-trip tests and Java-produced file compatibility tests.

Anything else?

We will also support formats such as Lance and Vortex in the future.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions