Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion modules/ROOT/nav.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -355,7 +355,7 @@
** xref:sql:query-data/index.adoc[Query Data]
*** xref:sql:query-data/redpanda-catalogs.adoc[Redpanda Catalogs]
*** xref:sql:query-data/query-streaming-topics.adoc[Query Streaming Topics]
*** xref:sql:query-data/query-iceberg-topics.adoc[Query Iceberg Topics]
*** xref:sql:query-data/query-iceberg-topics.adoc[Query Iceberg-enabled Topics]
** xref:sql:manage/index.adoc[Manage Redpanda SQL]
*** xref:sql:manage/manage-access.adoc[Manage access]
** xref:sql:troubleshoot/index.adoc[Troubleshoot]
Expand Down Expand Up @@ -543,16 +543,19 @@
** xref:reference:sql/index.adoc[Redpanda SQL Reference]
*** xref:reference:sql/sql-statements/keywords.adoc[]
*** xref:reference:sql/sql-statements/index.adoc[Statements]
**** xref:reference:sql/sql-statements/alter-iceberg-catalog.adoc[]
**** xref:reference:sql/sql-statements/alter-redpanda-catalog.adoc[]
**** xref:reference:sql/sql-statements/alter-storage.adoc[]
**** xref:reference:sql/sql-statements/alter-table.adoc[]
**** xref:reference:sql/sql-statements/alter-user.adoc[]
**** xref:reference:sql/sql-statements/copy-to.adoc[]
**** xref:reference:sql/sql-statements/create-iceberg-catalog.adoc[]
**** xref:reference:sql/sql-statements/create-redpanda-catalog.adoc[]
**** xref:reference:sql/sql-statements/create-storage.adoc[]
**** xref:reference:sql/sql-statements/create-table.adoc[]
**** xref:reference:sql/sql-statements/create-user.adoc[]
**** xref:reference:sql/sql-statements/describe.adoc[]
**** xref:reference:sql/sql-statements/drop-iceberg-catalog.adoc[]
**** xref:reference:sql/sql-statements/drop-redpanda-catalog.adoc[]
**** xref:reference:sql/sql-statements/drop-storage.adoc[]
**** xref:reference:sql/sql-statements/drop-table.adoc[]
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
= ALTER ICEBERG CATALOG
:description: The ALTER ICEBERG CATALOG statement modifies connection properties of an existing Iceberg catalog.
:page-topic-type: reference

The `ALTER ICEBERG CATALOG` statement modifies connection properties of an existing Iceberg catalog. You must repeat the `STORAGE` clause when altering, even if the storage connection is not changing.

== Syntax

[source,sql]
----
ALTER ICEBERG CATALOG [IF EXISTS] catalog_name STORAGE storage_name
WITH (option = 'value' [, ...]);
----

* `catalog_name`: Name of the Iceberg catalog to modify.
* `IF EXISTS`: Optional. Prevents an error if the Iceberg catalog does not exist.
* `storage_name`: Name of the storage connection backing the catalog.
* `option = 'value'`: One or more connection options to update. See xref:reference:sql/sql-statements/create-iceberg-catalog.adoc[CREATE ICEBERG CATALOG] for the full list of options.

== Examples

Update the REST catalog URI for an existing Iceberg catalog:

[source,sql]
----
ALTER ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (uri = 'https://new-catalog.example.com');
----

Rotate the basic-authentication credentials on an existing Iceberg catalog:

[source,sql]
----
ALTER ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
auth_type = 'basic',
username = '<new-username>',
password = '<new-password>'
);
----
Original file line number Diff line number Diff line change
@@ -0,0 +1,210 @@
= CREATE ICEBERG CATALOG
:description: The CREATE ICEBERG CATALOG statement creates a named connection to an Iceberg REST catalog, enabling Redpanda SQL to query Iceberg-committed topic data.
:page-topic-type: reference

The `CREATE ICEBERG CATALOG` statement creates a named connection to an Iceberg REST catalog. Link the Iceberg catalog to a Redpanda catalog with `USING CATALOG` so that queries against the linked Redpanda catalog return both live and Iceberg-committed records. Standalone querying against an Iceberg catalog is not supported. See xref:sql:query-data/query-iceberg-topics.adoc[Query Iceberg-enabled Topics] for the end-to-end workflow.

The statement requires an existing xref:reference:sql/sql-statements/create-storage.adoc[storage connection] that holds the object-storage credentials for the Iceberg warehouse.

== Syntax

[source,sql]
----
CREATE ICEBERG CATALOG [IF NOT EXISTS] catalog_name STORAGE storage_name
WITH (option = 'value' [, ...]);
----

* `catalog_name`: Name for the new Iceberg catalog.
* `IF NOT EXISTS`: Optional. Prevents an error if an Iceberg catalog with the same name already exists.
* `storage_name`: Name of an existing storage connection. Create it first with xref:reference:sql/sql-statements/create-storage.adoc[CREATE STORAGE].

NOTE: Catalogs are created in the current schema (`public` by default). To create a catalog in a different schema, qualify the name as `schema.catalog_name`. The auto-created `default_iceberg_catalog` is in `public`.

== Options

[cols="<30%,<15%,<10%,<45%",options="header"]
|===
|Option |Type |Required |Description

|`uri`
|STRING
|Yes
|REST catalog endpoint URI.

|`warehouse`
|STRING
|No
|Iceberg warehouse identifier or location.

|`auth_type`
|STRING
|No
|Authentication type for the REST catalog. One of `oauth2`, `basic`, or `aws_sigv4`. If omitted, the catalog connects without authentication. Providing an auth-specific option (such as `username` or `aws_region`) without `auth_type` is rejected.

|`oauth2_client_id`
|STRING
|Required when `auth_type = 'oauth2'`
|OAuth2 client ID.

|`oauth2_client_secret`
|STRING
|Required when `auth_type = 'oauth2'`
|OAuth2 client secret.

|`oauth2_scope`
|STRING
|No
|OAuth2 scope to request.

|`oauth2_token_endpoint_url`
|STRING
|No
|OAuth2 token endpoint URL. Use to override the catalog's default token endpoint.

|`oauth2_token_refresh_margin_seconds`
|INTEGER
|No
|Number of seconds before token expiry to refresh. Must be between 0 and 2147483647.

|`username`
|STRING
|Required when `auth_type = 'basic'`
|Basic authentication username.

|`password`
|STRING
|Required when `auth_type = 'basic'`
|Basic authentication password.

|`aws_region`
|STRING
|Required when `auth_type = 'aws_sigv4'`
|AWS region for SigV4 request signing (for example, `us-west-2`).

|`aws_access_key_id`
|STRING
|No
|AWS access key ID for SigV4 signing. Must be set together with `aws_secret_access_key`. If both are omitted, the catalog uses the AWS default credential chain (environment variables, shared config, STS web identity, IMDSv2/ECS).

|`aws_secret_access_key`
|STRING
|No
|AWS secret access key for SigV4 signing. See `aws_access_key_id` for credential-chain behavior.

|`ssl_verify`
|STRING
|No
|`'true'` (default) or `'false'`. Whether to verify the REST catalog's TLS certificate.

|`ssl_ca_info`
|STRING
|No
|Path to a CA certificate file used to verify the REST catalog's TLS certificate.

|`ssl_ca_path`
|STRING
|No
|Path to a directory containing CA certificates.

|`ssl_crl_file`
|STRING
|No
|Path to a certificate revocation list (CRL) file.
|===

== Examples

=== Create a basic Iceberg catalog

Connect to a REST catalog without authentication. The catalog uses TLS verification by default.

[source,sql]
----
CREATE ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
uri = 'https://catalog.example.com',
warehouse = 's3://warehouse/'
);
----

=== Create an Iceberg catalog with OAuth2 authentication

[source,sql]
----
CREATE ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
uri = 'https://catalog.example.com',
warehouse = 's3://lakehouse-data/',
auth_type = 'oauth2',
oauth2_client_id = '<client-id>',
oauth2_client_secret = '<client-secret>',
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would we tell users to create and reference secrets here in the same way we do for RP Cloud secrets such as for catalog credentials in the cluster config, like so? https://deploy-preview-575--rp-cloud.netlify.app/redpanda-cloud/manage/iceberg/use-iceberg-catalogs/#use-a-secret-in-cluster-configuration

oauth2_scope = 'PRINCIPAL_ROLE:ALL',
oauth2_token_endpoint_url = 'https://auth.example.com/token',
oauth2_token_refresh_margin_seconds = 300
);
----

=== Create an Iceberg catalog with basic authentication

[source,sql]
----
CREATE ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
uri = 'https://catalog.example.com',
warehouse = 's3://warehouse/',
auth_type = 'basic',
username = '<username>',
password = '<password>'
);
----

=== Create an Iceberg catalog with AWS SigV4 authentication

Use for REST catalogs fronted by AWS services (such as AWS Glue).

[source,sql]
----
CREATE ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
uri = 'https://catalog.example.com',
warehouse = 's3://warehouse/',
auth_type = 'aws_sigv4',
aws_region = 'us-west-2',
aws_access_key_id = '<access-key-id>',
aws_secret_access_key = '<secret-access-key>'
);
----

To use the AWS default credential chain (for example, an EC2 instance-profile role), omit `aws_access_key_id` and `aws_secret_access_key`. They must be set together or omitted together.

=== Create an Iceberg catalog with custom TLS settings

[source,sql]
----
CREATE ICEBERG CATALOG lakehouse_catalog STORAGE iceberg_storage
WITH (
uri = 'https://catalog.example.com',
warehouse = 's3://warehouse/',
ssl_verify = 'true',
ssl_ca_info = '/etc/ssl/certs/catalog-ca.pem'
);
----

== Related statements

[cols="<40%,<60%",options="header"]
|===
|Statement |Description

|xref:reference:sql/sql-statements/alter-iceberg-catalog.adoc[ALTER ICEBERG CATALOG]
|Modify connection properties of an existing Iceberg catalog.

|xref:reference:sql/sql-statements/drop-iceberg-catalog.adoc[DROP ICEBERG CATALOG]
|Remove an Iceberg catalog.

|xref:reference:sql/sql-statements/create-storage.adoc[CREATE STORAGE]
|Create the storage connection that backs the Iceberg catalog.

|xref:reference:sql/sql-statements/create-redpanda-catalog.adoc[CREATE REDPANDA CATALOG]
|Create a Redpanda catalog. Use `USING CATALOG` to link a Redpanda catalog to an Iceberg catalog so that queries return both live and Iceberg-committed records.
|===
Loading