K8SPG-864: add `sidecarPVCs` and `sidecarVolumes` by pooknull · Pull Request #1394 · percona/percona-postgresql-operator

pooknull · 2026-01-08T10:13:28Z

https://perconadev.atlassian.net/browse/K8SPG-864

DESCRIPTION

This PR adds the following fields to the cr.yaml:

.spec.instances[].sidecarPVCs
.spec.instances[].sidecarVolumes
.spec.proxy.pgBouncer.sidecarPVCs
.spec.proxy.pgBouncer.sidecarVolumes
.spec.backups.pgbackrest.repoHost.sidecarPVCs
.spec.backups.pgbackrest.repoHost.sidecarVolumes

The sidecarPVCs field defines PersistentVolumeClaims that should be created and associated with a specific resource. Example:

sidecarPVCs:
- name: sidecar-volume-claim
  spec:
    resources:
      requests:
        storage: 1Gi
    volumeMode: Filesystem
    accessModes:
      - ReadWriteOnce

The sidecarVolumes field defines volumes that should be attached to a specific resource. Example:

sidecarVolumes:
- name: sidecar-secret
  secret:
    secretName: mysecret
- name: sidecar-config
  configMap:
    name: myconfigmap
- name: backup-nfs
  nfs:
    server: "nfs-service.storage.svc.cluster.local"
    path: "/pg-some-name"

Helm PR: percona/percona-helm-charts#783

CHECKLIST

Jira

Is the Jira ticket created and referenced properly?
Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

Is an E2E test/test case added for the new feature/change?
Are unit tests added where appropriate?

Config/Logging/Testability

Are all needed new/changed options added to default YAML files?
Are all needed new/changed options added to the Helm Chart?
Did we add proper logging messages for operator actions?
Did we ensure compatibility with the previous version or cluster upgrade process?
Does the change support oldest and newest supported PG version?
Does the change support oldest and newest supported Kubernetes version?

https://perconadev.atlassian.net/browse/K8SPG-864

egegunes · 2026-01-14T05:41:31Z

internal/controller/postgrescluster/instance.go

+	if cluster.CompareVersion("2.9.0") >= 0 {
+		for _, p := range spec.SidecarPVCs {
+			instance.Spec.VolumeClaimTemplates = append(instance.Spec.VolumeClaimTemplates, corev1.PersistentVolumeClaim{
+				ObjectMeta: metav1.ObjectMeta{Name: p.Name},
+				Spec:       p.Spec,
+			})
+		}
+	}


does this mean that users can only add sidecar PVCs while creating clusters? i guess we had the same limitation in other operators.

egegunes · 2026-01-14T05:43:55Z

percona/controller/pgcluster/pvc.go

+		if err := cl.Create(ctx, pvc); err != nil {
+			return errors.Wrapf(err, "create PVC %s", client.ObjectKeyFromObject(pvc).String())
+		}


but if we are creating PVCs ourselves why don't we just add them into statefulset volumes so they can also be added after cluster creation?

ok, i now realized we're doing this only for pgbouncer because it's a deployment. but if we do this for all, we'd overcome the limitation of adding sidecar pvcs after creation

egegunes · 2026-02-03T10:32:58Z

build/crd/crunchy/generated/postgres-operator.crunchydata.com_postgresclusters.yaml

i don't think we should downgrade

egegunes · 2026-02-11T05:57:02Z

hack/tools/.gitignore

why this was deleted?

gkech · 2026-02-11T11:36:41Z

percona/controller/pgcluster/pvc.go

+		pvc := new(corev1.PersistentVolumeClaim)
+		pvc.Name = sidecarPVC.Name
+		pvc.Namespace = namespace
+		pvc.Spec = sidecarPVC.Spec


should we have some sort of labels added here so that we know that these pvcs are created by the operator?

gkech · 2026-02-11T11:37:16Z

percona/controller/pgcluster/pvc.go

+		err := cl.Get(ctx, client.ObjectKeyFromObject(pvc), &corev1.PersistentVolumeClaim{})
+		if err == nil {
+			// already exists
+			continue


What should happen if the pvcs are updated in terms of specs? should we update them of skip?

gkech · 2026-02-11T11:54:14Z

let's check also why unit tests are failing on this pr

Run make check
REGISTRY_NAME is not set
Updated IMAGE to: docker.io/perconalab/percona-postgresql-operator:head
docker.io/perconalab/percona-postgresql-operator:head
git -C 'hack/tools/' clone https://github.com/CrunchyData/pgmonitor.git || git -C 'hack/tools/pgmonitor' fetch origin
fatal: cannot change to 'hack/tools/': No such file or directory
fatal: cannot change to 'hack/tools/pgmonitor': No such file or directory
make: *** [Makefile:49: get-pgmonitor] Error 128
Error: Process completed with exit code 2.

Copilot

Pull request overview

Adds support for configuring extra volumes and operator-managed PVCs for sidecar containers across instance pods, pgBouncer, and pgBackRest repoHost, along with the necessary API/plumbing, RBAC, and tests.

Changes:

Extend CRDs/types with sidecarVolumes and sidecarPVCs for instances, pgBouncer, and pgBackRest repoHost.
Reconcile pod specs to mount the configured sidecar volumes/PVCs, and add a controller reconciler to create/update the defined PVCs.
Update RBAC and sidecar-related unit/E2E tests to cover the new fields.

Reviewed changes

Copilot reviewed 20 out of 28 changed files in this pull request and generated 10 comments.

Show a summary per file

File	Description
pkg/apis/postgres-operator.crunchydata.com/v1beta1/zz_generated.deepcopy.go	Deepcopy updates for new fields and new `SidecarPVC` type.
pkg/apis/postgres-operator.crunchydata.com/v1beta1/postgrescluster_types.go	Adds `sidecarVolumes/sidecarPVCs` to instance set spec + defines `SidecarPVC`.
pkg/apis/postgres-operator.crunchydata.com/v1beta1/pgbouncer_types.go	Adds `sidecarVolumes/sidecarPVCs` to pgBouncer pod spec.
pkg/apis/postgres-operator.crunchydata.com/v1beta1/pgbackrest_types.go	Adds `sidecarVolumes/sidecarPVCs` to pgBackRest repoHost spec.
pkg/apis/pgv2.percona.com/v2/zz_generated.deepcopy.go	Deepcopy updates for new Percona API fields.
pkg/apis/pgv2.percona.com/v2/perconapgcluster_types.go	Adds Percona-level fields and maps them through `ToCrunchy()`.
percona/controller/pgcluster/pvc.go	New reconciler to create/update PVCs declared via `sidecarPVCs`.
percona/controller/pgcluster/controller_test.go	Extends sidecar tests to assert volumes + PVC-backed volumes are present.
percona/controller/pgcluster/controller.go	Calls PVC reconciler and adds PVC RBAC marker.
internal/postgres/reconcile.go	Adds `sidecarVolumes` to instance pods (version-gated).
internal/pgbouncer/reconcile.go	Adds `sidecarVolumes` and PVC-backed volumes to pgBouncer pod spec (version-gated).
internal/controller/postgrescluster/pgbackrest.go	Adds `sidecarVolumes` and PVC-backed volumes to repoHost pod template (version-gated).
internal/controller/postgrescluster/instance.go	Adds PVC-backed volumes to instance StatefulSet pod template (version-gated).
e2e-tests/tests/sidecars/01-create-cluster.yaml	Sets `sidecarVolumes/sidecarPVCs` fields in the sidecars E2E test.
e2e-tests/tests/sidecars/01-assert.yaml	Adds assertions for PVC creation/binding in the sidecars E2E test.
deploy/rbac.yaml	Grants PVC verbs in deployment RBAC.
deploy/cw-rbac.yaml	Same RBAC updates for cw deployment.
config/rbac/namespace/role.yaml	Grants PVC verbs in generated namespace Role.
config/rbac/cluster/role.yaml	Grants PVC verbs in generated cluster Role.
Makefile	Minor formatting/line fix in after-release target.

Copilot · 2026-02-13T12:31:07Z

pkg/apis/postgres-operator.crunchydata.com/v1beta1/pgbouncer_types.go

+	// K8SPG-864
+	SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`
+	// K8SPG-864


These new API fields are declared with omitempty but are missing the // +optional marker that is used throughout this API type for optional fields. Add // +optional so CRD generation/markers remain consistent with surrounding fields.

Suggested change

// K8SPG-864

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// K8SPG-864

// +optional

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// +optional

Copilot · 2026-02-13T12:31:07Z

pkg/apis/pgv2.percona.com/v2/perconapgcluster_types.go


+	SidecarVolumes []corev1.Volume             `json:"sidecarVolumes,omitempty"`


These newly added spec fields don't have the // +optional marker used for other optional fields in this API type. Add // +optional to keep CRD generation/markers consistent and make intent explicit.

Suggested change

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// +optional

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// +optional

Copilot · 2026-02-13T12:31:07Z

percona/controller/pgcluster/pvc.go

+			if err := cl.Create(ctx, pvc); err != nil {
+				return errors.Wrap(err, "failed to create pvc")
+			}
+			return nil


ensureSidecarPVCs exits the whole function after creating the first missing PVC (return nil inside the loop). This prevents creation/update of any subsequent PVCs in the same pvcs slice during the same reconcile. Replace the early return with continue (or restructure) so the loop processes all entries and the function returns nil only after finishing.

Suggested change

return nil

continue

Copilot · 2026-02-13T12:31:07Z

internal/controller/postgrescluster/instance.go

+	// K8SPG-864
+	if cluster.CompareVersion("2.9.0") >= 0 {
+		for _, v := range spec.SidecarPVCs {
+			instance.Spec.Template.Spec.Volumes = append(instance.Spec.Template.Spec.Volumes, corev1.Volume{
+				Name: v.Name,
+				VolumeSource: corev1.VolumeSource{
+					PersistentVolumeClaim: &corev1.PersistentVolumeClaimVolumeSource{
+						ClaimName: v.Name,
+					},
+				},
+			})
+		}
+	}


Instance SidecarPVC volumes are added based only on CR version, not the same feature gate used for instance sidecars (feature.InstanceSidecars) and not conditioned on sidecars actually being configured. Consider gating this block consistently (and/or only adding PVC volumes when sidecars are enabled) to avoid creating unused volumes and to match how SidecarVolumes are handled.

Copilot · 2026-02-13T12:31:08Z

pkg/apis/postgres-operator.crunchydata.com/v1beta1/pgbackrest_types.go

+	// K8SPG-864
+	SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`
+	// K8SPG-864


These new API fields are declared with omitempty but are missing the // +optional marker that is used throughout this API type for optional fields. Add // +optional so CRD generation/markers remain consistent with surrounding fields.

Suggested change

// K8SPG-864

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// K8SPG-864

// +optional

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// +optional

Copilot · 2026-02-13T12:31:08Z

pkg/apis/pgv2.percona.com/v2/perconapgcluster_types.go


+	SidecarVolumes []corev1.Volume             `json:"sidecarVolumes,omitempty"`


These newly added spec fields don't have the // +optional marker used for other optional fields in this API type. Add // +optional to keep CRD generation/markers consistent and make intent explicit.

Suggested change

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// +optional

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// +optional

Copilot · 2026-02-13T12:31:08Z

percona/controller/pgcluster/pvc.go

+				return err
+			}
+			maps.Copy(pvc.Labels, ls)
+
+			// It's only allowed to update resources.requests and volumeAttributesClassName
+			pvc.Spec.Resources.Requests = sidecarPVC.Spec.Resources.Requests
+			pvc.Spec.VolumeAttributesClassName = sidecarPVC.Spec.VolumeAttributesClassName


maps.Copy(pvc.Labels, ls) will panic if pvc.Labels is nil (possible for existing PVCs created without labels or with labels cleared). Initialize pvc.Labels to an empty map before copying/merging labels.

Copilot · 2026-02-13T12:31:09Z

percona/controller/pgcluster/controller.go

 // +kubebuilder:rbac:groups=pgv2.percona.com,resources=perconapgclusters/finalizers,verbs=update
 // +kubebuilder:rbac:groups=batch,resources=jobs,verbs=create;list;update
 // +kubebuilder:rbac:groups="",resources="pods",verbs=create;delete
+// +kubebuilder:rbac:groups="",resources="persistentvolumeclaims",verbs=create;update


The kubebuilder RBAC marker for PersistentVolumeClaims only grants create/update, but the reconciler also does Get (and controller-runtime typically needs list/watch for caching). Update the marker to include at least get;list;watch;create;update (and patch if used) so generated RBAC matches the controller behavior.

Suggested change

// +kubebuilder:rbac:groups="",resources="persistentvolumeclaims",verbs=create;update

// +kubebuilder:rbac:groups="",resources="persistentvolumeclaims",verbs=get;list;watch;create;update

Copilot · 2026-02-13T12:31:09Z

e2e-tests/tests/sidecars/01-assert.yaml

+    postgres-operator.crunchydata.com/cluster: sidecars
+    postgres-operator.crunchydata.com/pgbackrest: ""
+    postgres-operator.crunchydata.com/pgbackrest-dedicated: ""
+  name: sidecar-repohost-claim-sidecars-repo-host-0


The asserted PVC name here (sidecar-repohost-claim-sidecars-repo-host-0) does not match the PVC name configured in the test setup (sidecar-repohost-claim) nor the controller logic which creates/uses PVCs by the provided name. This is likely to make the e2e test flaky/failing; align the expected name with the actual PVC name that will be created/mounted.

Suggested change

name: sidecar-repohost-claim-sidecars-repo-host-0

name: sidecar-repohost-claim

Copilot · 2026-02-13T12:31:09Z

pkg/apis/postgres-operator.crunchydata.com/v1beta1/postgrescluster_types.go

+	// K8SPG-864
+	SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`
+	// K8SPG-864


These new API fields are declared with omitempty but are missing the // +optional marker that is used throughout this API type for optional fields. Add // +optional so CRD generation/markers remain consistent with surrounding fields.

Suggested change

// K8SPG-864

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// K8SPG-864

// +optional

SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

// K8SPG-864

// +optional

JNKPercona · 2026-02-13T14:32:28Z

Test Name	Result	Time
backup-enable-disable	passed	00:00:00
builtin-extensions	passed	00:00:00
custom-envs	passed	00:00:00
custom-extensions	passed	00:00:00
custom-tls	passed	00:00:00
database-init-sql	passed	00:00:00
demand-backup	passed	00:00:00
finalizers	passed	00:00:00
init-deploy	passed	00:00:00
huge-pages	passed	00:00:00
monitoring	passed	00:00:00
monitoring-pmm3	passed	00:00:00
one-pod	passed	00:00:00
operator-self-healing	passed	00:00:00
pitr	passed	00:00:00
scaling	passed	00:00:00
scheduled-backup	passed	00:00:00
self-healing	passed	00:00:00
sidecars	failure	00:04:29
standby-pgbackrest	passed	00:00:00
standby-streaming	passed	00:00:00
start-from-backup	passed	00:00:00
tablespaces	passed	00:00:00
telemetry-transfer	passed	00:00:00
upgrade-consistency	passed	00:00:00
upgrade-minor	passed	00:00:00
users	passed	00:00:00

Summary	Value
Tests Run	27/27
Job Duration	00:23:02
Total Test Time	00:04:29

commit: 608e287
image: perconalab/percona-postgresql-operator:PR-1394-608e2878a

hors

@pooknull please check sidecars test

K8SPG-864: add sidecarPVCs and sidecarVolumes

d56fcaf

https://perconadev.atlassian.net/browse/K8SPG-864

pooknull force-pushed the K8SPG-864 branch from cae7770 to d56fcaf Compare January 8, 2026 10:15

pooknull added 2 commits January 9, 2026 13:39

revert kustomize and controller-gen updates

ca506c1

fix unit-test

c4be734

pooknull marked this pull request as ready for review January 13, 2026 09:50

pooknull requested review from egegunes, eleo007, gkech, hors, jvpasinatto, nmarukovich and valmiranogueira as code owners January 13, 2026 09:50

egegunes reviewed Jan 14, 2026

View reviewed changes

don't use volumeClaimTemplates

fb1cad2

pooknull requested review from bogdanjeler-ev, mayankshah1607 and oksana-grishchenko as code owners January 28, 2026 11:06

pooknull requested a review from egegunes January 28, 2026 11:09

pooknull added 2 commits January 28, 2026 13:22

Merge remote-tracking branch 'origin/main' into K8SPG-864

57a2553

make generate

2190767

egegunes requested changes Feb 3, 2026

View reviewed changes

pooknull added 2 commits February 10, 2026 13:32

make manifests

de3bcda

Merge branch 'main' into K8SPG-864

d26ddd8

pooknull requested a review from egegunes February 10, 2026 11:56

Merge remote-tracking branch 'origin/main' into K8SPG-864

93c1b32

egegunes requested changes Feb 11, 2026

View reviewed changes

gkech reviewed Feb 11, 2026

View reviewed changes

pooknull added 2 commits February 12, 2026 14:09

add labels

b10f5da

revert .gitignore

772b800

egegunes added this to the v2.9.0 milestone Feb 12, 2026

allow updating the pvc

cbc67f5

Copilot AI review requested due to automatic review settings February 13, 2026 12:23

Merge branch 'main' into K8SPG-864

608e287

Copilot started reviewing on behalf of pooknull February 13, 2026 12:23 View session

pooknull requested review from egegunes and gkech February 13, 2026 12:24

Copilot AI reviewed Feb 13, 2026

View reviewed changes

hors requested changes Feb 13, 2026

View reviewed changes


		SidecarVolumes []corev1.Volume `json:"sidecarVolumes,omitempty"`

	// +kubebuilder:rbac:groups="",resources="persistentvolumeclaims",verbs=create;update
	// +kubebuilder:rbac:groups="",resources="persistentvolumeclaims",verbs=get;list;watch;create;update

	name: sidecar-repohost-claim-sidecars-repo-host-0
	name: sidecar-repohost-claim

Conversation

pooknull commented Jan 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

DESCRIPTION

CHECKLIST

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

gkech commented Feb 11, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

JNKPercona commented Feb 13, 2026

Uh oh!

hors left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

pooknull commented Jan 8, 2026 •

edited

Loading