Data transforms and self-service config do not work on Redpanda Cloud Serverless clusters

TL;DR

Set only properties from the Cloud 'Cluster Configuration Properties' reference; anything Redpanda manages returns REASONINVALIDINPUT. Expect restart-requiring properties to return a long-running operation ID and take several minutes. Before deploying a transform to Redpanda Cloud, confirm the cluster is BYOC or Dedicated on AWS or GCP and on Redpanda 24.3+; do not deploy to Serverless.

Fix

1. Set only properties from the Cloud 'Cluster Configuration Properties' reference; anything Redpanda manages returns REASONINVALIDINPUT. Expected: You get the expected result; the problem is gone.

2. Expect restart-requiring properties to return a long-running operation ID and take several minutes. Expected: You get the expected result; the problem is gone.

When to use

• You are dealing with this situation.
• The symptom matches: Data transforms and self-service config do not work on Redpanda Cloud Serverless clusters.

When NOT to use

• Unrelated issues with a different cause.
• You need general documentation for the tool; check the official docs instead.

Compatibility

Reported per the linked source (mentions 24.3, 25.1.2).

Variant phrasings

Data transforms and self-service config do not work on Redpanda Cloud Serverless clusters

Why it happens

Official docs (redpanda-data/skills, rpk-transform skill): documents the Serverless-limits gotcha that trips agents deploying data transforms. Data transforms are supported on BYOC and Dedicated clusters running Redpanda 24.3+, but Serverless is not listed as supported, so transforms should not be deployed there. Self-service cluster config via rpk requires rpk 25.1.2+ and Redpanda 25.1.2+, works only on BYOC/Dedicated on AWS and GCP (not Azure, not Serverless), and only a curated subset of datatransforms* properties is settable; the rest returns REASONINVALIDINPUT.

Edge cases

• If your error message differs even slightly, this is probably a different issue; search the exact text.
• Behavior can change between releases; the linked source reflects the versions above.
• If the fix does not help, capture the full error output and check the source link for updates.

Source: Official docs (redpanda-data/skills, rpk-transform skill): documents the Serverless-limits gotcha that trips agents deploying data transforms. Data transforms are supported on BYOC and Dedicated clusters running Redpanda 24.3+, but Serverless is not listed as supported, so transforms should not be deployed there. Self-service cluster config via rpk requires rpk 25.1.2+ and Redpanda 25.1.2+, works only on BYOC/Dedicated on AWS and GCP (not Azure, not Serverless), and only a curated subset of datatransforms* properties is settable; the rest returns REASONINVALIDINPUT.

Verified resolution: Before deploying a transform to Redpanda Cloud, confirm the cluster is BYOC or Dedicated on AWS or GCP and on Redpanda 24.3+; do not deploy to Serverless. Run rpk cloud login and select the cluster first, since Cloud config changes go through the control plane, not the broker Admin API. Set only properties from the Cloud 'Cluster Configuration Properties' reference; anything Redpanda manages returns REASONINVALIDINPUT. Expect restart-requiring properties to return a long-running operation ID and take several minutes.

Source URL: https://github.com/redpanda-data/skills/blob/HEAD/skills/rpk-transform/SKILL.md