WarpStream

WarpStream: Confluent's Bring-Your-Own-Cloud Kafka

Confluent 17,245 acquired WarpStream on 9 September 2024 and sells it beside Confluent Cloud 17,245 as a bring-your-own-cloud (BYOC) product. WarpStream speaks the Kafka 129 protocol but has no brokers with disks: stateless agents run in your own cloud account, accept produce and fetch requests, and write batches straight to an object-storage bucket you own; a control plane run by WarpStream orders those batches and keeps the metadata (topics, offsets, consumer groups).

WarpStream's split: data stays in your account, metadata goes to the vendor's control plane
WarpStream's split: data stays in your account, metadata goes to the vendor's control plane

The design trades latency for cost and simplicity. Because the bucket replicates data across zones, agents need no inter-zone replication traffic, a large line on a self-managed Kafka bill in the cloud, and any agent can serve any partition, so scaling is adding or removing stateless containers. In exchange, every produce waits for an object-storage write: WarpStream's own figures give a median produce latency of 250 ms (500 ms at the 99th percentile) and 500 ms end to end, far slower than brokers writing to local disks. The control plane also means your cluster depends on a vendor service, though your data never leaves your account.

Pricing has no per-agent, per-core or per-partition fee. You pay WarpStream for uncompressed data written, from $0.01 per GiB for the first 50 TiB a month, and for cluster time by tier: Dev about $100 a month (no SLA, 4,096 partitions), Fundamentals $500 (99.9%), Pro $1,500 (99.99%), Enterprise quoted. The compute for the agents and the bucket's storage and requests are on your own cloud bill. WarpStream advertises $400 of non-expiring credit with no credit card, but the agents still need somewhere to run; it was not run here. It suits high-volume, latency-tolerant streams such as logs, clickstreams and CDC feeds into a lakehouse, not BookNest's checkout events, where a customer is waiting.