Architecture

Bufstream is a Kafka-compatible message queue that uses object storage for data persistence and PostgreSQL for coordination, decoupling compute from storage while eliminating the need for ZooKeeper or KRaft.

The following architecture guides provide deeper insights into how it works:

• Kafka data flow: How Bufstream combines object storage and a metadata service to support Kafka's producer and consumer data flows.
• Network architecture: How Bufstream is air-gapped within your VPC and guides for connecting clients both within and outside the same Kubernetes cluster.