Tansu, an open-source, Apache Kafka-compatible messaging broker, challenges traditional approaches by prioritizing statelessness. Instead of replicating data like Kafka, Tansu delegates durability to external storage, allowing for brokers that are lightweight ("cattle," not "pets") and scale rapidly. It supports various storage backends like S3, SQLite, and Postgres, with a particular emphasis on Postgres integration for streamlined data pipelines. Tansu also offers broker-side schema validation and the ability to directly write validated data to open table formats like Iceberg, Delta Lake, or Parquet. The project is written in Rust and seeks contributors.
