DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

Data on Kubernetes Community

https://go.dok.community/slack
https://dok.community/
ABSTRACT OF THE TALK
How to build a stateful, transactional streaming storage engine on top of kubernetes.
KEY TAKE-AWAYS FROM THE TALK
1. Building storage engines in kubernetes is hard
2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
3. You also need sound replication inside the cluster
4. You need a simple architecture so you can scale the pods easily
BIO
Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.