27 subscribers
התחל במצב לא מקוון עם האפליקציה Player FM !
פודקאסטים ששווה להאזין
בחסות


1 #697: Building the total experience for customers with AJ Joplin, Forrester 24:10
#12 DoK community: PostgreSQL as a Service on K8s at Zalando // Alexander Kukushkin
Manage episode 283453640 series 2865115
// Abstract: PostgreSQL is a powerful, open-source object-relational database system with over 30 years of active development that has earned it a strong reputation for reliability, feature robustness, and performance, but a production-grade deployment requires many complementary technologies to the database core: high availability and automated failover, backup and recovery, monitoring and alerting, centralized access control and logging, connection pooling, and so on.
Being not initially accustomed for running stateful workloads, Kubernetes with its infrastructure as a code paradigm, CustomResourceDefinition, and Operator pattern turned out to be extremely convenient for deploying and running PostgreSQL at scale.
I will talk about a few open-source project developed and maintained by database team at Zalando which anybody could use to build own PgaaS:
1. https://github.com/zalando/patroni - Tool for PostgreSQL high availability and cluster management. Integrates with K8s API and makes PostgreSQL cloud-native.
2. https://github.com/zalando/spilo - The Docker image that packages Patroni, multiple versions of PostgreSQL, and tools for backup and recovery.
3. https://github.com/zalando/postgres-operator - Implements Kubernetes operator pattern, orchestrates hundreds and thousands deployments of Patroni/Spilo clusters.
Aforementioned projects would never get to the current state without an effort of dozens of external contributors.
// Bio: During his professional career, Alexander touched PostgreSQL from all possible sides: as a Web Developer, as System Administrator, and as a Database Engineer now. Five years ago he started working on Patroni project and achieved quite a big success with it. Nowadays Patroni is used in the heart of PostgreSQL-as-a-Service on Kubernetes at Zalando to run 1000+ PostgreSQL HA clusters. Besides that, Alexander periodically reports bugs and contributes patches to PostgreSQL and some other open-source projects (usually Postgres related).
▬▬▬▬▬▬ Show Notes ▬▬▬▬▬▬
Remember to put your toys away: https://twitter.com/braddwyer/status/1303751133765283840 Getting Write happy and burning out your SSDs https://blog.okmeter.io/real-world-ssd-wearout-a3396a35c663 GitLab Postmortem https://about.gitlab.com/blog/2017/02/10/postmortem-of-database-outage-of-january-31/
▬▬▬▬▬▬ Connect with us 👋 ▬▬▬▬▬▬
Join our slack: https://go.dok.community/slack Follow us on Twitter: @dokcommunity Register for the next meetup: // Register here: https://go.dok.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Alexander on Twitter: https://twitter.com/cyberdemn Connect with Bart on LinkedIn: https://www.linkedin.com/in/bart-farrell/
▬▬▬▬▬▬ Supporters of the DoKc ▬▬▬▬▬▬
This meetup is sponsored by MayaData, which helped start the DOK.community and remains an active supporter. MayaData sponsors two Cloud Native Computing Foundation (CNCF) projects, OpenEBS (http://www.openEBS.io) - the leading open-source container attached storage solution - and Litmus (https://litmuschaos.io/) - the leading Kubernetes native chaos engineering project, which was recently donated to the CNCF as a Sandbox project. As of August 2020, MayaData is the fifth-largest contributor to CNCF projects. Well-known users of MayaData software include the CNCF itself, Bloomberg, Comcast, Arista, Orange, Intuit, and others. Check out more info at https://mayadata.io/
// Final thoughts This is a Fireside chat all audience can participate and ask questions and you can also join the conversation beforehand in our slack group: https://go.dok.community/slack
You can also check out some of our old meetups on youtube here: https://www.youtube.com/channel/UCUnXJbHQ89R2uSfKsqQwGvQ
243 פרקים
Manage episode 283453640 series 2865115
// Abstract: PostgreSQL is a powerful, open-source object-relational database system with over 30 years of active development that has earned it a strong reputation for reliability, feature robustness, and performance, but a production-grade deployment requires many complementary technologies to the database core: high availability and automated failover, backup and recovery, monitoring and alerting, centralized access control and logging, connection pooling, and so on.
Being not initially accustomed for running stateful workloads, Kubernetes with its infrastructure as a code paradigm, CustomResourceDefinition, and Operator pattern turned out to be extremely convenient for deploying and running PostgreSQL at scale.
I will talk about a few open-source project developed and maintained by database team at Zalando which anybody could use to build own PgaaS:
1. https://github.com/zalando/patroni - Tool for PostgreSQL high availability and cluster management. Integrates with K8s API and makes PostgreSQL cloud-native.
2. https://github.com/zalando/spilo - The Docker image that packages Patroni, multiple versions of PostgreSQL, and tools for backup and recovery.
3. https://github.com/zalando/postgres-operator - Implements Kubernetes operator pattern, orchestrates hundreds and thousands deployments of Patroni/Spilo clusters.
Aforementioned projects would never get to the current state without an effort of dozens of external contributors.
// Bio: During his professional career, Alexander touched PostgreSQL from all possible sides: as a Web Developer, as System Administrator, and as a Database Engineer now. Five years ago he started working on Patroni project and achieved quite a big success with it. Nowadays Patroni is used in the heart of PostgreSQL-as-a-Service on Kubernetes at Zalando to run 1000+ PostgreSQL HA clusters. Besides that, Alexander periodically reports bugs and contributes patches to PostgreSQL and some other open-source projects (usually Postgres related).
▬▬▬▬▬▬ Show Notes ▬▬▬▬▬▬
Remember to put your toys away: https://twitter.com/braddwyer/status/1303751133765283840 Getting Write happy and burning out your SSDs https://blog.okmeter.io/real-world-ssd-wearout-a3396a35c663 GitLab Postmortem https://about.gitlab.com/blog/2017/02/10/postmortem-of-database-outage-of-january-31/
▬▬▬▬▬▬ Connect with us 👋 ▬▬▬▬▬▬
Join our slack: https://go.dok.community/slack Follow us on Twitter: @dokcommunity Register for the next meetup: // Register here: https://go.dok.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Alexander on Twitter: https://twitter.com/cyberdemn Connect with Bart on LinkedIn: https://www.linkedin.com/in/bart-farrell/
▬▬▬▬▬▬ Supporters of the DoKc ▬▬▬▬▬▬
This meetup is sponsored by MayaData, which helped start the DOK.community and remains an active supporter. MayaData sponsors two Cloud Native Computing Foundation (CNCF) projects, OpenEBS (http://www.openEBS.io) - the leading open-source container attached storage solution - and Litmus (https://litmuschaos.io/) - the leading Kubernetes native chaos engineering project, which was recently donated to the CNCF as a Sandbox project. As of August 2020, MayaData is the fifth-largest contributor to CNCF projects. Well-known users of MayaData software include the CNCF itself, Bloomberg, Comcast, Arista, Orange, Intuit, and others. Check out more info at https://mayadata.io/
// Final thoughts This is a Fireside chat all audience can participate and ask questions and you can also join the conversation beforehand in our slack group: https://go.dok.community/slack
You can also check out some of our old meetups on youtube here: https://www.youtube.com/channel/UCUnXJbHQ89R2uSfKsqQwGvQ
243 פרקים
All episodes
×
1 Implementing Data & Databases on K8s within the Dutch Government | DoKC Town Hall 44:54

1 Unsticking Ourselves from Glue: Migrating PayIt’s Data Pipelines to Argo Workflows and Hera | DoKC Town Hall 23:17

1 Repel Boarders! How to find a Kubernetes operator that really protects your data | DoKC Town Hall 19:22

1 DoK + Apache Spark | DoKC Town Hall 19:52

1 DoK @ Comcast - Deliver Business Outcomes & Improved DevX with Data Services on K8s | DoKC Town Hall 16:43

1 DoK Talks - What is Kafka? The rise of one of the world's most used streaming data technologies // Abbey Russell 15:28

1 DoK Talks - (almost)Everything you need to know about stateful cloud native network applications // W Watson 43:39

1 The Outer Nerd #001 - Dungeons & Dragons - Why should you care? // Abhi Vaidyanatha, Fabian Met & Chase Christensen 58:25

1 DoK Talks #155 - Databases at the edge with K3s and ARM devices // Sergio Méndez 49:40

1 DoK Talks #154 - StatefulSets in K8 // Srinivas Karnati 31:55

1 Data-driven Diversity, Equity, and Inclusion // Lisa-Marie Namphy, Melissa Logan, Tiffany Jachja, Audra Montenegro & Cortney Nickerson (DoK Day North America 2022) 19:50

1 Formula 1 telemetry processing using Apache Kafka on Kubernetes // Paolo Patierno (DoK Day North America 2022) 15:36

1 Choosing Kubernetes for Stateful Applications // Akshay Ram & Peter Schuurman (DoK Day North America 2022) 18:31

1 Kubernetes 360º - Data driven observability - from Secrets to logs // Ben Hirschberg (DoK Day North America 2022) 17:11

1 Shifting Left Stateful Applications In Kubernetes // Viktor Farcic (DoK Day North America 2022) 15:52

1 Medical - Healthcare Data on Kubernetes // Olyvia Rakshit & Prasad Dorbala (DoK Day North America 2022) 13:41

1 Highly Available Postgres Clusters In Kubernetes // John Long & Jonathan Gonzalez (DoK Day North America 2022) 15:04

1 Inter-Cluster PostreSQL on Kubernetes // Julian Fischer (DoK Day North America 2022) 17:07

1 Open Source Databases on Kubernetes- Best Practices // Peter Zaitsev (DoK Day North America 2022) 16:04

1 The Kubernetes Native Database // Jeffrey Carpenter (DoK Day North America 2022) 16:26

1 Databases on Kubernetes: Why are they important? // With Bhavin Shah, Xing Yang, Gabriele Bartolini & Patrick McFadin (DoK Day North America 2022) 34:51

1 Data streaming on Kubernetes // Yaniv Ben Hemo (DoK Day North America 2022) 13:51

1 Architecting Your First Event Driven Serverless Streaming Applications on K8 // Timothy Spann (DoK Day North America 2022) 13:29

1 Fybrik - A Kubernetes based platform for governed data use // Flora Gilboa-Solomon, Alexey Roytman, Maryna Strelchuk & Barry Hijkoop (DoK Day North America 2022) 20:59

1 The Challenges of Data Processing On Kubernetes - A look at Spark, Flink, Dask, and Ray // Holden Karau (DoK Day North America 2022) 20:09

1 Scaling our SaaS offering to thousands of clusters // Dax McDonald (DoK Day North America 2022) 21:04

1 Why we decided to migrate our Jaeger storage to ClickHouse on Kubernetes // Arul Jegadish Francis (DoK Day North America 2022) 13:48

1 Building a Digital Factory for the Sheet Metal Industry // Elie Assi (From the DoK Day North America 2022) 20:48

1 How we built our Big Data Stack (almost) entirely on top of Kubernetes // Neylson Crepalde (From DoK Day NA 2022) 16:00

1 Dok Talks #153 - CRD Panel // Eyar Zilberman & Álvaro Hernández 58:05
ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.