Sharding

Postgres FM

Nikolay and Michael discuss sharding Postgres — what it means, why and when it's needed, and the available options right now.
Here are some links to some things they mentioned:

• PGSQL Friday monthly blogging event https://www.pgsqlphriday.com/
• Did “sharding” come from Ultima Online? https://news.ycombinator.com/item?id=23438399
• Our episode on partitioning: https://postgres.fm/episodes/partitioning
• Vitess https://vitess.io/
• Citus https://www.citusdata.com/
• Lessons learned from sharding Postgres (Notion 2021) https://www.notion.so/blog/sharding-postgres-at-notion
• The Great Re-shard (Notion 2023) https://www.notion.so/blog/the-great-re-shard
• The growing pains of database architecture (Figma 2023) https://www.figma.com/blog/how-figma-scaled-to-multiple-databases/
• Timescale multi-node https://docs.timescale.com/self-hosted/latest/multinode-timescaledb/about-multinode/
• PgCat https://github.com/postgresml/pgcat
• SPQR https://github.com/pg-sharding/spqr
• PL/Proxy https://plproxy.github.io/
• Sharding GitLab by top-level namespace https://about.gitlab.com/handbook/engineering/development/enablement/data_stores/database/doc/root-namespace-sharding.html
• Loose foreign keys (GitLab) https://docs.gitlab.com/ee/development/database/loose_foreign_keys.html

~~~

What did you like or not like? What should we discuss next time? Let us know via a YouTube comment, on social media, or by commenting on our Google doc!

~~~

Postgres FM is brought to you by:

• Nikolay Samokhvalov, founder of Postgres.ai
• Michael Christofides, founder of pgMustard

With special thanks to:

• Jessie Draws for the amazing artwork