OLTP To Parquet For Analytics | Scaling Postgres 353

Scaling Postgres

Player FM - Internet Radio Done Right

75 subscribers

הוסף לפני seven שנים

תוכן מסופק על ידי creston.jamison@rubytreesoftware.com (Ruby Tree Software Inc) and Creston Jamison. כל תוכן הפודקאסטים כולל פרקים, גרפיקה ותיאורי פודקאסטים מועלים ומסופקים ישירות על ידי creston.jamison@rubytreesoftware.com (Ruby Tree Software Inc) and Creston Jamison או שותף פלטפורמת הפודקאסט שלהם. אם אתה מאמין שמישהו משתמש ביצירה שלך המוגנת בזכויות יוצרים ללא רשותך, אתה יכול לעקוב אחר התהליך המתואר כאן https://he.player.fm/legal.

TED Health

1
My mission to change the narrative of mental health | Glenn Close 13:44

לפני 22 weeks13:44

הפעל מאוחר יותר

רשימות

לייק

אהבתי

13:44

Legendary actor and mental health advocate Glenn Close is on a quest to change how we think about mental health, starting with her decision to speak out about her own family's struggles — a brave choice considering the stigma that pervades the topic. This week, we're revisiting this sweeping conversation with TEDWomen curator Pat Mitchell, where Close shares the inspiration behind the advocacy group she founded to combat the crisis, underscoring the transformative power of community and the critical need for comprehensive mental health care systems. Want to help shape TED’s shows going forward? Fill out our survey ! Hosted on Acast. See acast.com/privacy for more information.…

לפני שנה 15:59

MP3•בית הפרקים

In this episode of Scaling Postgres, we discuss how data can flow from your OLTP to parquet files for analytics, parallel queries, view inlining and partitioning advice.

To get the show notes as well as get notified of new episodes, visit:
https://www.scalingpostgres.com/episodes/353-oltp-to-parquet-for-analytics/

Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

537 פרקים

#Ruby Tree Software Inc #Creston Jamison #Web Development #Tech #Software Development

OLTP To Parquet For Analytics | Scaling Postgres 353

Scaling Postgres

75 subscribers

published לפני שנה

שתפו

MP3•בית הפרקים

In this episode of Scaling Postgres, we discuss how data can flow from your OLTP to parquet files for analytics, parallel queries, view inlining and partitioning advice.

To get the show notes as well as get notified of new episodes, visit:
https://www.scalingpostgres.com/episodes/353-oltp-to-parquet-for-analytics/

Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

537 פרקים

#Ruby Tree Software Inc #Creston Jamison #Web Development #Tech #Software Development

All episodes

Scaling Postgres

1
4 Times Faster UUID Primary Keys | Scaling Postgres 368 19:10

לפני 13 hours19:10

19:10

In this episode of Scaling Postgres, we discuss the benefits of using time-based UUIDv7 vs UUIDv4 for primary keys, how OpenAI uses Postgres, handling locks and methods to migrate to partition tables with low downtime. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/368-4-times-faster-uuid-primary-keys/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
How Often Does That Query Run? | Scaling Postgres 367 13:10

לפני 8 ימים13:10

13:10

In this episode of Scaling Postgres, we discuss a Postgres VS code extension, service definition files, undead tuples and the benefits of finding out how often a query is run. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/367-how-often-does-that-query-run/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
20,000 Times Faster Order By Limit | Scaling Postgres 366 14:46

לפני 15 ימים14:46

14:46

In this episode of Scaling Postgres, we discuss a top ten dangerous Postgres issues list, importing and exporting statistics, more Postgres 18 beta features and a 20,000 times faster query by fixing an order by limit issue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/366-20k-faster-order-by-limit/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Here Comes Async I/O! | Scaling Postgres 365 20:01

לפני 22 ימים20:01

20:01

In this episode of Scaling Postgres, we discuss async I/O introduced in PG 18 Beta 1, new Postgres releases, PgDog performance and innovative ways to optimize queries. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/365-here-comes-async-io/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Scaling For High Volume | Scaling Postgres 364 20:39

לפני 29 ימים20:39

20:39

In this episode of Scaling Postgres, we discuss scaling for high volume, why workflows should be Postgres rows, a planner gotcha and ways to resolve planner issues. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/364-scaling-for-high-volume/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Top Ten Postgres Dos & Don'ts | Scaling Postgres 363 13:32

לפני 5 weeks13:32

13:32

In this episode of Scaling Postgres, we discuss a top ten dos and don't for Postgres, understanding statistics and extended statistics, aligning columns to reduce padding and how to handle disaster recovery. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/363-top-ten-postgres-dos-and-donts/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Optimizing For Time-Series Data | Scaling Postgres 362 12:22

לפני 6 weeks12:22

12:22

In this episode, we discuss optimizing for time-series data, indexing vectors, Postgres APT extension packaging and how to optimize queries involving low cardinality data columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/362-optimizing-for-time-series-data/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
A Roadmap To Scaling Postgres | Scaling Postgres 361 17:28

לפני 7 weeks17:28

17:28

In this episode of Scaling Postgres, we discuss a roadmap to scaling Postgres, life altering Postgres patterns, making Postgres better with OrioleDB, performance cliffs and efficient use of foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/361-roadmap-to-scaling-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Handle One Million Connections? | Scaling Postgres 360 16:17

לפני 8 weeks16:17

16:17

In this episode of Scaling Postgres, we discuss how a new tool pgDog might allow one million client connections to Postgres, novel use cases for pgvector other than semantic search, don't expose port 5432 and Postgres on Kubernetes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/360-handle-one-million-connections/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Trillions of Rows & Metrics | Scaling Postgres 359 18:27

לפני 9 weeks18:27

18:27

In this episode of Scaling Postgres, we talk about indexes being added to Timescale's column store, processing 1 trillion metrics in Timescale, processing 1 trillion rows in Citus and partitions for deletion use cases. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/359-trillions-of-rows-and-metrics/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Conference 2025 | Scaling Postgres 358 23:37

לפני 10 weeks23:37

23:37

In this episode of Scaling Postgres, I discuss my experience attending Postgres Conference 2025 and cover some of the highlights of the conference. Interestingly, at least from my perspective, the most well attended talks seemed to cover pg_vector, analytics involving duckdb and partitioning. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/358-postgres-conference-2025/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Best Practices? | Scaling Postgres 357 9:58

לפני 11 weeks9:58

9:58

In this episode of Scaling Postgres, we discuss best practices, caching monitoring statistics, a new vector extension called VectorChord and the importance of monitoring wait events. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/357-postgres-best-practices/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Is the Future Immutable? | Scaling Postgres 356 15:21

לפני 12 weeks15:21

15:21

In this episode of Scaling Postgres, we discuss immutability and Postgres, the upcoming Postgres Conference in Orlando, extended statistics and usage of default partitions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/356-is-the-future-immutable/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Top Ten Analytics with pg_mooncake | Scaling Postgres 355 15:59

לפני 13 weeks15:59

15:59

In this episode of Scaling Postgres, we discuss how Postgres & pg_mooncake achieves top ten Clickbench results, a comparison of Oracle and Postgres transactions, sharding to scale and connection counts. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/355-top-ten-analytics-with-pg_mooncake/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres & The US Treasury Attack | Scaling Postgres 354 15:43

לפני 14 weeks15:43

15:43

In this episode of Scaling Postgres, we discuss the role of Postgres in the US Treasury online attack, new releases of Postgres, optimizing application of streaming changes and a query that filled a databases disks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/354-postgres-us-treasury-attack/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
OLTP To Parquet For Analytics | Scaling Postgres 353 15:59

לפני 15 weeks15:59

15:59

In this episode of Scaling Postgres, we discuss how data can flow from your OLTP to parquet files for analytics, parallel queries, view inlining and partitioning advice. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/353-oltp-to-parquet-for-analytics/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
You Can Always Optimize More | Scaling Postgres 352 14:32

לפני 16 weeks14:32

14:32

In this episode of Scaling Postgres, we discuss how you can always optimize more, avoiding deadlocks, casting & indexes and pg_hint_plan best practices. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/352-you-can-always-optimize-more/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Features To Avoid? | Scaling Postgres 351 16:55

לפני 17 weeks16:55

16:55

In this episode of Scaling Postgres, we talk about some features you may want to avoid like commit_delay, index_cleanup off, & logon triggers, a way to detect a table rewrite and a zero downtime upgrade. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/351-features-to-avoid/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Seven Years of Scaling Postgres | Scaling Postgres 350 19:09

לפני 18 weeks19:09

19:09

In this episode of Scaling Postgres, we discuss our seven year anniversary, better pg_search performance, reducing table locks, not valid constraints and better group by statistics. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/350-seven-years-of-scaling-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
The Dangers of Temporary Tables | Scaling Postgres 349 15:24

לפני 19 weeks15:24

15:24

In this episode of Scaling Postgres, we discuss the dangers of temporary tables, better transparent data encryption, pig the extension wizard, and table level lock considerations. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/349-the-dangers-of-temporary-tables/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
The Future Is Containers? | Scaling Postgres 348 12:28

לפני 20 weeks12:28

12:28

In this episode of Scaling Postgres, we discuss whether the future of containers and Postgres, UUIDv7 commit, and a pg_duckdb interview. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/348-the-future-is-containers/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Easy Incremental Data Processing? | Scaling Postgres 347 14:47

לפני 23 weeks14:47

14:47

In this episode of Scaling Postgres, we discuss the new pg_incremental extension for processing data pipelines, a set of Postgres monitoring queries, handling alter table retries and large object dump performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/347-easy-incremental-data-processing/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Things I Don't Do In Postgres | Scaling Postgres 346 15:47

לפני 24 weeks15:47

15:47

In this episode of Scaling Postgres, we discuss things I do not do such as use default partitions, play column Tetris, ELT using special data types or create 7+ millions tables in a database. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/346-things-i-do-not-do-in-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Over 5X Faster Postgres? | Scaling Postgres 345 17:02

לפני 25 weeks17:02

17:02

In this episode of Scaling Postgres, we discuss OrioleDB getting Postgres over 5 times faster, historical OLAP performance, efficient queries and whether you should us track_planning. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/345-over-5x-faster-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Performance & Hard Things | Scaling Postgres 344 17:38

לפני 26 weeks17:38

17:38

In this episode of Scaling Postgres, we discuss new releases, collation speed, ZFS performance, insert benchmarking and pglz vs. lz4 performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/344-performance-hard-things/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Release Warning! | Scaling Postgres 343 18:50

לפני 27 weeks18:50

18:50

In this episode of Scaling Postgres, we discuss new Postgres releases and an out-of-band release to address issues, increasing insert performance by 2X, pg_search benchmarks and fast OpenStreetMap loading. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/343-postgres-release-warning/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Faster Writes With ZFS? | Scaling Postgres 342 13:19

לפני 28 weeks13:19

13:19

In this episode of Scaling Postgres, we discuss the read and write performance of Postgres on ZFS, handling URL text identifiers in the database, denormalization and a new pgvector release. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/342-faster-writes-with-zfs/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
The Future of Postgres Upgrades | Scaling Postgres 341 14:15

לפני 29 weeks14:15

14:15

In this episode of Scaling Postgres, we discuss the future of Postgres upgrades, the usefulness of pg_dump, partitioning with minimal downtime and limitless Aurora. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/341-the-future-of-postgres-upgrades/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Do You Need A Vectorizer? | Scaling Postgres 340 16:39

לפני 30 weeks16:39

16:39

In this episode of Scaling Postgres, we discuss whether you need a vectorizer, different ways to bin or bucket timestamps, addressing a bad plan and advanced psql. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/340-do-you-need-a-vectorizer/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Goes Parquet | Scaling Postgres 339 11:32

לפני 31 weeks11:32

11:32

In this episode of Scaling Postgres, we discuss pg_parquet allowing Postgres to read and write parquet files, other useful extensions, open source bounties, and Postgres gotchas. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/339-postgres-goes-parquet/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
JSON Goodies In Postgres 17 | Scaling Postgres 338 17:03

לפני 32 weeks17:03

17:03

In this episode of Scaling Postgres, we discuss the JSON goodies in Postgres 17, trigger recursion, pg_dump as backup and pg_timeseries columnar performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/338-json-goodies-in-postgres-17/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
77 Times Faster In Postgres 17 | Scaling Postgres 337 14:19

לפני 33 weeks14:19

14:19

In this episode of Scaling Postgres, we discuss how one query runs 77 times faster in Postgres 17, a detailed Postgres 17 performance webinar, using logical replication fail over slots and a discussion on Patroni. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/337-77-times-faster-in-postgres-17/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
More Postgres 17 Highlights | Scaling Postgres 336 12:54

לפני 34 weeks12:54

12:54

In this episode of Scaling Postgres, we discuss more about the features released with Postgres 17, an example of performance improvements, things to watch out for, and the start of Postgres 18. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/336-more-postgres-17-highlights/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres 17 Released! | Scaling Postgres 335 18:32

לפני 35 weeks18:32

18:32

In this episode of Scaling Postgres, we discuss the release of Postgres 17, b-tree performance gains, logical replication enhancements and different levels of performance tuning. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/335-postgres-17-released/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Optimizing For Analytics | Scaling Postgres 334 21:55

לפני 36 weeks21:55

21:55

In this episode of Scaling Postgres, we discuss how to optimize your database for analytics, how to speed up counts, improvements to TimescaleDB and why you should stop using serial. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/334-optimizing-for-analytics/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
When Select Writes! | Scaling Postgres 333 13:38

לפני 37 weeks13:38

13:38

In this episode of Scaling Postgres, we discuss when select can write, Postgres RC1 is released, Tetris in SQL and copy, swap, drop. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/333-when-select-writes/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Sometimes It Is Slow? | Scaling Postgres 332 15:10

לפני 38 weeks15:10

15:10

In this episode of Scaling Postgres, we discuss what can happen when queries get slow, backup best practices, Postgres emergencies and the state of Postgres survey. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/332-sometimes-it-is-slow/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Is pg_dump A Backup Tool? | Scaling Postgres 331 17:31

לפני 39 weeks17:31

17:31

In this episode of Scaling Postgres, we discuss whether pg_dump is a backup tool, the pgMonitor extension, Postgres malware, and application uses for the merge command. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/331-is-pg_dump-a-backup-tool/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Splicing Elephant & Duck DNA | Scaling Postgres 330 14:58

לפני 40 weeks14:58

14:58

In this episode of Scaling Postgres, we discuss the merging of Postgres and DuckDB via the pg_duckdb extension, how this can help the analytics story for Postgres, some ways to improve PG analytics and building a search engine. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/330-splicing-elephant-and-duck-dna/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
PGlite: Embeddable Postgres & postgres.new | Scaling Postgres 329 19:01

לפני 41 weeks19:01

19:01

In this episode of Scaling Postgres, we discuss PGlite, an embeddable Postgres, postgres.new which adds AI features, new Postgres releases and the performance of synchronous replication. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/329-pglite-embeddable-postgres/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Implement Get Or Create | Scaling Postgres 328 16:10

לפני 42 weeks16:10

16:10

In this episode of Scaling Postgres, we discuss different get or create implementations, a new pgBouncer version, alter default privileges, and six degrees of separation with Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/328-implement-get-or-create/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Graph Queries | Scaling Postgres 327 16:30

לפני 43 weeks16:30

16:30

In this episode of Scaling Postgres, we discuss using Postgres for graph queries, the fastest way to copy data from one table to another, dealing with linux memory overcommit and compression. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/327-postgres-graph-queries/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Faster Index Creation | Scaling Postgres 326 20:28

לפני 44 weeks20:28

20:28

In this episode of Scaling Postgres, we talk about speeding up index creation, extensions to track wait events, a row pattern recognition feature and savepoints. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/326-faster-index-creation/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Faster Paging? | Scaling Postgres 325 20:07

לפני 45 weeks20:07

20:07

In this episode of Scaling Postgres, we discuss more ways to keep the superior performance of keyset pagination, how to implement UUIDv7 in SQL functions, how expensive extended statistics are and the benefits of range columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/325-faster-paging/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Four Million TPS | Scaling Postgres 324 16:29

לפני 46 weeks16:29

16:29

In this episode of Scaling Postgres, we discuss experiments to achieve four million transaction per second, the importance of extended statistics, parallelism in Postgres and an introduction to window functions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/324-four-million-tps/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
PgBouncer Breaking Change | Scaling Postgres 323 23:47

לפני 47 weeks23:47

23:47

In this episode of Scaling Postgres, we discuss a breaking change in the new version of PgBouncer, PostgreSQL 17 Beta 2 is released, examination of the new built-in collation provider in PG 17 and Notion's data lake. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/323-pgbouncer-breaking-change/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Postgres Sort Instability? | Scaling Postgres 322 19:48

לפני 48 weeks19:48

19:48

In this episode of Scaling Postgres, we discuss an incremental sort instability issue with the Postgres planner, whether we should use foreign keys, how the visibility map works and how to vacuum the template0 database. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/322-postgres-sort-instability/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
Ottertune Is Dead! | Scaling Postgres 321 11:02

לפני 49 weeks11:02

11:02

In this episode of Scaling Postgres, we discuss the shutdown of Ottertune, how schema changes cause locks and how to avoid them, the benefits of on conflic do nothing, and pgvectorscale. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/321-ottertune-is-dead/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
100 TB and Beyond! | Scaling Postgres 320 17:32

לפני 50 weeks17:32

17:32

In this episode of Scaling Postgres, we discuss three organizations scaling their databases to 100 TB and beyond, collation speed, configuring memory and new AI extensions To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/320-100tb-and-beyond/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/…

Scaling Postgres

1
When Postgres Development Stopped! | Scaling Postgres 319 12:05

לפני 51 weeks12:05

12:05

In this episode of Scaling Postgres, we discuss a time when Postgres development stopped, two new extensions pg_lakehouse & pg_compare and the upcoming event Posette. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/319-when-postgres-development-stoppped/…

Scaling Postgres

1
Postgres 17 Beta 1 Released | Scaling Postgres 318 17:54

לפני 52 weeks17:54

17:54

In this episode of Scaling Postgres, we discuss all the new features in Postgres 17 Beta 1, some features that did not make it, database collations & sorting and causes of slow commits. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/318-postgres-17-beta-1-released/…

Scaling Postgres

1
Time-Series Open Source Extension | Scaling Postgres 317 14:56

לפני 1 year14:56

14:56

In this episode of Scaling Postgres, we discuss a new time-series open source extension called pg_timeseries, Postgres ignoring indexes, JSONB selectivity issues, and geographically distributed multi-tenant applications. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/317-time-series-open-source-extension/…

Scaling Postgres

1
New Releases & 1,000 Times Faster Query | Scaling Postgres 316 14:34

לפני 1 year14:34

14:34

In this episode of Scaling Postgres, we discuss new Postgres releases, optimizing a query to be 1,000 times faster, custom vs. generic plans and the pgtt extension. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/316-new-releases-1000-times-faster-query/…

Scaling Postgres

1
Hacking On Postgres is Hard! | Scaling Postgres 315 19:31

לפני 1 year19:31

19:31

In this episode of Scaling Postgres, we discuss how hacking on Postgres is hard, a notifier pattern for using Listen/Notify, using histograms for metrics and saturated arithmetic. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/315-hacking-on-postgres-is-hard/…

Scaling Postgres

1
150 Times Faster pgvector? | Scaling Postgres 314 16:30

לפני 1 year16:30

16:30

In this episode of Scaling Postgres, we discuss performance improvements for pgvector 0.7.0, a guide to vector embeddings, building a Retrieval Augmented Generation app and only allow logins to replicas. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/314-150-times-faster-pgvector/…

Scaling Postgres

1
The Future of MySQL is Postgres? | Scaling Postgres 313 15:33

לפני 1 year15:33

15:33

In this episode of Scaling Postgres, we discuss whether the future of MySQL is Postgres, how to use recursive CTEs, work on OrioleDB, and PG17 performance improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/313-the-future-of-mysql-is-postgres/…

Scaling Postgres

1
Postgres 17 Commit-orama | Scaling Postgres 312 12:57

לפני 1 year12:57

12:57

In this episode of Scaling Postgres, we cover potential features in Postgres 17 such as explain serialize, verbose copy, pg_buffer_cache_evict, as well as many others. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/312-postgres-17-commit-orama/…

Scaling Postgres

1
1,400 Times Faster Max & Group By Performance | Scaling Postgres 311 18:52

לפני 1 year18:52

18:52

In this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/…

Scaling Postgres

1
Andres, Microsoft & Postgres Save Linux? | Scaling Postgres 310 12:55

לפני 1 year12:55

12:55

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/…

Scaling Postgres

1
Will Postgres Pull A Redis? | Scaling Postgres 309 15:12

לפני 1 year15:12

15:12

Scaling Postgres

1
Scale Through Sharding | Scaling Postgres 308 18:15

לפני 1 year18:15

18:15

In this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/…

Scaling Postgres

1
Collation Conundrum | Scaling Postgres 307 14:22

לפני 1 year14:22

14:22

In this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conundrum/…

Scaling Postgres

1
Scalability Limits From SLRU & Lock Manager | Scaling Postgres 306 14:29

לפני 1 year14:29

14:29

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-from-slru-lock-manager/…

Scaling Postgres

1
11K Faster Configuration Change | Scaling Postgres 305 13:26

לפני 1 year13:26

13:26

Scaling Postgres

1
Overhead of pg_stat_statements | Scaling Postgres 304 14:09

לפני 1 year14:09

14:09

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/…

Scaling Postgres

1
PgBouncer, PgCat, Supavisor Fight!!! | Scaling Postgres 303 19:55

לפני 1 year19:55

19:55

Scaling Postgres

1
UUID vs Bigint Battle!!! | Scaling Postgres 302 13:23

לפני 1 year13:23

13:23

In this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/302-uuid-vs-bigint-battle/…

Scaling Postgres

1
Postgres LLM OS & 30 Times Faster Index Builds | Scaling Postgres 301 18:14

לפני 1 year18:14

18:14

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-faster-index-builds/…

Scaling Postgres

1
Scaling Postgres Celebration | Scaling Postgres 300 18:02

לפני 1 year18:02

18:02

Scaling Postgres

1
Build A GPT In SQL | Scaling Postgres 299 12:21

לפני 1 year12:21

12:21

Scaling Postgres

1
10-100 Times Higher Latency With Distributed Postgres | Scaling Postgres 298 19:28

לפני 1 year19:28

19:28

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/…

Scaling Postgres

1
Postgres In 2024 | Scaling Postgres 297 20:38

לפני 1 year20:38

20:38

Scaling Postgres

1
State Of Postgres 2023 | Scaling Postgres 296 17:45

לפני 1 year17:45

17:45

In this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/…

Scaling Postgres

1
30K Messages Per Second Queue | Scaling Postgres 295 15:32

לפני 1 year15:32

15:32

In this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second-queue/…

Scaling Postgres

1
How Much Observability Is Needed? | Scaling Postgres 294 14:09

לפני 1 year14:09

14:09

In this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/…

ברוכים הבאים אל Player FM!

Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.