Top.Mail.Ru
Implementing a Table Engine from Scratch: The New TableAM for OLAP (Алексей Гордеев) | PGConf.Russia 2025 | PGConf.Russia

title

text

Алексей Гордеев
Алексей Гордеев PostgresPro
11:20 01 April
40 min

Implementing a Table Engine from Scratch: The New TableAM for OLAP

I’ll talk about the challenges you’ll face if you decide to implement a new TableAM. What to choose: Generic XLog or Custom RMGR? Why use a Custom SMGR? How to integrate PostgreSQL allocators into third-party libraries, even if they don't officially support it? What’s missing for a columnar engine (including vectorization and late materialization), and how can we work around those limitations?

In the second part, I’ll dive into the internals of pgpro_tam — a new native table engine for OLAP that supports standard data formats, various SMGRs, and, if needed, third-party schedulers and execution engines, all while adhering to ACID principles. This is designed to achieve the fastest analytics on PostgreSQL (not just plugging in DuckDB).

Slides

Slides are available to logged-in participants

Video

Slides are available to logged-in participants

Other talks