postgresql/contrib/pageinspect
Heikki Linnakangas 8af2565248 Introduce a new smgr bulk loading facility.
The new facility makes it easier to optimize bulk loading, as the
logic for buffering, WAL-logging, and syncing the relation only needs
to be implemented once. It's also less error-prone: We have had a
number of bugs in how a relation is fsync'd - or not - at the end of a
bulk loading operation. By centralizing that logic to one place, we
only need to write it correctly once.

The new facility is faster for small relations: Instead of of calling
smgrimmedsync(), we register the fsync to happen at next checkpoint,
which avoids the fsync latency. That can make a big difference if you
are e.g. restoring a schema-only dump with lots of relations.

It is also slightly more efficient with large relations, as the WAL
logging is performed multiple pages at a time. That avoids some WAL
header overhead. The sorted GiST index build did that already, this
moves the buffering to the new facility.

The changes to pageinspect GiST test needs an explanation: Before this
patch, the sorted GiST index build set the LSN on every page to the
special GistBuildLSN value, not the LSN of the WAL record, even though
they were WAL-logged. There was no particular need for it, it just
happened naturally when we wrote out the pages before WAL-logging
them. Now we WAL-log the pages first, like in B-tree build, so the
pages are stamped with the record's real LSN. When the build is not
WAL-logged, we still use GistBuildLSN. To make the test output
predictable, use an unlogged index.

Reviewed-by: Andres Freund
Discussion: https://www.postgresql.org/message-id/30e8f366-58b3-b239-c521-422122dd5150%40iki.fi
2024-02-23 16:10:51 +02:00
..
expected Introduce a new smgr bulk loading facility. 2024-02-23 16:10:51 +02:00
sql Introduce a new smgr bulk loading facility. 2024-02-23 16:10:51 +02:00
.gitignore pageinspect: Add tests 2016-11-01 14:02:16 -04:00
Makefile Add bt_multi_page_stats() function to contrib/pageinspect. 2023-01-02 13:02:29 -05:00
brinfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
btreefuncs.c Consolidate ItemPointer to Datum conversion functions 2023-02-13 09:57:15 +01:00
fsmfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
ginfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
gistfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
hashfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
heapfuncs.c Update copyright for 2024 2024-01-03 20:49:05 -05:00
meson.build Update copyright for 2024 2024-01-03 20:49:05 -05:00
pageinspect--1.0--1.1.sql Fix typos in some error messages thrown by extension scripts when fed to psql. 2014-08-25 18:30:37 +02:00
pageinspect--1.1--1.2.sql Fix typos in some error messages thrown by extension scripts when fed to psql. 2014-08-25 18:30:37 +02:00
pageinspect--1.2--1.3.sql pageinspect/BRIN: minor tweaks 2014-12-02 12:20:50 -03:00
pageinspect--1.3--1.4.sql Add forgotten file in commit d6061f83a1 2015-11-25 16:59:07 +03:00
pageinspect--1.4--1.5.sql Update pageinspect extension for parallel query. 2016-06-09 17:18:09 -04:00
pageinspect--1.5--1.6.sql pageinspect: Add bt_page_items function with bytea argument 2017-04-04 23:52:55 -04:00
pageinspect--1.5.sql Update pageinspect extension for parallel query. 2016-06-09 17:18:09 -04:00
pageinspect--1.6--1.7.sql Skip full index scan during cleanup of B-tree indexes when possible 2018-04-04 19:29:00 +03:00
pageinspect--1.7--1.8.sql pageinspect: Fix types used for bt_metap() columns. 2020-03-07 16:44:53 -08:00
pageinspect--1.8--1.9.sql Use full 64-bit XIDs in deleted nbtree pages. 2021-02-24 18:41:34 -08:00
pageinspect--1.9--1.10.sql pageinspect: Improve page_header() for pages of 32kB 2021-07-12 11:05:27 +09:00
pageinspect--1.10--1.11.sql Mark pageinspect's disk-accessing functions as parallel restricted. 2022-11-21 15:37:10 -05:00
pageinspect--1.11--1.12.sql Show empty BRIN ranges in brin_page_items 2023-05-19 02:00:21 +02:00
pageinspect.control Add bt_multi_page_stats() function to contrib/pageinspect. 2023-01-02 13:02:29 -05:00
pageinspect.h Update copyright for 2024 2024-01-03 20:49:05 -05:00
rawpage.c Update copyright for 2024 2024-01-03 20:49:05 -05:00