postgresql/src/backend/utils
Michael Paquier 4035cd5d4e Add support for LZ4 with compression of full-page writes in WAL
The logic is implemented so as there can be a choice in the compression
used when building a WAL record, and an extra per-record bit is used to
track down if a block is compressed with PGLZ, LZ4 or nothing.

wal_compression, the existing parameter, is changed to an enum with
support for the following backward-compatible values:
- "off", the default, to not use compression.
- "pglz" or "on", to compress FPWs with PGLZ.
- "lz4", the new mode, to compress FPWs with LZ4.

Benchmarking has showed that LZ4 outclasses easily PGLZ.  ZSTD would be
also an interesting choice, but going just with LZ4 for now makes the
patch minimalistic as toast compression is already able to use LZ4, so
there is no need to worry about any build-related needs for this
implementation.

Author: Andrey Borodin, Justin Pryzby
Reviewed-by: Dilip Kumar, Michael Paquier
Discussion: https://postgr.es/m/3037310D-ECB7-4BF1-AF20-01C10BB33A33@yandex-team.ru
2021-06-29 11:17:55 +09:00
..
activity Initial pgindent and pgperltidy run for v14. 2021-05-12 13:14:10 -04:00
adt Message style improvements 2021-06-28 08:36:44 +02:00
cache Improve RelationGetIdentityKeyBitmap(). 2021-06-28 10:56:53 +05:30
error Initial pgindent and pgperltidy run for v14. 2021-05-12 13:14:10 -04:00
fmgr Reconsider the handling of procedure OUT parameters. 2021-06-10 17:11:36 -04:00
hash Update copyright for 2021 2021-01-02 13:06:25 -05:00
init Add function to log the memory contexts of specified backend process. 2021-04-06 13:44:15 +09:00
mb Initial pgindent and pgperltidy run for v14. 2021-05-12 13:14:10 -04:00
misc Add support for LZ4 with compression of full-page writes in WAL 2021-06-29 11:17:55 +09:00
mmgr Restore the portal-level snapshot after procedure COMMIT/ROLLBACK. 2021-05-21 14:03:59 -04:00
resowner Refactor HMAC implementations 2021-04-03 17:30:49 +09:00
sort Initial pgindent and pgperltidy run for v14. 2021-05-12 13:14:10 -04:00
time Initial pgindent and pgperltidy run for v14. 2021-05-12 13:14:10 -04:00
.gitignore Rearrange makefile rules for running Gen_fmgrtab.pl. 2018-05-03 17:54:18 -04:00
Gen_dummy_probes.pl Emit dummy statements for probes.d probes when disabled 2021-05-10 11:40:03 +02:00
Gen_dummy_probes.pl.prolog Tweak generation of Gen_dummy_probes.pl 2021-05-11 20:02:02 -04:00
Gen_dummy_probes.sed Emit dummy statements for probes.d probes when disabled 2021-05-10 11:40:03 +02:00
Gen_fmgrtab.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
Makefile Tweak generation of Gen_dummy_probes.pl 2021-05-11 20:02:02 -04:00
README.Gen_dummy_probes Tweak generation of Gen_dummy_probes.pl 2021-05-11 20:02:02 -04:00
errcodes.txt Rethink SQLSTATE code for ERRCODE_IDLE_SESSION_TIMEOUT. 2021-01-11 14:53:42 -05:00
generate-errcodes.pl Update copyright for 2021 2021-01-02 13:06:25 -05:00
probes.d Update copyright for 2021 2021-01-02 13:06:25 -05:00

README.Gen_dummy_probes

# Generating dummy probes

If Postgres isn't configured with dtrace enabled, we need to generate
dummy probes for the entries in probes.d, that do nothing.

This is accomplished in Unix via the sed script `Gen_dummy_probes.sed`. We
used to use this in MSVC builds using the perl utility `psed`, which mimicked
sed. However, that utility disappeared from Windows perl distributions and so
we converted the sed script to a perl script to be used in MSVC builds.

We still keep the sed script as the authoritative source for generating
these dummy probes because except on Windows perl is not a hard requirement
when building from a tarball.

So, if you need to change the way dummy probes are generated, first change
the sed script, and when it's working generate the perl script. This can
be accomplished by using the perl utility s2p.

s2p is no longer part of the perl core, so it might not be on your system,
but it is available on CPAN and also in many package systems. e.g.
on Fedora it can be installed using `cpan App::s2p` or
`dnf install perl-App-s2p`.

The Makefile contains a recipe for regenerating Gen_dummy_probes.pl, so all
you need to do is once you have s2p installed is `make Gen_dummy_probes.pl`
Note that in a VPATH build this will generate the file in the vpath tree,
not the source tree.