postgresql/src/backend/utils
Tom Lane ec62ce55a8 Change type "char"'s I/O format for non-ASCII characters.
Previously, a byte with the high bit set was just transmitted
as-is by charin() and charout().  This is problematic if the
database encoding is multibyte, because the result of charout()
won't be validly encoded, which breaks various stuff that
expects all text strings to be validly encoded.  We've
previously decided to enforce encoding validity rather than try
to individually harden each place that might have a problem with
such strings, so it's time to do something about "char".

To fix, represent high-bit-set characters as \ooo (backslash
and three octal digits), following the ancient "escape" format
for bytea.  charin() will continue to accept the old way as well,
though that is only reachable in single-byte encodings.

Add some test cases just so there is coverage for this code.
We'll otherwise leave this question undocumented as it was before,
because we don't really want to encourage end-user use of "char".

For the moment, back-patch into v15 so that this change appears
in 15beta3.  If there's not great pushback we should consider
absorbing this change into the older branches.

Discussion: https://postgr.es/m/2318797.1638558730@sss.pgh.pa.us
2022-08-02 10:29:35 -04:00
..
activity Remove the restriction that the relmap must be 512 bytes. 2022-07-26 14:56:25 -04:00
adt Change type "char"'s I/O format for non-ASCII characters. 2022-08-02 10:29:35 -04:00
cache Move common catalog cache access routines to lsyscache.c 2022-08-02 10:47:22 +05:30
error Provide log_status_format(), useful for an emit_log_hook. 2022-07-11 12:29:33 -07:00
fmgr Add construct_array_builtin, deconstruct_array_builtin 2022-07-01 11:23:15 +02:00
hash Update copyright for 2022 2022-01-07 19:04:57 -05:00
init Process session_preload_libraries within InitPostgres's transaction. 2022-07-25 10:27:43 -04:00
mb Update copyright for 2022 2022-01-07 19:04:57 -05:00
misc Tweak detail and hint messages to be consistent with project policy 2022-07-20 09:50:12 +09:00
mmgr Remove fls(), use pg_leftmost_one_pos32() instead. 2022-07-22 10:41:50 +12:00
resowner Remove extraneous blank lines before block-closing braces 2022-04-13 19:16:02 +02:00
sort Improve speed of hash index build. 2022-07-28 14:34:32 -04:00
time Fix incorrect logic in HaveRegisteredOrActiveSnapshot(). 2022-04-16 16:04:50 -04:00
.gitignore Rearrange makefile rules for running Gen_fmgrtab.pl. 2018-05-03 17:54:18 -04:00
Gen_dummy_probes.pl Update copyright for 2022 2022-01-07 19:04:57 -05:00
Gen_dummy_probes.pl.prolog Update copyright for 2022 2022-01-07 19:04:57 -05:00
Gen_dummy_probes.sed Update copyright for 2022 2022-01-07 19:04:57 -05:00
Gen_fmgrtab.pl Update copyright for 2022 2022-01-07 19:04:57 -05:00
Makefile Clean up temp file from refactored dtrace rule 2022-07-19 07:31:58 +02:00
README.Gen_dummy_probes Tweak generation of Gen_dummy_probes.pl 2021-05-11 20:02:02 -04:00
errcodes.txt Add another SQL/JSON error code 2022-07-18 14:26:43 +02:00
generate-errcodes.pl Add output file argument to generate-errcodes.pl 2022-07-18 12:24:35 -07:00
postprocess_dtrace.sed Refactor dtrace postprocessing make rules 2022-07-18 12:33:02 -07:00
probes.d Update copyright for 2022 2022-01-07 19:04:57 -05:00

README.Gen_dummy_probes

# Generating dummy probes

If Postgres isn't configured with dtrace enabled, we need to generate
dummy probes for the entries in probes.d, that do nothing.

This is accomplished in Unix via the sed script `Gen_dummy_probes.sed`. We
used to use this in MSVC builds using the perl utility `psed`, which mimicked
sed. However, that utility disappeared from Windows perl distributions and so
we converted the sed script to a perl script to be used in MSVC builds.

We still keep the sed script as the authoritative source for generating
these dummy probes because except on Windows perl is not a hard requirement
when building from a tarball.

So, if you need to change the way dummy probes are generated, first change
the sed script, and when it's working generate the perl script. This can
be accomplished by using the perl utility s2p.

s2p is no longer part of the perl core, so it might not be on your system,
but it is available on CPAN and also in many package systems. e.g.
on Fedora it can be installed using `cpan App::s2p` or
`dnf install perl-App-s2p`.

The Makefile contains a recipe for regenerating Gen_dummy_probes.pl, so all
you need to do is once you have s2p installed is `make Gen_dummy_probes.pl`
Note that in a VPATH build this will generate the file in the vpath tree,
not the source tree.