postgresql/src/backend/utils
Tom Lane 58d9acc18d Fix assorted issues in convert_to_scalar().
If convert_to_scalar is passed a pair of datatypes it can't cope with,
its former behavior was just to elog(ERROR).  While this is OK so far as
the core code is concerned, there's extension code that would like to use
scalarltsel/scalargtsel/etc as selectivity estimators for operators that
work on non-core datatypes, and this behavior is a show-stopper for that
use-case.  If we simply allow convert_to_scalar to return FALSE instead of
outright failing, then the main logic of scalarltsel/scalargtsel will work
fine for any operator that behaves like a scalar inequality comparison.
The lack of conversion capability will mean that we can't estimate to
better than histogram-bin-width precision, since the code will effectively
assume that the comparison constant falls at the middle of its bin.  But
that's still a lot better than nothing.  (Someday we should provide a way
for extension code to supply a custom version of convert_to_scalar, but
today is not that day.)

While poking at this issue, we noted that the existing code for handling
type bytea in convert_to_scalar is several bricks shy of a load.
It assumes without checking that if the comparison value is type bytea,
the bounds values are too; in the worst case this could lead to a crash.
It also fails to detoast the input values, so that the comparison result is
complete garbage if any input is toasted out-of-line, compressed, or even
just short-header.  I'm not sure how often such cases actually occur ---
the bounds values, at least, are probably safe since they are elements of
an array and hence can't be toasted.  But that doesn't make this code OK.

Back-patch to all supported branches, partly because author requested that,
but mostly because of the bytea bugs.  The change in API for the exposed
routine convert_network_to_scalar() is theoretically a back-patch hazard,
but it seems pretty unlikely that any third-party code is calling that
function directly.

Tomas Vondra, with some adjustments by me

Discussion: https://postgr.es/m/b68441b6-d18f-13ab-b43b-9a72188a4e02@2ndquadrant.com
2018-03-03 20:31:35 -05:00
..
adt Fix assorted issues in convert_to_scalar(). 2018-03-03 20:31:35 -05:00
cache Add prokind column, replacing proisagg and proiswindow 2018-03-02 13:48:33 -05:00
error Update copyright for 2018 2018-01-02 23:30:12 -05:00
fmgr Replace AclObjectKind with ObjectType 2018-01-19 14:01:15 -05:00
hash Update copyright for 2018 2018-01-02 23:30:12 -05:00
init Support parallel btree index builds. 2018-02-02 13:32:44 -05:00
mb Update headers of generated files 2018-02-24 14:54:17 -05:00
misc Remove some inappropriate #includes. 2018-02-16 12:14:08 -05:00
mmgr Fix crash when canceling parallel query 2018-02-16 16:21:24 -05:00
resowner Update copyright for 2018 2018-01-02 23:30:12 -05:00
sort Avoid another valgrind complaint about write() of uninitalized bytes. 2018-02-22 09:28:12 -05:00
time Update copyright for 2018 2018-01-02 23:30:12 -05:00
.gitignore Generate fmgr prototypes automatically 2017-01-17 14:06:07 -05:00
errcodes.txt Support all SQL:2011 options for window frame clauses. 2018-02-07 00:06:56 -05:00
Gen_dummy_probes.pl Update copyright for 2018 2018-01-02 23:30:12 -05:00
Gen_dummy_probes.sed Update copyright for 2018 2018-01-02 23:30:12 -05:00
Gen_fmgrtab.pl Update copyright for 2018 2018-01-02 23:30:12 -05:00
generate-errcodes.pl Update copyright for 2018 2018-01-02 23:30:12 -05:00
Makefile Replace binary search in fmgr_isbuiltin with a lookup array. 2017-10-04 00:22:38 -07:00
probes.d Support parallel btree index builds. 2018-02-02 13:32:44 -05:00