2022-12-20 13:54:39 +01:00
|
|
|
# Copyright (c) 2022, PostgreSQL Global Development Group
|
|
|
|
|
meson: Add initial version of meson based build system
Autoconf is showing its age, fewer and fewer contributors know how to wrangle
it. Recursive make has a lot of hard to resolve dependency issues and slow
incremental rebuilds. Our home-grown MSVC build system is hard to maintain for
developers not using Windows and runs tests serially. While these and other
issues could individually be addressed with incremental improvements, together
they seem best addressed by moving to a more modern build system.
After evaluating different build system choices, we chose to use meson, to a
good degree based on the adoption by other open source projects.
We decided that it's more realistic to commit a relatively early version of
the new build system and mature it in tree.
This commit adds an initial version of a meson based build system. It supports
building postgres on at least AIX, FreeBSD, Linux, macOS, NetBSD, OpenBSD,
Solaris and Windows (however only gcc is supported on aix, solaris). For
Windows/MSVC postgres can now be built with ninja (faster, particularly for
incremental builds) and msbuild (supporting the visual studio GUI, but
building slower).
Several aspects (e.g. Windows rc file generation, PGXS compatibility, LLVM
bitcode generation, documentation adjustments) are done in subsequent commits
requiring further review. Other aspects (e.g. not installing test-only
extensions) are not yet addressed.
When building on Windows with msbuild, builds are slower when using a visual
studio version older than 2019, because those versions do not support
MultiToolTask, required by meson for intra-target parallelism.
The plan is to remove the MSVC specific build system in src/tools/msvc soon
after reaching feature parity. However, we're not planning to remove the
autoconf/make build system in the near future. Likely we're going to keep at
least the parts required for PGXS to keep working around until all supported
versions build with meson.
Some initial help for postgres developers is at
https://wiki.postgresql.org/wiki/Meson
With contributions from Thomas Munro, John Naylor, Stone Tickle and others.
Author: Andres Freund <andres@anarazel.de>
Author: Nazir Bilal Yavuz <byavuz81@gmail.com>
Author: Peter Eisentraut <peter@eisentraut.org>
Reviewed-By: Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Discussion: https://postgr.es/m/20211012083721.hvixq4pnh2pixr3j@alap3.anarazel.de
2022-09-22 06:53:12 +02:00
|
|
|
backend_build_deps = [backend_code]
|
|
|
|
backend_sources = []
|
|
|
|
backend_link_with = [pgport_srv, common_srv]
|
|
|
|
|
|
|
|
generated_backend_sources = []
|
|
|
|
|
|
|
|
subdir('access')
|
|
|
|
subdir('backup')
|
|
|
|
subdir('bootstrap')
|
|
|
|
subdir('catalog')
|
|
|
|
subdir('commands')
|
|
|
|
subdir('executor')
|
|
|
|
subdir('foreign')
|
|
|
|
subdir('jit')
|
|
|
|
subdir('lib')
|
|
|
|
subdir('libpq')
|
|
|
|
subdir('main')
|
|
|
|
subdir('nodes')
|
|
|
|
subdir('optimizer')
|
|
|
|
subdir('parser')
|
|
|
|
subdir('partitioning')
|
|
|
|
subdir('port')
|
|
|
|
subdir('postmaster')
|
|
|
|
subdir('regex')
|
|
|
|
subdir('replication')
|
|
|
|
subdir('rewrite')
|
|
|
|
subdir('statistics')
|
|
|
|
subdir('storage')
|
|
|
|
subdir('tcop')
|
|
|
|
subdir('tsearch')
|
|
|
|
subdir('utils')
|
|
|
|
|
|
|
|
subdir('po', if_found: libintl)
|
|
|
|
|
|
|
|
|
|
|
|
backend_link_args = []
|
|
|
|
backend_link_depends = []
|
|
|
|
|
|
|
|
|
|
|
|
# On windows when compiling with msvc we need to make postgres export all its
|
|
|
|
# symbols so that extension libraries can use them. For that we need to scan
|
|
|
|
# the constituting objects and generate a file specifying all the functions as
|
|
|
|
# exported (variables need an "import" declaration in the header, hence
|
|
|
|
# PGDLLEXPORT, but functions work without that, due to import libraries
|
|
|
|
# basically being trampolines).
|
|
|
|
#
|
|
|
|
# For dtrace probes we need to invoke dtrace on all input files, before
|
|
|
|
# linking the final executable (see more below).
|
|
|
|
#
|
|
|
|
#
|
|
|
|
# On meson there's currently no easy way to do this that I found. So we build
|
|
|
|
# a static library with all the input objects, run our script to generate
|
|
|
|
# exports, and build the final executable using that static library
|
|
|
|
#
|
|
|
|
# We could do that only if either dtrace or msvc is in use, but it seems
|
|
|
|
# easier to just always do so.
|
|
|
|
#
|
|
|
|
# Can't name the static library 'postgres', because msbuild ends up with a
|
|
|
|
# conflict for the .pdb file otherwise.
|
|
|
|
|
|
|
|
postgres_lib = static_library('postgres_lib',
|
|
|
|
backend_sources + timezone_sources + generated_backend_sources,
|
|
|
|
link_whole: backend_link_with,
|
|
|
|
dependencies: backend_build_deps,
|
2022-10-07 02:19:30 +02:00
|
|
|
c_pch: pch_postgres_h,
|
meson: Add initial version of meson based build system
Autoconf is showing its age, fewer and fewer contributors know how to wrangle
it. Recursive make has a lot of hard to resolve dependency issues and slow
incremental rebuilds. Our home-grown MSVC build system is hard to maintain for
developers not using Windows and runs tests serially. While these and other
issues could individually be addressed with incremental improvements, together
they seem best addressed by moving to a more modern build system.
After evaluating different build system choices, we chose to use meson, to a
good degree based on the adoption by other open source projects.
We decided that it's more realistic to commit a relatively early version of
the new build system and mature it in tree.
This commit adds an initial version of a meson based build system. It supports
building postgres on at least AIX, FreeBSD, Linux, macOS, NetBSD, OpenBSD,
Solaris and Windows (however only gcc is supported on aix, solaris). For
Windows/MSVC postgres can now be built with ninja (faster, particularly for
incremental builds) and msbuild (supporting the visual studio GUI, but
building slower).
Several aspects (e.g. Windows rc file generation, PGXS compatibility, LLVM
bitcode generation, documentation adjustments) are done in subsequent commits
requiring further review. Other aspects (e.g. not installing test-only
extensions) are not yet addressed.
When building on Windows with msbuild, builds are slower when using a visual
studio version older than 2019, because those versions do not support
MultiToolTask, required by meson for intra-target parallelism.
The plan is to remove the MSVC specific build system in src/tools/msvc soon
after reaching feature parity. However, we're not planning to remove the
autoconf/make build system in the near future. Likely we're going to keep at
least the parts required for PGXS to keep working around until all supported
versions build with meson.
Some initial help for postgres developers is at
https://wiki.postgresql.org/wiki/Meson
With contributions from Thomas Munro, John Naylor, Stone Tickle and others.
Author: Andres Freund <andres@anarazel.de>
Author: Nazir Bilal Yavuz <byavuz81@gmail.com>
Author: Peter Eisentraut <peter@eisentraut.org>
Reviewed-By: Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Discussion: https://postgr.es/m/20211012083721.hvixq4pnh2pixr3j@alap3.anarazel.de
2022-09-22 06:53:12 +02:00
|
|
|
kwargs: internal_lib_args,
|
|
|
|
)
|
|
|
|
|
|
|
|
if cc.get_id() == 'msvc'
|
|
|
|
postgres_def = custom_target('postgres.def',
|
|
|
|
command: [perl, files('../tools/msvc/gendef.pl'),
|
|
|
|
'--arch', host_cpu,
|
|
|
|
'--tempdir', '@PRIVATE_DIR@',
|
|
|
|
'--deffile', '@OUTPUT@',
|
|
|
|
'@INPUT@'],
|
|
|
|
input: [postgres_lib, common_srv, pgport_srv],
|
|
|
|
output: 'postgres.def',
|
|
|
|
depends: [postgres_lib, common_srv, pgport_srv],
|
|
|
|
install: false,
|
|
|
|
build_by_default: false,
|
|
|
|
)
|
|
|
|
|
|
|
|
backend_link_args += '/DEF:@0@'.format(postgres_def.full_path())
|
|
|
|
backend_link_depends += postgres_def
|
2022-10-07 02:19:30 +02:00
|
|
|
# Due to the way msvc and meson's precompiled headers implementation
|
|
|
|
# interact, we need to have symbols from the full library available. Could
|
|
|
|
# be restricted to b_pch=true.
|
|
|
|
backend_link_with += postgres_lib
|
meson: Add initial version of meson based build system
Autoconf is showing its age, fewer and fewer contributors know how to wrangle
it. Recursive make has a lot of hard to resolve dependency issues and slow
incremental rebuilds. Our home-grown MSVC build system is hard to maintain for
developers not using Windows and runs tests serially. While these and other
issues could individually be addressed with incremental improvements, together
they seem best addressed by moving to a more modern build system.
After evaluating different build system choices, we chose to use meson, to a
good degree based on the adoption by other open source projects.
We decided that it's more realistic to commit a relatively early version of
the new build system and mature it in tree.
This commit adds an initial version of a meson based build system. It supports
building postgres on at least AIX, FreeBSD, Linux, macOS, NetBSD, OpenBSD,
Solaris and Windows (however only gcc is supported on aix, solaris). For
Windows/MSVC postgres can now be built with ninja (faster, particularly for
incremental builds) and msbuild (supporting the visual studio GUI, but
building slower).
Several aspects (e.g. Windows rc file generation, PGXS compatibility, LLVM
bitcode generation, documentation adjustments) are done in subsequent commits
requiring further review. Other aspects (e.g. not installing test-only
extensions) are not yet addressed.
When building on Windows with msbuild, builds are slower when using a visual
studio version older than 2019, because those versions do not support
MultiToolTask, required by meson for intra-target parallelism.
The plan is to remove the MSVC specific build system in src/tools/msvc soon
after reaching feature parity. However, we're not planning to remove the
autoconf/make build system in the near future. Likely we're going to keep at
least the parts required for PGXS to keep working around until all supported
versions build with meson.
Some initial help for postgres developers is at
https://wiki.postgresql.org/wiki/Meson
With contributions from Thomas Munro, John Naylor, Stone Tickle and others.
Author: Andres Freund <andres@anarazel.de>
Author: Nazir Bilal Yavuz <byavuz81@gmail.com>
Author: Peter Eisentraut <peter@eisentraut.org>
Reviewed-By: Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Discussion: https://postgr.es/m/20211012083721.hvixq4pnh2pixr3j@alap3.anarazel.de
2022-09-22 06:53:12 +02:00
|
|
|
|
|
|
|
elif host_system == 'aix'
|
|
|
|
# The '.' argument leads mkldexport.sh to emit "#! .", which refers to the
|
|
|
|
# main executable, allowing extension libraries to resolve their undefined
|
|
|
|
# symbols to symbols in the postgres binary.
|
|
|
|
postgres_imp = custom_target('postgres.imp',
|
|
|
|
command: [files('port/aix/mkldexport.sh'), '@INPUT@', '.'],
|
|
|
|
input: postgres_lib,
|
|
|
|
output: 'postgres.imp',
|
|
|
|
capture: true,
|
|
|
|
install: true,
|
|
|
|
install_dir: dir_lib,
|
|
|
|
build_by_default: false,
|
|
|
|
)
|
|
|
|
backend_link_args += '-Wl,-bE:@0@'.format(postgres_imp.full_path())
|
|
|
|
backend_link_depends += postgres_imp
|
|
|
|
endif
|
|
|
|
|
|
|
|
backend_input = []
|
|
|
|
backend_objs = [postgres_lib.extract_all_objects(recursive: false)]
|
|
|
|
|
|
|
|
# As of 1/2010:
|
|
|
|
# The probes.o file is necessary for dtrace support on Solaris, and on recent
|
|
|
|
# versions of systemtap. (Older systemtap releases just produce an empty
|
|
|
|
# file, but that's okay.) However, macOS's dtrace doesn't use it and doesn't
|
|
|
|
# even recognize the -G option. So, build probes.o except on macOS.
|
|
|
|
# This might need adjustment as other platforms add dtrace support.
|
|
|
|
#
|
|
|
|
# On at least linux we don't actually need to pass in all the objects, but
|
|
|
|
# at least on FreeBSD and Solaris we have to.
|
|
|
|
#
|
2022-10-06 21:22:36 +02:00
|
|
|
# XXX: The reason we don't use the objects for generated sources is that doing
|
|
|
|
# so is not supported in older meson versions. Luckily we don't have probes in
|
|
|
|
# generated sources...
|
meson: Add initial version of meson based build system
Autoconf is showing its age, fewer and fewer contributors know how to wrangle
it. Recursive make has a lot of hard to resolve dependency issues and slow
incremental rebuilds. Our home-grown MSVC build system is hard to maintain for
developers not using Windows and runs tests serially. While these and other
issues could individually be addressed with incremental improvements, together
they seem best addressed by moving to a more modern build system.
After evaluating different build system choices, we chose to use meson, to a
good degree based on the adoption by other open source projects.
We decided that it's more realistic to commit a relatively early version of
the new build system and mature it in tree.
This commit adds an initial version of a meson based build system. It supports
building postgres on at least AIX, FreeBSD, Linux, macOS, NetBSD, OpenBSD,
Solaris and Windows (however only gcc is supported on aix, solaris). For
Windows/MSVC postgres can now be built with ninja (faster, particularly for
incremental builds) and msbuild (supporting the visual studio GUI, but
building slower).
Several aspects (e.g. Windows rc file generation, PGXS compatibility, LLVM
bitcode generation, documentation adjustments) are done in subsequent commits
requiring further review. Other aspects (e.g. not installing test-only
extensions) are not yet addressed.
When building on Windows with msbuild, builds are slower when using a visual
studio version older than 2019, because those versions do not support
MultiToolTask, required by meson for intra-target parallelism.
The plan is to remove the MSVC specific build system in src/tools/msvc soon
after reaching feature parity. However, we're not planning to remove the
autoconf/make build system in the near future. Likely we're going to keep at
least the parts required for PGXS to keep working around until all supported
versions build with meson.
Some initial help for postgres developers is at
https://wiki.postgresql.org/wiki/Meson
With contributions from Thomas Munro, John Naylor, Stone Tickle and others.
Author: Andres Freund <andres@anarazel.de>
Author: Nazir Bilal Yavuz <byavuz81@gmail.com>
Author: Peter Eisentraut <peter@eisentraut.org>
Reviewed-By: Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Discussion: https://postgr.es/m/20211012083721.hvixq4pnh2pixr3j@alap3.anarazel.de
2022-09-22 06:53:12 +02:00
|
|
|
if dtrace.found() and host_system != 'darwin'
|
|
|
|
backend_input += custom_target(
|
|
|
|
'probes.o',
|
|
|
|
input: ['utils/probes.d', postgres_lib.extract_objects(backend_sources, timezone_sources)],
|
|
|
|
output: 'probes.o',
|
|
|
|
command: [dtrace, '-C', '-G', '-o', '@OUTPUT@', '-s', '@INPUT@'],
|
|
|
|
install: false,
|
|
|
|
)
|
|
|
|
endif
|
|
|
|
|
|
|
|
postgres = executable('postgres',
|
|
|
|
backend_input,
|
|
|
|
objects: backend_objs,
|
|
|
|
link_args: backend_link_args,
|
|
|
|
link_with: backend_link_with,
|
|
|
|
link_depends: backend_link_depends,
|
|
|
|
export_dynamic: true,
|
|
|
|
implib: true,
|
|
|
|
dependencies: backend_build_deps,
|
|
|
|
kwargs: default_bin_args,
|
|
|
|
)
|
|
|
|
|
|
|
|
backend_targets += postgres
|
|
|
|
|
|
|
|
pg_mod_c_args = cflags_mod
|
|
|
|
pg_mod_cpp_args = cxxflags_mod
|
|
|
|
pg_mod_link_args = ldflags_sl + ldflags_mod
|
|
|
|
pg_mod_link_depend = []
|
|
|
|
|
|
|
|
# A few platforms like MacOS and Windows link shared modules against postgres,
|
|
|
|
# or a [import] library derived from it. Set up the link flags for that.
|
|
|
|
if mod_link_args_fmt.length() > 0
|
|
|
|
# To avoid unnecessary build-time dependencies on other operating systems,
|
2022-10-06 21:22:36 +02:00
|
|
|
# only add the dependency when necessary.
|
meson: Add initial version of meson based build system
Autoconf is showing its age, fewer and fewer contributors know how to wrangle
it. Recursive make has a lot of hard to resolve dependency issues and slow
incremental rebuilds. Our home-grown MSVC build system is hard to maintain for
developers not using Windows and runs tests serially. While these and other
issues could individually be addressed with incremental improvements, together
they seem best addressed by moving to a more modern build system.
After evaluating different build system choices, we chose to use meson, to a
good degree based on the adoption by other open source projects.
We decided that it's more realistic to commit a relatively early version of
the new build system and mature it in tree.
This commit adds an initial version of a meson based build system. It supports
building postgres on at least AIX, FreeBSD, Linux, macOS, NetBSD, OpenBSD,
Solaris and Windows (however only gcc is supported on aix, solaris). For
Windows/MSVC postgres can now be built with ninja (faster, particularly for
incremental builds) and msbuild (supporting the visual studio GUI, but
building slower).
Several aspects (e.g. Windows rc file generation, PGXS compatibility, LLVM
bitcode generation, documentation adjustments) are done in subsequent commits
requiring further review. Other aspects (e.g. not installing test-only
extensions) are not yet addressed.
When building on Windows with msbuild, builds are slower when using a visual
studio version older than 2019, because those versions do not support
MultiToolTask, required by meson for intra-target parallelism.
The plan is to remove the MSVC specific build system in src/tools/msvc soon
after reaching feature parity. However, we're not planning to remove the
autoconf/make build system in the near future. Likely we're going to keep at
least the parts required for PGXS to keep working around until all supported
versions build with meson.
Some initial help for postgres developers is at
https://wiki.postgresql.org/wiki/Meson
With contributions from Thomas Munro, John Naylor, Stone Tickle and others.
Author: Andres Freund <andres@anarazel.de>
Author: Nazir Bilal Yavuz <byavuz81@gmail.com>
Author: Peter Eisentraut <peter@eisentraut.org>
Reviewed-By: Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Discussion: https://postgr.es/m/20211012083721.hvixq4pnh2pixr3j@alap3.anarazel.de
2022-09-22 06:53:12 +02:00
|
|
|
pg_mod_link_depend += postgres
|
|
|
|
|
|
|
|
name = mod_link_with_name.format('postgres')
|
|
|
|
link_with_uninst = meson.current_build_dir() / name
|
|
|
|
link_with_inst = '${@0@}/@1@'.format(mod_link_with_dir, name)
|
|
|
|
|
|
|
|
foreach el : mod_link_args_fmt
|
|
|
|
pg_mod_link_args += el.format(link_with_uninst)
|
|
|
|
endforeach
|
|
|
|
endif
|
|
|
|
|
|
|
|
|
|
|
|
# Note there's intentionally no dependency on pgport/common here - we want the
|
|
|
|
# symbols from the main binary for extension modules, rather than the
|
|
|
|
# extension linking separately to pgport/common.
|
|
|
|
backend_mod_code = declare_dependency(
|
|
|
|
compile_args: pg_mod_c_args,
|
|
|
|
include_directories: postgres_inc,
|
|
|
|
link_args: pg_mod_link_args,
|
|
|
|
sources: generated_headers + generated_backend_headers,
|
|
|
|
dependencies: backend_mod_deps,
|
|
|
|
)
|
|
|
|
|
|
|
|
pg_mod_args = default_mod_args + {
|
|
|
|
'dependencies': [backend_mod_code],
|
|
|
|
'cpp_args': pg_mod_cpp_args,
|
|
|
|
'link_depends': pg_mod_link_depend,
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# Shared modules that, on some system, link against the server binary. Only
|
|
|
|
# enter these after we defined the server build.
|
|
|
|
|
|
|
|
subdir('jit/llvm')
|
|
|
|
subdir('replication/libpqwalreceiver')
|
|
|
|
subdir('replication/pgoutput')
|
|
|
|
subdir('snowball')
|
|
|
|
subdir('utils/mb/conversion_procs')
|