libmdbx v0.10.0 Release Notes
Release Date: 2021-05-09 // almost 3 years ago-
Acknowledgements:
- Mahlon E. Smith for Ruby bindings.
- Alex Sharov for mdbx-go, bug reporting and testing.
- Artem Vorotnikov for bug reporting and PR.
- Paolo Rebuffo, Alexey Akhunov and Mark Grosberg for donations.
- Noel Kuntze for preliminary Python bindings
🆕 New features:
- Added
mdbx_env_set_option()
andmdbx_env_get_option()
for controls various runtime options for an environment (announce of this feature was missed in a previous news). - Added
MDBX_DISABLE_PAGECHECKS
build option to disable some checks to reduce an overhead and detection probability of database corruption to a values closer to the LMDB. TheMDBX_DISABLE_PAGECHECKS=1
provides a performance boost of about 10% in CRUD scenarios, and conjointly with theMDBX_ENV_CHECKPID=0
andMDBX_TXN_CHECKOWNER=0
options can yield up to 30% more performance compared to LMDB. - Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones (https://github.com/erthink/libmdbx/issues/166). To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation.
- Added the
mdbx_drop
similar to LMDB command-line tool to purge or delete (sub)database(s). - Ruby bindings is available now by Mahlon E. Smith.
- Added
MDBX_ENABLE_MADVISE
build option which controls the use of POSIXmadvise()
hints and friends. - The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases and a slight increase in limits for a keys size to ≈½ of page size.
- Added to
mdbx_chk
output number of keys/items on pages. - Added explicit
install-strip
andinstall-no-strip
targets to theMakefile
(https://github.com/erthink/libmdbx/pull/180). - Major rework page splitting (af9b7b560505684249b76730997f9e00614b8113) for
- An "auto-appending" feature upon insertion for both ascending and descending key sequences. As a result, the optimality of page filling increases significantly (more densely, less slackness) while inserting ordered sequences of keys,
- A "splitting at middle" to make page tree more balanced on average.
- Added
mdbx_get_sysraminfo()
to the API. - Added guessing a reasonable maximum DB size for the default upper limit of geometry (https://github.com/erthink/libmdbx/issues/183).
- Major rework internal labeling of a dirty pages (958fd5b9479f52f2124ab7e83c6b18b04b0e7dda) for
a "transparent spilling" feature with the gist to make a dirty pages
be ready to spilling (writing to a disk) without further altering ones.
Thus in the
MDBX_WRITEMAP
mode the OS kernel able to oust dirty pages to DB file without further penalty during transaction commit. As a result, page swapping and I/O could be significantly reduced during extra large transactions and/or lack of memory. - Minimized reading leaf-pages during dropping subDB(s) and nested trees.
- Major rework a spilling of dirty pages to support LRU policy and prioritization for a large/overflow pages.
- Statistics of page operations (split, merge, copy, spill, etc) now available through
mdbx_env_info_ex()
. - Auto-setup limit for length of dirty pages list (
MDBX_opt_txn_dp_limit
option). - Support
make options
to list available build options. - Support
make help
to list available make targets. - Silently
make
's build by default. - Preliminary Python bindings is available now by Noel Kuntze (https://github.com/erthink/libmdbx/issues/147).
Backward compatibility break:
- The
MDBX_AVOID_CRT
build option was renamed toMDBX_WITHOUT_MSVC_CRT
. This option is only relevant when building for Windows. - The
mdbx_env_stat()
always, andmdbx_env_stat_ex()
when called with the zeroed transaction parameter, now internally start temporary read transaction and thus may returnsMDBX_BAD_RSLOT
error. So, just never use deprecatedmdbx_env_stat()' and call
mdbx_env_stat_ex()` with transaction parameter. - The build option
MDBX_CONFIG_MANUAL_TLS_CALLBACK
was removed and now just a non-zero value of theMDBX_MANUAL_MODULE_HANDLER
macro indicates the requirement to manually callmdbx_module_handler()
when loading libraries and applications uses statically linked libmdbx on an obsolete Windows versions.
🛠 Fixes:
- Fixed performance regression due non-optimal C11 atomics usage (https://github.com/erthink/libmdbx/issues/160).
- Fixed "reincarnation" of subDB after it deletion (https://github.com/erthink/libmdbx/issues/168).
- Fixed (disallowing) implicit subDB deletion via operations on
@MAIN
's DBI-handle. - Fixed a crash of
mdbx_env_info_ex()
in case of a call for a non-open environment (https://github.com/erthink/libmdbx/issues/171). - Fixed the selecting/adjustment values inside
mdbx_env_set_geometry()
for implicit out-of-range cases (https://github.com/erthink/libmdbx/issues/170). - Fixed
mdbx_env_set_option()
for set initial and limit size of dirty page list ((https://github.com/erthink/libmdbx/issues/179). - Fixed an unreasonably huge default upper limit for DB geometry (https://github.com/erthink/libmdbx/issues/183).
- Fixed
constexpr
specifier for theslice::invalid()
. - Fixed (no)readahead auto-handling (https://github.com/erthink/libmdbx/issues/164).
- Fixed non-alloy build for Windows.
- Switched to using Heap-functions instead of LocalAlloc/LocalFree on Windows.
- Fixed
mdbx_env_stat_ex()
to returning statistics of the whole environment instead of MainDB only (https://github.com/erthink/libmdbx/issues/190). - Fixed building by GCC 4.8.5 (added workaround for a preprocessor's bug).
- Fixed building C++ part for iOS <= 13.0 (unavailability of
std::filesystem::path
). - Fixed building for Windows target versions prior to Windows Vista (
WIN32_WINNT < 0x0600
). - Fixed building by MinGW for Windows (https://github.com/erthink/libmdbx/issues/155).