All Versions
23
Latest Version
Avg Release Cycle
42 days
Latest Release
8 days ago

Changelog History
Page 1

  • v0.10.4 Changes

    October 12, 2021

    Acknowledgements:

    πŸ›  Fixes:

    • Fixed possibility of looping update GC during transaction commit (no public issue since the problem was discovered inside Positive Technologies.
    • Fixed #pragma pack to avoid provoking some compilers to generate code with unaligned access.
    • Fixed noexcept for potentially throwing txn::put() of C++ API.

    Minors:

    • Added stochastic test script for checking small transactions cases.
    • Removed extra transaction commit/restart inside test framework.
    • In debugging builds fixed a too small (single page) by default DB shrink threshold.
  • v0.10.3 Changes

    August 27, 2021

    Acknowledgements:

    Extensions and improvements:

    • Added cursor::erase() overloads for key and for key-value.
    • Resolve minor Coverity Scan issues (no fixes but some hint/comment were added).
    • Resolve minor UndefinedBehaviorSanitizer issues (no fixes but some workaround were added).

    πŸ›  Fixes:

    Minors:

    • Fixed getting revision number from middle of history during amalgamation (GNU Makefile).
    • Fixed search GCC tools for LTO (CMake scripts).
    • Fixed/reorder dirs list for search CLANG tools for LTO (CMake scripts).
    • Fixed/workarounds for CLANG < 9.x
    • Fixed CMake warning about compatibility with 3.8.2
  • v0.10.2 Changes

    July 26, 2021

    Acknowledgements:

    πŸ†• New features, extensions and improvements:

    • Allow to predefine/override MDBX_BUILD_TIMESTAMP for builds reproducibility.
    • Added options support for long-stochastic script.
    • Avoided MDBX_TXN_FULL error for large transactions when possible.
    • The MDBX_READERS_LIMIT increased to 32767.
    • Raise MDBX_TOO_LARGE under Valgrind/ASAN if being opened DB is 100 larger than RAM (to avoid hangs and OOM).
    • Minimized the size of poisoned/unpoisoned regions to avoid Valgrind/ASAN stuck.
    • Added more workarounds for QEMU for testing builds for 32-bit platforms, Alpha and Sparc architectures.
    • mdbx_chk now skips iteration & checking of DB' records if corresponding page-tree is corrupted (to avoid SIGSEGV, ASAN failures, etc).
    • Added more checks for rare/fuzzing corruption cases.

    Backward compatibility break:

    • Use file VERSION.txt for version information instead of VERSION to avoid collision with #include <version>.
    • Rename slice::from/to_FOO_bytes() to `slice::envisage_from/to_FOO_length()'.
    • Rename MDBX_TEST_EXTRA make's variable to MDBX_SMOKE_EXTRA.
    • Some details of the C++ API have been changed for subsequent freezing.

    πŸ›  Fixes:

  • v0.10.1 Changes

    June 01, 2021

    Acknowledgements:

    πŸ†• New features:

    • Added -p option to mdbx_stat utility for printing page operations statistic.
    • Added explicit checking for and warning about using unfit github's archives.
    • Added fallback from OFD locking to legacy non-OFD POSIX file locks on an EINVAL error.
    • Added Plan 9 network file system to the whitelist for an ability to open a DB in exclusive mode.
    • Support for opening from WSL2 environment a DB hosted on Windows drive and mounted via DrvFs (i.e by Plan 9 noted above).

    πŸ›  Fixes:

  • v0.10.0 Changes

    May 09, 2021

    Acknowledgements:

    πŸ†• New features:

    • Added mdbx_env_set_option() and mdbx_env_get_option() for controls various runtime options for an environment (announce of this feature was missed in a previous news).
    • Added MDBX_DISABLE_PAGECHECKS build option to disable some checks to reduce an overhead and detection probability of database corruption to a values closer to the LMDB. The MDBX_DISABLE_PAGECHECKS=1 provides a performance boost of about 10% in CRUD scenarios, and conjointly with the MDBX_ENV_CHECKPID=0 and MDBX_TXN_CHECKOWNER=0 options can yield up to 30% more performance compared to LMDB.
    • Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones (https://github.com/erthink/libmdbx/issues/166). To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation.
    • Added the mdbx_drop similar to LMDB command-line tool to purge or delete (sub)database(s).
    • Ruby bindings is available now by Mahlon E. Smith.
    • Added MDBX_ENABLE_MADVISE build option which controls the use of POSIX madvise() hints and friends.
    • The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases and a slight increase in limits for a keys size to β‰ˆΒ½ of page size.
    • Added to mdbx_chk output number of keys/items on pages.
    • Added explicit install-strip and install-no-strip targets to the Makefile (https://github.com/erthink/libmdbx/pull/180).
    • Major rework page splitting (af9b7b560505684249b76730997f9e00614b8113) for
      • An "auto-appending" feature upon insertion for both ascending and descending key sequences. As a result, the optimality of page filling increases significantly (more densely, less slackness) while inserting ordered sequences of keys,
      • A "splitting at middle" to make page tree more balanced on average.
    • Added mdbx_get_sysraminfo() to the API.
    • Added guessing a reasonable maximum DB size for the default upper limit of geometry (https://github.com/erthink/libmdbx/issues/183).
    • Major rework internal labeling of a dirty pages (958fd5b9479f52f2124ab7e83c6b18b04b0e7dda) for a "transparent spilling" feature with the gist to make a dirty pages be ready to spilling (writing to a disk) without further altering ones. Thus in the MDBX_WRITEMAP mode the OS kernel able to oust dirty pages to DB file without further penalty during transaction commit. As a result, page swapping and I/O could be significantly reduced during extra large transactions and/or lack of memory.
    • Minimized reading leaf-pages during dropping subDB(s) and nested trees.
    • Major rework a spilling of dirty pages to support LRU policy and prioritization for a large/overflow pages.
    • Statistics of page operations (split, merge, copy, spill, etc) now available through mdbx_env_info_ex().
    • Auto-setup limit for length of dirty pages list (MDBX_opt_txn_dp_limit option).
    • Support make options to list available build options.
    • Support make help to list available make targets.
    • Silently make's build by default.
    • Preliminary Python bindings is available now by Noel Kuntze (https://github.com/erthink/libmdbx/issues/147).

    Backward compatibility break:

    • The MDBX_AVOID_CRT build option was renamed to MDBX_WITHOUT_MSVC_CRT. This option is only relevant when building for Windows.
    • The mdbx_env_stat() always, and mdbx_env_stat_ex() when called with the zeroed transaction parameter, now internally start temporary read transaction and thus may returns MDBX_BAD_RSLOT error. So, just never use deprecated mdbx_env_stat()' and callmdbx_env_stat_ex()` with transaction parameter.
    • The build option MDBX_CONFIG_MANUAL_TLS_CALLBACK was removed and now just a non-zero value of the MDBX_MANUAL_MODULE_HANDLER macro indicates the requirement to manually call mdbx_module_handler() when loading libraries and applications uses statically linked libmdbx on an obsolete Windows versions.

    πŸ›  Fixes:

  • v0.9.4 Changes

    March 18, 2021

    TODO:

    Acknowledgements:

    πŸ†• New features:

    • Added MDBX_DISABLE_PAGECHECKS build option to disable some checks to reduce an overhead and detection probability of database corruption to a values closer to the LMDB. The MDBX_DISABLE_PAGECHECKS=1 provides a performance boost of about 10% in CRUD scenarios, and conjointly with the MDBX_ENV_CHECKPID=0 and MDBX_TXN_CHECKOWNER=0 options can yield up to 30% more performance compared to LMDB.
    • Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones (https://github.com/erthink/libmdbx/issues/166). To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation.
    • Added the mdbx_drop similar to LMDB command-line tool to purge or delete (sub)database(s).
    • Ruby bindings is available now by Mahlon E. Smith.
    • Added MDBX_ENABLE_MADVISE build option which controls the use of POSIX madvise() hints and friends.
    • The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases and a slight increase in limits for a keys size.

    πŸ›  Fixes:

  • v0.9.3 Changes

    February 02, 2021

    Acknowledgements:

    βœ‚ Removed options and features:

    • Drop MDBX_HUGE_TRANSACTIONS build-option (now no longer required).

    πŸ†• New features:

    • Package for FreeBSD is available now by Mahlon E. Smith.
    • New API functions to get/set various options (https://github.com/erthink/libmdbx/issues/128):
      • the maximum number of named databases for the environment;
      • the maximum number of threads/reader slots;
      • threshold (since the last unsteady commit) to force flush the data buffers to disk;
      • relative period (since the last unsteady commit) to force flush the data buffers to disk;
      • limit to grow a list of reclaimed/recycled page's numbers for finding a sequence of contiguous pages for large data items;
      • limit to grow a cache of dirty pages for reuse in the current transaction;
      • limit of a pre-allocated memory items for dirty pages;
      • limit of dirty pages for a write transaction;
      • initial allocation size for dirty pages list of a write transaction;
      • maximal part of the dirty pages may be spilled when necessary;
      • minimal part of the dirty pages should be spilled when necessary;
      • how much of the parent transaction dirty pages will be spilled while start each child transaction;
    • Unlimited/Dynamic size of retired and dirty page lists (https://github.com/erthink/libmdbx/issues/123).
    • Added -p option (purge subDB before loading) to mdbx_load tool.
    • Reworked spilling of large transaction and committing of nested transactions:
      • page spilling code reworked to avoid the flaws and bugs inherited from LMDB;
      • limit for number of dirty pages now is controllable at runtime;
      • a spilled pages, including overflow/large pages, now can be reused and refunded/compactified in nested transactions;
      • more effective refunding/compactification especially for the loosed page cache.
    • Added MDBX_ENABLE_REFUND and MDBX_PNL_ASCENDING internal/advanced build options.
    • Added mdbx_default_pagesize() function.
    • Better support architectures with a weak/relaxed memory consistency model (ARM, AARCH64, PPC, MIPS, RISC-V, etc) by means C11 atomics.
    • Speed up page number lists and dirty page lists (https://github.com/erthink/libmdbx/issues/132).
    • Added LIBMDBX_NO_EXPORTS_LEGACY_API build option.

    πŸ›  Fixes:

  • v0.9.2 Changes

    November 27, 2020

    Acknowledgements:

    βž• Added features:

    • πŸ— Provided package for buildroot.
    • Binding for Nim is available now by Jens Alfke.
    • Added mdbx_env_delete() for deletion an environment files in a proper and multiprocess-safe way.
    • Added mdbx_txn_commit_ex() with collecting latency information.
    • Fast completion pure nested transactions.
    • Added LIBMDBX_INLINE_API macro and inline versions of some API functions.
    • Added mdbx_cursor_copy() function.
    • βœ… Extended tests for checking cursor tracking.
    • Added MDBX_SET_LOWERBOUND operation for mdbx_cursor_get().

    πŸ›  Fixes:

    • πŸ›  Fixed missing installation of mdbx.h++.
    • πŸ›  Fixed use of obsolete __noreturn.
    • πŸ›  Fixed use of yield instruction on ARM if unsupported.
    • βž• Added pthread workaround for buggy toolchain/cmake/buildroot.
    • πŸ›  Fixed use of pthread_yield() for non-GLIBC.
    • πŸ›  Fixed use of RegGetValueA() on Windows 2000/XP.
    • πŸ›  Fixed use of GetTickCount64() on Windows 2000/XP.
    • πŸ›  Fixed opening DB on a network shares (in the exclusive mode).
    • πŸ›  Fixed copy&paste typos.
    • πŸ›  Fixed minor false-positive GCC warning.
    • Added workaround for broken DEFINE_ENUM_FLAG_OPERATORS from Windows SDK.
    • πŸ›  Fixed cursor state after multimap/dupsort repeated deletes (#121).
    • Added SIGPIPE suppression for internal thread during mdbx_env_copy().
    • Fixed extra-rare MDBX_KEY_EXIST error during mdbx_commit() (#131).
    • πŸ›  Fixed spilled pages checking (#126).
    • πŸ›  Fixed mdbx_load for 'plain text' and without -s name cases (#136).
    • πŸ›  Fixed save/restore/commit of cursors for nested transactions.
    • πŸ›  Fixed cursors state in rare/special cases (move next beyond end-of-data, after deletion and so on).
    • βž• Added workaround for MSVC 19.28 (Visual Studio 16.8) (but may still hang during compilation).
    • πŸ›  Fixed paranoidal Clang C++ UB for bitwise operations with flags defined by enums.
    • πŸ›  Fixed large pages checking (for compatibility and to avoid false-positive errors from mdbx_chk).
    • βž• Added workaround for Wine (miranda-ng/miranda-ng#1209).
    • Fixed ERROR_NOT_SUPPORTED while opening DB by UNC pathnames (miranda-ng/miranda-ng#2627).
    • Added handling EXCEPTION_POSSIBLE_DEADLOCK condition for Windows.

    TODO for v0.9.3

    • Engage new terminology (#137).
    • πŸ”€ Rework/speedup the implementation of the dirty page list (lazy compactification, lazy sorting via merge).
    • Resolve few TODOs (#123, #124, #127, #128, #132, #115).
    • ✏️ Finalize C++ API (few typos and trivia bugs are still likely for now).
    • 🐧 Packages for ROSA Linux, ALT Linux, Fedora/RHEL, Debian/Ubuntu.

    SHA256 checksums

    c35cc53d66d74ebfc86e39441ba26276541ac7892bf91dba1e70c83665a02767 libmdbx-amalgamated-0.9.2.tar.gz
    82523330f701939325ce96becace35ec739d30f8e98ec776c4d50bc8745297a8 libmdbx-amalgamated-0_9_2.zip
    a98382d85a06a551393a89152a50c53fd45abf6bf9f5e01e594bbd799c1352c7 v0.9.2.tar.gz
    099b31eef060bd41c35221ba2c805571d173b936075da9a97fcaf4801c8c2ecf v0.9.2.zip
    
  • v0.9.1 Changes

    September 30, 2020

    βž• Added features:

    • πŸ‘ Preliminary C++ API with support for C++17 polymorphic allocators.
    • Online C++ API reference by Doxygen.
    • ⚑️ Quick reference for Insert/Update/Delete operations.
    • πŸ”€ Explicit MDBX_SYNC_DURABLE to sync modes for API clarity.
    • Explicit MDBX_ALLDUPS and MDBX_UPSERT for API clarity.
    • Support for read transactions preparation (MDBX_TXN_RDONLY_PREPARE flag).
    • Support for cursor preparation/(pre)allocation and reusing (mdbx_cursor_create() and mdbx_cursor_bind() functions).
    • πŸ‘Œ Support for checking database using specified meta-page (see mdbx_chk -h).
    • πŸ‘Œ Support for turn to the specific meta-page after checking (see mdbx_chk -h).
    • πŸ‘Œ Support for explicit reader threads (de)registration.
    • The mdbx_txn_break() function to explicitly mark a transaction as broken.
    • Improved handling of corrupted databases by mdbx_chk utility and mdbx_walk_tree() function.
    • πŸ‘Œ Improved DB corruption detection by checking parent-page-txnid.
    • πŸ‘Œ Improved opening large DB (> 4Gb) from 32-bit code.
    • Provided pure-function and const-function attributes to C API.
    • πŸ‘Œ Support for user-settable context for transactions & cursors.
    • πŸ“š Revised API and documentation related to Handle-Slow-Readers callback feature.

    πŸ—„ Deprecated functions and flags:

    • πŸ—„ For clarity and API simplification the MDBX_MAPASYNC flag is deprecated.
      Just use MDBX_SAFE_NOSYNC or MDBX_UTTERLY_NOSYNC instead of it.
    • MDBX_oom_func, mdbx_env_set_oomfunc() and mdbx_env_get_oomfunc()
      replaced with MDBX_hsr_func, mdbx_env_get_hsr and mdbx_env_get_hsr().

    πŸ›  Fixes:

    • Fix mdbx_strerror() for MDBX_BUSY error (no error description is returned).
    • πŸ›  Fix update internal meta-geo information in read-only mode (EACCESS or EBADFD error).
    • Fix mdbx_page_get() null-defer when DB corrupted (crash by SIGSEGV).
    • Fix mdbx_env_open() for re-opening after non-fatal errors (mdbx_chk unexpected failures).
    • β†ͺ Workaround for MSVC 19.27 static_assert() bug.
    • Doxygen descriptions and refinement.
    • ⚑️ Update Valgrind's suppressions.
    • βœ… Workaround to avoid infinite loop of 'nested' testcase on MIPS under QEMU.
    • πŸ›  Fix a lot of typos & spelling (Thanks to Josh Soref for PR).
    • πŸ›  Fix getopt() messages for Windows (Thanks to Andrey Sporaw for reporting).
    • πŸ›  Fix MSVC compiler version requirements (Thanks to Andrey Sporaw for reporting).
    • πŸ— Workarounds for QEMU's bugs to run tests for cross-builded library under QEMU.
    • πŸ— Now C++ compiler optional for building by CMake.

    TODO for next version(s):

    • πŸ”€ Rework/speedup the implementation of the dirty page list (lazy compactification, lazy sorting via merge).
    • ✏️ Finalize C++ API (few typos and trivia bugs are likely for now).
    • 🐧 Packages for ROSA Linux, ALT Linux, Fedora/RHEL, Debian/Ubuntu.
  • v0.9.0 Changes

    July 30, 2020

    βž• Added features:

    • Online C API reference by Doxygen.
    • Separated enums for environment, sub-databases, transactions, copying and data-update flags.

    πŸ—„ Deprecated functions and flags:

    • Usage of custom comparators and the mdbx_dbi_open_ex() are deprecated, since such databases couldn't be checked by the mdbx_chk utility. Please use the value-to-key functions to provide keys that are compatible with the built-in libmdbx comparators.