All Versions
97
Latest Version
Avg Release Cycle
10 days
Latest Release
-

Changelog History
Page 4

  • v2.4.0 Changes

    Disk Format

    • Store array schemas under __schema directory #2258

    ๐Ÿ†• New features

    • ๐Ÿ Perform early audit for acceptable aws sdk windows path length #2260
    • ๐Ÿ‘Œ Support setting via config s3 BucketCannedACL and ObjectCannedACL via SetACL() methods #2383
    • โšก๏ธ Update spdlog dependency to 1.9.0 fixing c++17 compatibility and general improvements #1973
    • โž• Added Azure SAS token config support and new config option #2420
    • Load all array schemas in storage manager and pass the appropriate schema pointer to each fragment #2415
    • First revision of the Interval class #2417
    • Add tiledb_schema_evolution_t and new apis for schema evolution #2426
    • โž• Add ArraySchemaEvolution to cpp_api and its unit tests are also added. #2462
    • โž• Add c and cpp api functions for getting the array schema of a fragment #2468
    • โž• Add capnp serialization and rest support for array schema evolution objects #2467

    ๐Ÿ‘Œ Improvements

    • encryption_key and encryption_type parameters have been added to the config; internal APIs now use these parameters to set the key. #2245
    • ๐ŸŽ‰ Initial read refactor #2374
    • Create class ByteVecValue from typedef #2368
    • Encapsulate spdlog.h #2396
    • ๐Ÿš€ Update OSX target to 10.14 for release artifacts #2401
    • โž• Add nullable (and unordered, nullable) support to the smoke test. #2405
    • ๐ŸŽ‰ Initial sparse global order reader #2395
    • Remove sm.sub_partitioner_memory_budget #2402
    • โšก๏ธ Update the markdown documents for our new version of array schemas #2416
    • ๐Ÿ“œ Sparse global order reader: no more result cell slab copy. #2411
    • ๐Ÿ“œ Sparse global order reader: initial memory budget improvements. #2413
    • ๐Ÿ“œ Optimization of result cell slabs generation for sparse global order reader. #2414
    • โœ‚ Remove selective unfiltering. #2410
    • โšก๏ธ Updated Azure Storage Lite SDK to 0.3.0 #2419
    • ๐Ÿ“œ Respect memory budget for sparse global order reader. #2425
    • ๐Ÿ‘‰ Use newer Azure patch for all platforms to solve missing header error #2433
    • increased diag output for differences reported by tiledb_unit (some of which may be reasonable) #2437
    • Adjustments to schema evolution new attribute reads #2484
    • ๐Ÿ”„ Change Quickstart link in readthedocs/doxygen index.rst #2448
    • ๐ŸŽ‰ Initial sparse unordered with duplicates reader. #2441
    • โž• Add calls to malloc_trim on context and query destruction linux to potentially reduce idle memory usage #2443
    • โž• Add logger internals for std::string and std::stringstream for developer convenience #2454
    • ๐Ÿ‘ Allow empty attribute writes. #2461
    • ๐Ÿ”จ Refactored readers: serialization. #2458
    • ๐Ÿ‘ Allow null data pointers for writes. #2481
    • โšก๏ธ Update backwards compatibility arrays for 2.3.0 #2487

    ๐Ÿ—„ Deprecations

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fix to correctly apply capnproto create_symlink avoidance patch #2264
    • The bug for calculating max_size_validity for var_size attribute caused incomplete query #2266
    • Always run ASAN with matching compiler versions #2277
    • ๐Ÿ›  Fix some loop bounds that reference non-existent elements #2282
    • Treating std::vector like an array; accessing an element that is not present to get its address. #2276
    • ๐Ÿ›  Fix buffer arguments in unit-curl.cc #2287
    • Stop loop iterations within limits of vector being initialized. #2320
    • ๐Ÿ— Modify FindCurl_EP.cmake to work for WIN32 -EnableDebug builds #2319
    • ๐Ÿ›  Fixing test failure because of an uninitialized buffer. #2386
    • ๐Ÿ”„ Change a condition that assumed MSVC was the only compiler for WIN32 #2388
    • Fix defects in buffer classes: read, set_offset, advance_offset #2342
    • ๐Ÿ‘‰ Use CHECK_SAFE() to avoid multi-threaded conflict #2394
    • ๐Ÿ‘‰ Use tiledb _SAFE() items when overlapping threads may invoke code #2418
    • ๐Ÿ”„ Changes to address issues with default string dimension ranges in query #2436
    • Only set cmake policy CMP0076 if cmake version in use knows about it #2463
    • ๐Ÿ›  Fix handling curl REST request having all data in single call back #2485
    • Write queries should post start/end timestamps for REST arrays #2492

    API additions

    • Introduce new tiledb_experimental.h c-api header for new feature that don't have a stabilized api yet #2453
    • Introduce new tiledb_experimental cpp-api header for new feature that don't have a stabilized api yet #2453

    C API

    • ๐Ÿ”จ Refactoring [get/set]_buffer APIs #2315
    • Add tiledb_fragment_info_get_array_schema functions for getting the array schema of a fragment #2468
    • Add tiledb_schema_evolution_t and new apis for schema evolution #2426

    C++ API

    • ๐Ÿ”จ Refactoring [get/set]_buffer APIs #2399
    • โž• Add FragmentInfo::array_schema functions for getting the array schema of a fragment #2468
    • โž• Add ArraySchemaEvolution to cpp_api and its unit tests are also added. #2462
  • v2.3.4 Changes

    ๐Ÿ‘Œ Improvements

    • Query::set_layout: setting the layout on the subarray. #2451
    • ๐Ÿ‘ Allow empty attribute writes. #2461

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fix deserialization of buffers in write queries with nullable var-length attributes #2442
  • v2.3.3 Changes

    ๐Ÿ‘Œ Improvements

    • Increase REST (TileDB Cloud) retry count from 3 to 25 to be inline with S3/GCS retry times #2421
    • Avoid unnecessary est_result_size computation in must_split #2431
    • ๐Ÿ‘‰ Use newer Azure patch for all platforms to solve missing header error #2433

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fix c-api error paths always resetting any alloced pointers to nullptr in-addition to deleting #2427
  • v2.3.2 Changes

    ๐Ÿ‘Œ Improvements

    • ๐Ÿ‘Œ Support more env selectable options in both azure-windows.yml and azure-windows-release.yml #2384
    • ๐Ÿ Enable Azure/Serialization for windows CI artifacts #2400

    ๐Ÿ› Bug fixes

    • Correct check for last offset position so that undefined memory is not accessed. #2390
    • ๐Ÿ›  Fix ch8416, failure to read array written with tiledb 2.2 via REST #2404
    • ๐Ÿ›  Fix ch7582: use the correct buffer for validity deserialization #2407
  • v2.3.1 Changes

    ๐Ÿ‘Œ Improvements

    • โšก๏ธ Update bzip2 in windows build to 1.0.8 #2332
    • ๐Ÿ›  Fixing S3 build for OSX11 #2339
    • ๐Ÿ›  Fixing possible overflow in Dimension::tile_num #2265
    • ๐Ÿ›  Fixing tile extent calculations for signed integer domains #2303
    • โž• Add support for cross compilation on OSX in superbuild #2354
    • โœ‚ Remove curl link args for cross compilation #2359
    • ๐Ÿš€ Enable MacOS arm64 release artifacts #2360
    • Add more stats for `compute_result_coords` path #2366
    • ๐Ÿ‘Œ Support credentials refresh for AWS #2376

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fixing intermittent metadata test failure #2338
    • ๐Ÿ›  Fix query condition validation check for nullable attributes with null conditions #2344
    • Multi-range single dimension query fix #2347
    • Rewrite Dimension::overlap_ratio #2304
    • ๐Ÿ›  Follow up fixes to floating point calculations for tile extents #2341
    • Fix for set_null_tile_extent_to_range #2361
    • Subarray partitioner, unordered should be unordered, even for Hilbert. #2377
  • v2.3.0 Changes

    Disk Format

    • Format version incremented to 9. #2108

    ๐Ÿ’ฅ Breaking behavior

    • The setting of `sm.read_range_oob` now defaults to `warn`, allowing queries to run with bounded ranges that errored before. #2176
    • โœ‚ Removes TBB as an optional dependency #2181

    ๐Ÿ†• New features

    • Support TILEDB_DATETIME_{SEC,MS,US,NS} in arrow_io_impl.h #2228
    • โž• Adds support for filtering query results on attribute values #2141
    • โž• Adding support for time datatype dimension and attribute #2140
    • โž• Add support for serialization of config objects #2164
    • Add C and C++ examples to the examples/ directory for the tiledb_fragment_info_t APIs. #2160
    • ๐Ÿ‘Œ supporting serialization (using capnproto) build on windows #2100
    • ๐Ÿ‘ Config option "vfs.s3.sse" for S3 server-side encryption support #2130
    • โšก๏ธ Name attribute/dimension files by index. This is fragment-specific and updates the format version to version 9. #2107
    • ๐Ÿšš Smoke Test, remove nullable structs from global namespace. #2078

    ๐Ÿ‘Œ Improvements

    • replace ReadFromOffset with ReadRange in GCS::read() to avoid excess gcs egress traffic #2307
    • ๐Ÿ›  Hilbert partitioning fixes #2269
    • ๐Ÿ”จ Stats refactor #2267
    • ๐Ÿ‘Œ Improve Cap'n Proto cmake setup for system installations #2263
    • โš™ Runtime check for minimum validity buffer size #2261
    • Enable partial vacuuming when vacuuming with timestamps #2251
    • Consolidation: de-dupe FragmentInfo #2250
    • Consolidation: consider non empty domain before start timestamp #2248
    • โž• Add size details to s3 read error #2249
    • Consolidation: do not re-open array for each fragment #2243
    • ๐Ÿ‘Œ Support back compat writes #2230
    • ๐Ÿ‘ Serialization support for query conditions #2240
    • Make SubarrayPartitioner's member functions to return Status after calling Subarray::get_range_num. #2235
    • โšก๏ธ Update bzip2 super build version to 1.0.8 to address CVE-2019-12900 in libbzip2 #2233
    • Timestamp start and end for vacuuming and consolidation #2227
    • ๐Ÿ›  Fix memory leaks reported on ASAN when running with leak-detection. #2223
    • ๐Ÿ“‡ Use relative paths in consolidated fragment metadata #2215
    • Optimize Subarray::compute_relevant_fragments #2216
    • AWS S3: improve is_dir #2209
    • โž• Add nullable string to nullable attribute example #2212
    • AWS S3: adding option to skip Aws::InitAPI #2204
    • โž• Added additional stats for subarrays and subarray partitioners #2200
    • Introduces config parameter "sm.skip_est_size_partitioning" #2203
    • โž• Add config to query serialization. #2177
    • ๐Ÿ‘ Consolidation support for nullable attributes #2196
    • โœ… Adjust unit tests to reduce memory leaks inside the tests. #2179
    • โฌ‡๏ธ Reduces memory usage in multi-range range reads #2165
    • Add config option `sm.read_range_oob` to toggle bounding read ranges to domain or erroring #2162
    • ๐Ÿ Windows msys2 build artifacts are no longer uploaded #2159
    • โž• Add internal log functions to log at different log levels #2161
    • Parallelize Writer::filter_tiles #2156
    • โฑ Added config option "vfs.gcs.request_timeout_ms" #2148
    • ๐Ÿ‘Œ Improve fragment info loading by parallelizing fragment_size requests #2143
    • ๐Ÿ‘ Allow open array stats to be printed without read query #2131
    • ๐Ÿ‘ท Cleanup the GHA CI scripts - put common code into external shell scripts. #2124
    • โฌ‡๏ธ Reduced memory consumption in the read path for multi-range reads. #2118
    • ๐Ÿšš The latest version of dev was leaving behind a test/empty_string3/. This ensures that the directory is removed when make check is run. #2113
    • ๐Ÿ‘ท Migrating AZP CI to GA #2111
    • Cache non_empty_domain for REST arrays like all other arrays #2105
    • โž• Add additional stats printing to breakdown read state initialization timings #2095
    • โœ… Places the in-memory filesystem under unit test #1961
    • โž• Adds a Github Action to automate the HISTORY.md #2075
    • ๐Ÿ”„ Change printfs in C++ examples to cout, edit C print statements to fix format warnings #2226

    ๐Ÿ—„ Deprecations

    • The following APIs have been deprecated: tiledb_array_open_at, tiledb_array_open_at_with_key, tiledb_array_reopen_at. #2142

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fix a segfault on VFS::ls for the in-memory filesystem #2255
    • ๐Ÿ›  Fix rare read corruption in S3 #2253
    • โšก๏ธ Update some union initializers to use strict syntax #2242
    • ๐Ÿ›  Fix race within S3::init_client #2247
    • ๐Ÿ Expand accepted windows URIs. #2237
    • ๐Ÿ›  Write fix for unordered writes on nullable, fixed attributes. #2241
    • ๐Ÿ›  Fix tile extent to be reported as domain extent for sparse arrays with Hilbert ordering #2231
    • Do not consider option sm.read_range_oob for set_subarray() on Write queries #2211
    • ๐Ÿ”„ Change avoiding generation of multiple, concatenated, subarray flattened data. #2190
    • ๐Ÿ”„ Change mutex from basic to recursive #2180
    • ๐Ÿ›  Fixes a memory leak in the S3 read path #2189
    • ๐Ÿ›  Fixes a potential memory leak in the filter pipeline #2185
    • ๐Ÿ›  Fixes misc memory leaks in the unit tests #2183
    • Fix memory leak of `tiledb_config_t` in error path of `tiledb_config_alloc`. #2178
    • ๐Ÿ›  Fix check for null pointer in query deserialization #2163
    • ๐Ÿ›  Fixes a potential crash when retrying incomplete reads #2137
    • ๐Ÿ›  Fixes a potential crash when opening an array with consolidated fragment metadata #2135
    • ๐Ÿ“œ Corrected a bug where sparse cells may be incorrectly returned using string dimensions. #2125
    • ๐Ÿ›  Fix segfault in serialized queries when partition is unsplittable #2120
    • Always use original buffer size in serialized read queries serverside. #2115
    • ๐Ÿ›  Fix an edge-case where a read query may hang on array with string dimensions #2089

    API additions

    C API

    • Added tiledb_array_set_open_timestamp_start and tiledb_array_get_open_timestamp_start #2285
    • Added tiledb_array_set_open_timestamp_end and tiledb_array_get_open_timestamp_end #2285
    • Addition of tiledb_array_set_config to directly assign a config to an array. #2142
    • tiledb_query_get_array now returns a deep-copy #2184
    • Added `tiledb_serialize_config` and `tiledb_deserialize_config` #2164
    • Add new api, tiledb_query_get_config to get a query's config. #2167
    • Removes non-default parameter in "tiledb_config_unset". #2099

    C++ API

    • Added Array::set_open_timestamp_start and Array::open_timestamp_start #2285
    • Added Array::set_open_timestamp_end and Array::open_timestamp_end #2285
    • add Query::result_buffer_elements_nullable support for dims #2238
    • Addition of tiledb_array_set_config to directly assign a config to an array. #2142
    • โž• Add new api, Query.config() to get a query's config. #2167
    • โœ‚ Removes non-default parameter in "Config::unset". #2099
    • โž• Add support for a string-typed, variable-sized, nullable attribute in the C++ API. #2090
  • v2.2.9 Changes

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fix rare read corruption in S3 #2254
    • ๐Ÿ›  Write fix for unordered writes on nullable, fixed attributes #2241
  • v2.2.8 Changes

    Disk Format

    ๐Ÿ’ฅ Breaking C API changes

    ๐Ÿ’ฅ Breaking behavior

    ๐Ÿ†• New features

    • Support TILEDB_DATETIME_{SEC,MS,US,NS} in arrow_io_impl.h #2229
    • โž• Add support for serialization of config objects #2164
    • โž• Add support for serialization of query config #2177

    ๐Ÿ‘Œ Improvements

    • Optimize Subarray::compute_relevant_fragments #2218
    • โฌ‡๏ธ Reduces memory usage in multi-range range reads #2165
    • Add config option sm.read_range_oob to toggle bounding read ranges to domain or erroring #2162
    • โšก๏ธ Updates bzip2 to v1.0.8 on Linux/OSX #2233

    ๐Ÿ—„ Deprecations

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fixes a potential memory leak in the filter pipeline #2185
    • ๐Ÿ›  Fixes misc memory leaks in the unit tests #2183
    • Fix memory leak of tiledb_config_t in error path of tiledb_config_alloc. #2178

    API additions

    C API

    • tiledb_query_get_array now returns a deep-copy #2188
    • Add new api,tiledb_query_get_config to get a query's config. #2167
    • Added tiledb_serialize_config and tiledb_deserialize_config #2164

    C++ API

    • โž• Add new api, Query.config() to get a query's config. #2167
  • v2.2.7 Changes

    ๐Ÿ‘Œ Improvements

    • โฑ Added config option vfs.gcs.request_timeout_ms #2148
    • ๐Ÿ‘Œ Improve fragment info loading by parallelizing fragment_size requests #2143
    • Apply 'var_offsets.extra_element' mode to string dimension offsets too #2145
  • v2.2.6 Changes

    ๐Ÿ› Bug fixes

    • ๐Ÿ›  Fixes a potential crash when retrying incomplete reads #2137