Project: ClickHouse (App Definition and Development / Database)
File: v23.8.1.2992-lts.md

sidebar_position: 1 sidebar_label: 2023 Deprecate the metadata cache feature. It is experimental and we have never used it. The feature is dangerous: . Remove the `system.mergetreemetadata_cache` system table. The metadata cache is still available in this version but will be removed soon. This closes . (). If a dynamic disk contains a name, it should be specified as `disk = disk(name = 'diskname'`, ...) in disk function arguments. In previous version it could be specified as `disk = disk<disk_name>(...)`, which is no longer supported. (). `clickhouse-benchmark` will establish connections in parallel when invoked with `--concurrency` more than one. Previously it was unusable if you ran it with 1000 concurrent connections from Europe to the US. Correct calculation of QPS for connections with high latency. Backward incompatible change: the option for JSON output of `clickhouse-benchmark` is removed. If you've used this option, you can also extract data from the `system.query_log` in JSON format as a workaround. (). The `microseconds` column is removed from the `system.textlog`, and the `milliseconds` column is removed from the `system.metriclog`, because they are redundant in the presence of the `eventtimemicroseconds` column. (). Changed zookeeper paths for storage `S3Queue` metadata. (). Add column `ptr` to `system.tracelog` for `tracetype = 'MemorySample'`. This column contains an address of allocation. Added function `flameGraph` which can build flamegraph containing allocated and not released memory. Reworking of . (). Add setting `rewritecountdistinctifwithcountdistinctimplementation` to rewrite `countDistinctIf` with `countdistinct_implementation`. Closes . (). Add new table engine `S3Queue` for streaming data import from s3. Closes . (). SevenZipArchiveReader - TarArchiveReader - Table Function file('pathtoarchive :: filename') - Functional tests for "Table Function file('pathtoarchive :: filename')" - Unit tests for TarArchiveReader/SevenZipArchiveReader. (). Added table function azureBlobStorageCluster table function. The supported set of features is very similar to table function S3Cluster. (). Allow using cluster, clusterAllReplicas, remote, remoteRaw and remoteSecure without table name in issue . (). System table to monitor kafka consumers. (). Added maxsessionsfor_user setting. (). Now that clickhouse do not have a function to convert UTC timezone timestamp to other timezone timestamp, which is not same as spark, and so we and the functions `toUTCTimestamp/fromUTCTimestamp` to act same as spark's `toutctimestamp/fromutctimestamp`. (). Add new functions `structureToCapnProtoSchema`/`structureToProtobufSchema` that convert ClickHouse table structure to CapnProto/Protobuf format schema. Allow to intput/output data in CapnProto/Protobuf format without external format schema using autogenerated schema from table structure (controled by settings `formatcapnprotouseautogeneratedschema`/`formatprotobufuseautogeneratedschema`). Allow to export autogenerated schema while input/outoput using setting `outputformat_schema`. (). A new field "querycacheusage" in SYSTEM.QUERY_LOG now shows if and how the query cache was used. (). Add new function startsWithUTF8 and endsWithUTF8. (). Allow variable number of columns in TSV/CuatomSeprarated/JSONCompactEachRow, make schema inference work with variable number of columns. Add settings `inputformattsvallowvariablenumberofcolumns`, `inputformatcustomallowvariablenumberofcolumns`, `inputformatjsoncompactallowvariablenumberofcolumns`. (). Added `SYSTEM STOP/START PULLING REPLICATION LOG` queries (for testing `ReplicatedMergeTree`). (). Allow to execute constant non-deterministic functions in mutations on initiator. (). Add input format One that doesn't read any data and always returns single row with column `dummy` with type `UInt8` and value `0` like `system.one`. It can be used together with `file/path` virtual columns to list files in file/s3/url/hdfs/etc table functions without reading any data. (). Add tupleConcat function. Closes . (). Support `TRUNCATE DATABASE` operation. (). Add maxthreadsfor_indexes setting to limit number of threads used for primary key processing. (). Add experimental support for HNSW as approximate neighbor search method. (). Re-add SipHash keyed functions. (). ( , ) Added functions `arrayRotateLeft`, `arrayRotateRight`, `arrayShiftLeft`, `arrayShiftRight`.

Add column `name` to `system.clusters` as an alias to cluster. (). The advanced dashboard now allows mass editing (save/load). (). Add support for plural units. (). Support function `isNotDistinctFrom` in join on section for null-safe comparison, ref . (). Added the "hideinpreprocessed" attribute to ClickHouse's server configuration XML dialect. This is a mechanism to hide certain settings from appearing in preprocessed server configuration files. Useful e.g. for passwords or private keys that should not appear verbatim in files. (). Added server setting validatetcpclient_information determines whether validation of client information enabled when query packet is received. (). Enable JIT compilation for AArch64, PowerPC, SystemZ, RISCV. (). This patch will provide a method to deal with all the hashsets in parallel before merge. (). Optimize aggregation performance of nullable string key when using aggregationmethodserialized. (). The performance experiments of SSB on the ICX device (Intel Xeon Platinum 8380 CPU, 80 cores, 160 threads) show that this change could bring an improvement of 8.5% to the geomean QPS* when the experimental analyzer is enabled. The details are shown below: . (). Parquet filter pushdown. I.e. when reading Parquet files, row groups (chunks of the file) are skipped based on the WHERE condition and the min/max values in each column. In particular, if the file is roughly sorted by some column, queries that filter by a short range of that column will be much faster. (). Optimize the merge if all hashSets are singleLevel in UniqExactSet. (). StorageJoin: do not create clone hash join with all columns. (). Optimize reading small row groups by batching them together in Parquet. Closes . (). Implement native orc input format without arrow to improve performance. (). The dashboard will tell the server to compress the data, which is useful for large time frames over slow internet connections. For example, one chart with 86400 points can be 1.5 MB uncompressed and 60 KB compressed with `br`. (). Optimize count from files in most input formats. Closes . (). Better utilization of thread pool for BACKUPs&RESTOREs. (). Remove useless slow on client performance check. (). Bloom filter indices are pruned so that they correlate with cardinality of the data set they are tracking. (). Add `stderr_reaction` configuration/setting to control the reaction (none, log or throw) when external command stderr has data. This helps make debugging external command easier. (). Https://github.com/clickhouse/clickhouse/issues/48720. @kgoralski helped with some thought about `system.merges` part. :d. (). If a dictionary is created with a complex key, automatically choose the "complex key" layout variant. (). Add setting `useconcurrencycontrol` for better testing of the new concurrency control feature. (). Added suggestions for mistyped names for db and tables with different scenarios commented. (). While read small files from hdfs by gluten, we found that it will cost more times when compare to directly query by spark. (). Too many worthless error logs after session expiration. (). Introduce fallback ZooKeeper sessions which are time-bound. Fixed `index` column in system.zookeeper_connection for DNS addresses. (). Add ability to log when maxpartitionsperinsertblock is reached ... (). Added a bunch of custom commands (mostly to make ClickHouse debugging easier). (). Updated check for connection_string as connection string with sas does not always begin with DefaultEndPoint and updated connection url to include sas token after adding container to url. (). Fix description for filtering sets in fullsortingmerge join.

The sizes of the (index) uncompressed/mark, mmap and query caches can now be configured dynamically at runtime. (). Fixed memory consumption in `Aggregator` when `maxblocksize` is huge. (). Add `SYSTEM SYNC FILESYSTEM CACHE` command. It will compare in-memory state of filesystem cache with what it has on disk and fix in-memory state if needed. (). Attempt to create a generic proxy resolver for CH while keeping backwards compatibility with existing S3 storage conf proxy resolver. (). Support reading tuple subcolumns from file/s3/hdfs/url/azureBlobStorage table functions. (). Function `arrayIntersect` now returns the values sorted like the first argument. Closes . (). Add new queries, which allow to create/drop of access entities in specified access storage or move access entities from one access storage to another. (). ALTER TABLE FREEZE are not replicated in Replicated engine. (). Added possibility to flush logs to the disk on crash - Added logs buffer configuration. (). Fix S3 table function does not work for pre-signed URL. close . (). System.events and system.metrics tables add column name as an alias to event and metric. close . (). Added support of syntax `CREATE UNIQUE INDEX` in parser for better SQL compatibility. `UNIQUE` index is not supported. Set `createindexignore_unique=1` to ignore UNIQUE keyword in queries. (). Add support of predefined macro (`{database}` and `{table}`) in some kafka engine settings: topic, consumer, client_id, etc. (). Disable updating fs cache during backup/restore. Filesystem cache must not be updated during backup/restore, it seems it just slows down the process without any profit (because the BACKUP command can read a lot of data and it's no use to put all the data to the filesystem cache and immediately evict it). (). Updated parameterized view implementation to create new StorageView with substituted parameters for every SELECT query of a parameterized view. (). The configuration of S3 endpoint allow using it from the root, and append '/' automatically if needed. . (). Added support for adding and subtracting arrays: `. (). Add support for string literals as table name. Closes . (). For clickhouse-local allow positional options and populate global UDF settings (userscriptspath and userdefinedexecutablefunctionsconfig). (). System.asynchronous_metrics now includes metrics "querycacheentries" and "querycachebytes" to inspect the query cache. (). Added possibility use s3storageclass parameter in SETTINGS of BACKUP statement for backups to S3. (). Improve insert retries on keeper session expiration. (). Add utility `print-backup-info.py` which parses a backup metadata file and prints information about the backup. (). Closes . Currently we have database and table names case-sensitive, but the tools query `informationschema` sometimes in lowercase, sometimes in uppercase. For this reason we have `informationschema` database, containing lowercase tables, such as `informationschema.tables` and `INFORMATIONSCHEMA` database, containing uppercase tables, such as `INFORMATIONSCHEMA.TABLES`. But some tools are querying `INFORMATIONSCHEMA.tables` and `informationschema.TABLES`. The proposed solution is to duplicate both lowercase and uppercase tables in lowercase and uppercase `informationschema` database. (). `GETPART` and `ATTACHPART` are almost identical, so they should use same executor pool. (). Query`CHECK TABLE` has better performance and usability (sends progress updates, cancellable). (). Add modulo, intDiv, intDivOrZero for tuple. (). Search for default `yaml` and `yml` configs in clickhouse-client after `xml`. (). When merging into non-'clickhouse' rooted configuration, configs with different root node name just bypassed without exception. (). Now it's possible to specify min (`memoryprofilersampleminallocationsize`) and max (`memoryprofilersamplemaxallocationsize`) size for allocations to be tracked with sampling memory profiler. (). Add `precisefloatparsing` setting to switch float parsing methods (fast/precise). (). Use the same default paths for `clickhousekeeper` (symlink) as for `clickhousekeeper` (executable).

CVE-2016-2183: disable 3DES. (). Load filesystem cache metadata on startup in parallel. Configured by `loadmetadatathreads` (default: 1) cache config setting. Related to . (). Improve error message for table function remote. Closes . (). Added the possibility to specify custom storage policy in the `SETTINGS` clause of `RESTORE` queries. (). Add the ability to throttle the S3 requests on backup operations (`BACKUP` and `RESTORE` commands now honor `s3max (). Add settings to ignore ON CLUSTER clause in queries for management of replicated user-defined functions or access control entities with replicated storage. (). Enable parallel reading from replicas over distributed table. Related to . (). EXPLAIN actions for JOIN step. (). Make `hasTokenOrNull` and `hasTokenCaseInsensitiveOrNull` return null for empty needles. (). Allow to restrict allowed paths for filesystem caches. Mainly useful for dynamic disks. If in server config `filesystemcachespath` is specified, all filesystem caches' paths will be restricted to this directory. E.g. if the `path` in cache config is relative - it will be put in `filesystemcachespath`; if `path` in cache config is absolute, it will be required to lie inside `filesystemcachespath`. If `filesystemcachespath` is not specified in config, then behaviour will be the same as in earlier versions. (). Added a bunch of custom commands (mostly to make ClickHouse debugging easier). (). Add diagnostic info about file name during schema inference - it helps when you process multiple files with globs. (). Client will load suggestions using the main connection if the second connection is not allowed to create a session. (). Add EXCEPT clause to `SYSTEM STOP/START LISTEN QUERIES (). Change the default of `maxconcurrentqueries` from 100 to 1000. It's ok to have many concurrent queries if they are not heavy, and mostly waiting for the network. Note: don't confuse concurrent queries and QPS: for example, ClickHouse server can do tens of thousands of QPS with less than 100 concurrent queries. (). Add ability to override credentials for accessing base backup in S3 (since tokens may be expired). (). Improve `moveprimarykeycolumnstoendof_prewhere`. (). Limit number of concurrent background partition optimize merges. (). Added a setting `allowmovingtabledirectoryto_trash` that allows to ignore `Directory for table data already exists` error when replicating/recovering a `Replicated` database. (). Server settings asynchronousmetricsupdateperiods and asynchronousheavymetricsupdateperiod_s configured to 0 now fail gracefully instead of crash the server. (). Previously the caller could register the same watch callback multiple times. In that case each entry was consuming memory and the same callback was called multiple times which didn't make much sense. In order to avoid this the caller could have some logic to not add the same watch multiple times. With this change this deduplication is done internally if the watch callback is passed via shared_ptr. (). The ClickHouse server now respects memory limits changed via cgroups when reloading its configuration. (). Add ability to turn off flush of Distributed tables on `DETACH`/`DROP`/server shutdown. (). Domainrfc support ipv6(ip literal within square brackets). (). Use filter by file/path before reading in url/file/hdfs table functins. (). Use longer timeout for S3 CopyObject requests. (). Added server setting `aggregatefunctiongrouparraymaxelementsize`. This setting is used to limit array size for `groupArray` function at serialization. The default value is `16777215`. (). `SCHEMA()` was added as alias for `DATABASE()` to improve MySQL compatibility. (). Add asynchronous metrics about tables in the system database. For example, `TotalBytesOfMergeTreeTablesSystem`. This closes . (). SQL editor in the Play UI and Dashboard will not use Grammarly.

The advanced dashboard now has an option to maximize charts and move them around. (). As expert-level settings, it is now possible to 1. configure the size_ratio (i.e. the relative size of the protected queue) of the (). More careful thread management will improve the speed of the S3 table function over a large number of files by more than ~25%. (). Upgrade snappy to 1.1.10, clickhouse may benefit from it. (). Added client info validation to the query packet in TCPHandler. (). Cache number of rows in files for count in file/s3/url/hdfs/azure functions. The cache can be enabled/disabled by setting `usecacheforcountfrom_files` (enabled by default). Continuation of https://github.com/ClickHouse/ClickHouse/pull/53637. (). Updated to retry loading part in case of Azure::Core::Http::TransportException (https://github.com/ClickHouse/ClickHouse/issues/39700#issuecomment-1686442785). (). Stacktrace for exceptions, Materailized view exceptions are propagated. (). If no hostname or port were specified, keeper client will try to search for a connection string in the ClickHouse's config.xml. (). Add profile event `PartsLockMicroseconds` which shows the amount of microseconds we hold the data parts lock in MergeTree table engine family. (). Make reconnect limit in raft limits configurable for keeper. This configuration can help to make keeper to rebuild connection with peers quicker if the current connection is broken. (). Supported globs in select from file in clickhouse-local. (). ...Ignore foreign keys in tables definition to improve compatibility with MySQL, so a user wouldn't need to rewrite his SQL of the foreign key part, ref . (). 'from' is supported as a Expression. (). Changes of the server configuration are now detected with high precision (milliseconds and less). (). Don't expose symbols from ClickHouse binary to dynamic linker. It might fix . (). Fixed endian issues in native protocol. (). Build `clickhouse/nginx-dav` and use it in integration tests instead of `kssenii/nginx-test`. Addresses . (). Add `clickhouse-keeper-client` symlink to the clickhouse-server package. (). Fixed ForEach aggregate function state for s390x. (). Add https://github.com/elliotchance/sqltest to CI to report the SQL 2016 conformance. (). Fixed codec delta endian issue for s390x. (). Packing inline cache into docker images sometimes causes strange special effects. Since we don't use it at all, it's good to go. (). Upgrade PRQL to 0.9.3. (). System tables from CI checks are exported to ClickHouse Cloud. (). The compiler's profile data (`-ftime-trace`) is uploaded to ClickHouse Cloud. (). Speed up Debug and Tidy builds. (). Speed up the build by removing tons and tonnes of garbage. One of the frequently included headers was poisoned by boost. (). Add ClickHouse builds for Linux s390x to CI. (). Remove even more garbage. (). The function `arrayAUC` was using heavy C++ templates. (). Some translation units were always rebuilt regardless of ccache. The culprit is found and fixed. (). The compiler's profile data (`-ftime-trace`) is uploaded to ClickHouse Cloud., the second attempt after . (). Three tests were failing / flaky: 1. testhostregexpmultipleptrrecords 2. testhostregexpmultipleptrrecordsconcurrent 3. testreversednsquery. (). Export logs from CI in stateful tests to ClickHouse Cloud. (). Export logs from CI in stress tests. (). Export logs from CI in fuzzer. (). Export logs from CI in performance test to ClickHouse Cloud. (). Preserve environment parameters in `clickhouse start` command. Fixes . (). Follow up for . Small improvements for install_check.py, adding tests for proper ENV parameters passing to the main process on `init.d start`. (). Fixed base64 endian issue for s390x. (). Reorganize file management in CMake to prevent potential duplications. For instance,

is duplicated in both `dbmssources` and `clickhousefunctions_sources`. (). Fixed functional test in 02354distributedwithexternalaggregationmemoryusage in s390x. (). Skipped QPL functional test for s390x. (). Slightly improve cmake build by sanitizing some dependencies and removing some duplicates. Each commit includes a short description of the changes made. (). Fixed StripeLog storage endian issue on the s390x platform. (). Do not reset Annoy index during build-up with > 1 mark (). Fix usage of temporary directories during RESTORE (). Fix binary arithmetic for Nullable(IPv4) (). Support IPv4 and IPv6 as dictionary attributes (). Bug fix for checksum of compress marks (). Fix mistakenly comma parsing as part of datetime in CSV best effort parsing (). Don't throw exception when exec udf has parameters (). Fix recalculation of skip indexes and projections in `ALTER DELETE` queries (). MaterializedMySQL: Fix the infinite loop in ReadBuffer::read (). Load suggestion only with `clickhouse` dialect (). init and destroy ares channel on demand.. (). RFC: Fix filtering by virtual columns with OR expression (). Fix crash in function `tuple` with one sparse column argument (). Fix named collections on cluster 23.7 (). Fix reading of unnecessary column in case of multistage `PREWHERE` (). Fix unexpected sort result on multi columns with nulls first direction (). Fix data race in Keeper reconfiguration (). Fix sorting of sparse columns with large limit (). clickhouse-keeper: fix implementation of server with poll() (). make regexp analyzer recognize named capturing groups (). Fix possible assert in ~PushingAsyncPipelineExecutor in clickhouse-local (). Fix reading of empty `Nested(Array(LowCardinality(...)))` (). Added new tests for session_log and fixed the inconsistency between login and logout. (). Fix password leak in show create mysql table (). Convert sparse to full in CreateSetAndFilterOnTheFlyStep (). Fix rare race condition with empty key prefix directory deletion in fs cache (). Fix ZstdDeflatingWriteBuffer truncating the output sometimes (). Fix queryid in partlog with async flush queries (). Fix possible error from cache "Read unexpected size" (). Disable the new parquet encoder (). Not-ready Set (). Fix character escaping in the PostgreSQL engine (). #2 Added new tests for session_log and fixed the inconsistency between login and logout. (). #3 Fixed inconsistency between login success and logout (). Fix adding sub-second intervals to DateTime (). Fix "Context has expired" error in dictionaries (). Fix incorrect normal projection AST format (). Forbid usestructurefrominsertiontableintable_functions when execute Scalar (). Fix loading lazy database during system.table select query (). Fixed system.dataskippingindices for MaterializedMySQL (). Fix processing single carriage return in TSV file segmentation engine (). Fix 'Context has expired' error properly (). Fix timeoutoverflowmode when having subquery in the rhs of IN (). Fix an unexpected behavior in (). Fix JSON_QUERY Function parse error while path is all number (). Fix wrong columns order for queries with parallel FINAL. (). Fixed SELECTing from ReplacingMergeTree with donotmergeacrosspartitionsselectfinal (). bugfix: Flush async insert queue first on shutdown (). Fix crash in join on sparse column (). Fix possible UB in Set skipping index for functions with incorrect args (). Fix possible UB in inverted indexes (experimental feature) (). Fix: interpolate expression takes source column instead of same name aliased from select expression. (). Fix number of dropped granules in EXPLAIN PLAN index=1 (). Correctly handle totals and extremes with `DelayedSource` (). Prepared set cache in mutation pipeline stuck (). Fix bug on mutations with subcolumns of type JSON in predicates of UPDATE and DELETE queries.

Fix filter pushdown for fullsortingmerge join (). Try to fix bug with NULL::LowCardinality(Nullable(...)) NOT IN (). Fix: sorted distinct with sparse columns (). transform: correctly handle default column with multiple rows (). Fix fuzzer crash in parseDateTime() (). Materialized postgres: fix uncaught exception in getCreateTableQueryImpl (). Fix possible segfault while using PostgreSQL engine (). Fix namedcollectionadmin alias (). Fix rowsbeforelimitatleast for DelayedSource. (). NO CL ENTRY: 'Revert "Implementing new commands for keeper-client"'. (). NO CL ENTRY: 'Revert "Remove try/catch from DatabaseFilesystem"'. (). NO CL ENTRY: 'Revert "Upload build time-trace data to CI database"'. (). NO CL ENTRY: 'Revert "Added new tests for session_log and fixed the inconsistency between login and logout."'. (). NO CL ENTRY: 'Revert "Improve CHECK TABLE system query"'. (). NO CL ENTRY: 'Revert "#2 Added new tests for session_log and fixed the inconsistency between login and logout."'. (). NO CL ENTRY: 'Revert "Documentation: add Ibis project to the integrations section"'. (). NO CL ENTRY: 'Revert "Planner prepare filters for analysis"'. (). NO CL ENTRY: 'Revert "dateDiff: add support for plural units."'. (). NO CL ENTRY: 'Revert "Fixed wrong python test name pattern"'. (). NO CL ENTRY: 'Revert "Fix bug on mutations with subcolumns of type JSON in predicates of UPDATE and DELETE queries."'. (). clickhouse-copier add check drop partition (). Add more checks into ThreadStatus ctor. (). Refactor Query Tree visitor (). Revert "Revert "Randomize JIT settings in tests"" (). Fix outdated cache configuration in s3 tests: s3storagepolicybydefau (). Fix IN with decimal in analyzer (). Some unclear change in StorageBuffer::reschedule() for something (). MergeTree & SipHash checksum big-endian support (). Maintain same aggregate function merge behavior for small and big endian machine (). Add a test to limit client max opening fd (). Add info about acquired space in cache to not enough space error (). KeeperDispatcher: remove reductant lock as the ConcurrentBoundedQueue is thread-safe (). Fix build type in packager (). metricsperfevents_enabled turn off in perf tests (). Remove try/catch from DatabaseFilesystem (). Add a test that clickhouse-client or local do not throw/catch on startup (). Retry blob listing in testaltermoving_garbage (). Try to make `testkafkaformatswithbrokenmessage` and `testkafka_formats` integration tests stable (). Kill the runner process with all subprocesses (). Implement endianness-indepedent support for MergeTree checksums (). add tests with connection reset by peer error, and retry it inside client (). Fix logging for asynchronous non-batched distributed sends (). Follow-up to "Implement support of encrypted elements in configuration file" (). Return zxid from TestKeeper and in multi responses (). Analyzer: Support ARRAY JOIN COLUMNS(...) syntax (). Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog (). Suspicious DISTINCT crashes from sqlancer (). Partially fixed test 01747systemsessionloglong (). Check for unexpected Cyrillic (). Fix `testkeeperreconfigreplaceleader` (). Rename setting disableurlencoding to enableurlencoding and add a test (). Remove creation of a unnecessary temporary ContextAccess on login (). Update version after release (). Update version_date.tsv and changelogs after v23.7.1.2470-stable (). Fix bugs and better test for SYSTEM STOP LISTEN (). Remove unneeded readBinary() specializations + update docs (). Remove remainders of legacy setting 'allowexperimentalquery_cache' (). Fix 02417opentelemetryinsertondistributed_table flakiness (). Improvements to backup restore disallow_concurrency test (). Move UnlinkMetadataFileOperationOutcome to common header (). Improve endianness-independent support for hash functions (). Allow reading zero objects in CachedObjectStorage::readObjects() (). Merging reading from archives (). Merging (). Analyzer: fix 00979setindex_not.sql (). Planner prepare filters for analysis (). Allow reading empty file with no blobs

Fix: check correctly window frame bounds for RANGE (). Numerical stability of the test for Polygons (). Change the default timezones in Docker test images (). Upload build statistics to the CI database (). Add `instance_type` information to the CI database (). Remove Coverity (part 2) (). Add a tool to upload `-ftime-trace` to ClickHouse (). Revert revert of system drop filesystem cache by key (). Remove obsolete part of a check name (). Maybe fix TLS tests (). Allow OOM in Stress and Upgrade checks (). Do not test upper bounds for throttlers (). Add more logging and touch test for materialize mysql (). Try to remove more leftovers. (). Update testcrashlog/test.py (). Don't report LOGICAL_ERROR if a file got truncated during read (). Throw S3Exception whenever possible. (). Increase min protocol version for sparse serialization (). Cleanup localBackup (). Try to fix 02352_rwlock (). Disable a couple of long tests for debug build. (). Fix flaky tests in testmergetreeazureblobstorage & teststorageazureblob_storage (). Cancel merges before renaming a system log table (). Try to fix a rare fail in 00612httpmaxquerysize (). Remove duplicated dialect setting value (). Significant improvement of rust caching (). Docker improvements (). Try to continue clickhouse process in stress test after terminating gdb. (). fix master ci for (). Fix the PR body check for `Reverts #number` (). Analyzer WITH statement references test (). Disable more tests for debug. (). Fix assertion in mutations with transactions (). Fixed testprofilemaxsessionsfor_user test flakiness (). Use concepts to replace more std::enableift (). Disable `testreconfigreplaceleaderinonecommand` (). tests: fix possible EADDRINUSE v2 (). Merging (). Remove obsolete `no-upgrade-check` tag (). Fix flaky teststorages3queue::testmultipletablesstreamingsyncdistributed (). Don't create empty parts on drop partittion if we have a transaction (). Analyzer: fix WITH clause resolving (). Refactor CI_CONFIG (). Try to fix assert in remove redundant sorting (). Remove unused code in StorageSystemStackTrace (). Fix wrong error code "BAD_GET" (). Fix some issues with databases (). Fix config update in HTTP Header Filtering (). Added peakmemoryusage to clickhouse-client final progress message (). tests: fix 01293clientinteractiveverticalmultiline flakiness (increase timeout) (). Added TSAN option reportatomicraces=0 for testmaxsessionsforuser (). MaterializedMySQL: Add tests for unquoted utf8 column names in DML (). Update version_date.tsv and changelogs after v23.7.2.25-stable (). Decrease a num of tries for a couple of too slow tests for debug. (). Fix test `00061storagebuffer` (). Remove `testhostregexpmultipleptrrecordsconcurrent`, CC @arthurpassos (). Fix `testzookeeperconfig` (). Remove assertion from testnottlmergesinbusypool (). Fix `testdictionarycustom_settings` (). Fix flaky test (). Fix default port for Keeper Client (). Add a test to broken tests (Analyzer) (). Implement big-endian support for transform (). Fix completion for clickhouse-keeper-client (). clickhouse-keeper-client: fix version parsing for set command (). MaterializedMySQL: Add tests to alter named collections (). Fix description for 's3uploadpartsizemultiplypartscount_threshold' setting (). Update 01114databaseatomic.sh (). Revert revert of "Remove try/catch from DatabaseFilesystem" (). Fix cache related logical error in stress tests (). Remove upgrade checks with sanitizers (). Increase election timeout in integration tests (). Analyzer: do not enable it for old servers in tests (). Try to make `01414mutationsanderrorszookeeper` less flaky (). Fix test `02434cancelinsertwhenclient_dies` (). Add `abortonerror=1` to `TSAN_OPTIONS` (). Fix Parquet stats for Float32 and Float64 (). Fix a comment (). Fix 02263formatinsert_settings flakiness (). Something with tests (). Update version_date.tsv and changelogs after v23.7.3.14-stable (). Simplify system logs creation (). Fix hung check in stress test (). Add clusters for running tests locally easily (). Fix wording (). Update README.md

Remove old util (). Add optional parameters to Buffer Engine definition (). Compatibility with clang-17 (). Remove duplicate test: `testconcurrentalterwithttl_move` (). Relax flaky test `tests3engineheavywritecheckmem` (). Update PocoHTTPClient.cpp (). Add hints for HTTP handlers (). Revert changes in `ZstdDeflatingAppendableWriteBuffer` (). Fix flaky test by using azure_query function (). Update `testrestorereplica` (). do not fail if prctl is not allowed () (). Use more unique name for TemporaryFileOnDisk (). Update `Mergeable Check` at the finishing CI (). Added retry for TransportException in azure blob storage (). Small fix for HTTPHeaderFilter (). Added functions to disallow concurrency of backup restore test (). Attempt to fix testinsertquorum by adding sync second replica (). fix mem leak in RegExpTreeDictionary (). Fixes for detach/attach partition and broken detached parts cleanup (). Update conftest.py (). Allow experimantal features when recovering Replicated db replica (). Update version_date.tsv and changelogs after v23.7.4.5-stable (). Analyzer: fix testsystemflush_logs (). Fix warning in testreplicateddatabase (). Fix: 00838uniqueindex test with analyzer (). Improved efficiency for array operations (). Disable testreversedns_query/test.py (). Improve reading from archives (). Disable testhostregexpmultipleptr_records/test.py (). Enable hedged requests under tsan (). Remove garbage (). Fix LOGICAL_ERROR exception in ALTER query (). Fix bad test `00417killquery` (). Fix test `02428deletewith_settings` (). Remove unrecognizable garbage from the performance test (). Disable randomization in `02273fullsort_join` (). Remove outdated Dockerfile (). Improve fs cache cleanup (). Add garbage (). Inhibit randomization in `00906lowcardinality_cache` (). Fix test 01169oldalterpartitionisolation_stress (). Remove no-parallel tag from some tests (). Fix test `00002logandexceptionmessages_formatting` (). Fix `01485256bit_multiply` (). Remove flaky tests for the experimental `UNDROP` feature (). Added test for session_log using remote and mysql sessions (). Added integration test for session_log using concurrrent GRPC/PostgreSQL/MySQL sessions (). Added test for session_log using concurrrent TCP/HTTP/MySQL sessions (). Added test for session_log dropping user/role/profile currently used in active session (). Added an integration test for client peakmemoryusage value (). Fix log message (). Analyzer: fix quotas for system tables (). Relax mergeable check (). Add clickhouse-keeper-client and clickhouse-keeper-converter symlinks to clickhouse-keeper package (). Add linux s390x to universal installer (). Make one exception message longer (). Fix wrong query in log messages check (). Non-significant changes (). Inhibit randomization in more tests (). Make some Keeper exceptions more structured (). Follow-up to : Move tests to a more appropriate place (). Minor fixes (hints for wrong DB or table name) (). Quick fail undocumented features (). boost getNestedColumnWithDefaultOnNull by insertManyDefaults (). Update testdistributedinterserversecret to pass with analyzer (). Parallel replicas: remove unnecessary code (). Refactorings for configuration of in-memory caches (). Less exceptions with runtime format string (). Analyzer: fix virtual columns in StorageDistributed (). Fix creation of empty parts (). Merging (). Merging (). Do not send logs to CI if the credentials are not set (). Minor: Factorize constants in Annoy index (). Restart killed PublishedReleaseCI workflows (). Follow-up: Do not send logs to CI if the credentials are not set (). Merging (). Merging (). Merging (). Merging (). Fix flaky test `02443detachattach_partition` (). Remove outdated code in ReplicatedMergeTreeQueue::initialize() (). krb5: Fix CVE-2023-36054 (). curl: update to latest master (fixes CVE-2023-32001) (). Update boost to 1.79 (). Get rid of secrets CLICKHOUSECILOGS (). Update style checker (). Update materializedwithddl.py (). Fix a race condition between RESTART REPLICAS and DROP DATABASE (). Fix tiny thing in Replicated database (). Simplify performance test (). Added waiting for PostgreSQL compatibility port open in integrational tests.

Allow non standalone keeper run in integration tests (). Make sending logs to the cloud less fragile (and fix an unrelated flaky test) (). Update test.py (). Fix `AddressSanitizer failed to allocate 0x0 (0) bytes of SetAlternateSignalStack` in integration tests (). Fix keeper default path check (). Follow-up to (). Update 00002logandexceptionmessages_formatting.sql (). Update krb5 to 1.21.2 (). Enable ISA-L on x86-64 only by default (). Change Big Endian-UUID to work the same as Little Endian-UUID (). Bump openldap to LTS version (v2.5.16) (). Update 02443detachattach_partition.sh (). Proper destruction of task in ShellCommandSource (). Fix for flaky testsslcert_authentication (). AARCH64 Neon memequal wide (). Experiment Aggregator merge and destroy states in batch (). Fix test `02102rowbinarywithnamesandtypes` (). Remove useless test (). Simplify test `01600partstypesmetricslong` (). :lipstick: (). Fix upgrade check (). Cleanup cluster test: remove unnecessary zookeeper (). Bump boost to 1.80 (). Update version_date.tsv and changelogs after v23.3.9.55-lts (). CMake small refactoring (). Fix data race of shell command (). Fix 02443detachattach_partition (). Add default timeout value for ClickHouseHelper (). Implement support for more aggregate functions on big-endian (). fix Logical Error in AsynchronousBoundedReadBuffer (). State of State and avg aggregation function fix for big endian (). Resubmit (). Bump boost to 1.81 (). Whitespaces (). Remove bad test (). Fix bad path format in logs (). Correct a functional test to not use endianness-specific input (). Fix running clickhouse-test with python 3.8 (). refactor some old code (). Fixed wrong python test name pattern (). Fix flaky `shutdownwaitunfinished_queries` integration test (). Update version_date.tsv and changelogs after v23.3.10.5-lts (). Fix flaky teststorages3queue/test.py::testdeleteafterprocessing (). Fix broken `02862sorteddistinctsparsefix` (). Do not warn about archsyscounter clock (). Add some profile events (). Support clang-18 (Wmissing-field-initializers) (). Upgrade openSSL to v3.0.10 (). Improve JSON-handling on s390x (). Reduce API calls to SSM client (). Remove branch references from .gitmodules (). Fix reading from `url` with all filtered paths (). Follow-up to (). Fix a bug in attach partition (). Bump boost to 1.82 (). Enable producing endianness-independent output in lz4 (). Fix typo in cluster name. (). Get rid of describe_parameters for the best robot token (). Update 00002logandexceptionmessages_formatting.sql (). Fix after (). Fix segfault in `TableNameHints` (with `Lazy` database) (). Follow-up to (). Follow-up to (). refactor some code (). Bump boost to 1.83 (). Remove unused parallel replicas coordinator in query info (). Update version_date.tsv and changelogs after v23.7.5.30-stable (). Update version_date.tsv and changelogs after v23.6.3.87-stable (). Update version_date.tsv and changelogs after v23.3.11.5-lts (). Update version_date.tsv and changelogs after v23.5.5.92-stable (). Update version_date.tsv and changelogs after v22.8.21.38-lts (). Fix: USearch deserialize (). Improve schema inference for archives (). Make UInt128TrivialHash endianness-independent (). Use iterators instead of std::ranges (). Finalize file descriptor in ~WriteBufferToFileSegment (). Fix: respect skipunavailableshards with parallel replicas (). Fix flakiness of 00514intervaloperators (). Change IStorage interface by random walk, no goal in particular (). Refactor logic around async insert with deduplication (). More assertive (). Correct doc for filesystemprefetchmaxmemoryusage (). Fix after (). Parse IS NOT DISTINCT and <=> operators (). Replace dlcdn.apache.org by archive domain (). Increased log waiting timeout in testprofilemaxsessionsfor_user (). Update Dockerfile (). Small improvements in `getAlterMutationCommandsForPart` (). Fix some more analyzer tests (). Disable `01600partstypesmetricslong` for asan (). Fixing 01086odbcroundtrip with analyzer. (). Add warnings about ingestion script speed and memory usage in Laion dataset instructions (). tests: mark 02152httpexternaltablesmemory_tracking as no-parallel (). The external logs have had colliding arguments (). Rename macro ().