Project: ClickHouse (App Definition and Development / Database)
File: v23.11.1.2711-stable.md

sidebar_position: 1 sidebar_label: 2023 Formatters `%l`/`%k`/`%c` in function `parseDateTime()` are now able to parse hours/months without leading zeros, e.g. `select parseDateTime('2023-11-26 8:14', '%F %k:%i')` now works. Set `parsedatetimeparsewithoutleadingzeros = 0` to restore the previous behavior which required two digits. Function `formatDateTime` is now also able to print hours/months without leading zeros. This is controlled by setting `formatdatetimeformatwithoutleadingzeros` but off by default to not break existing use cases. (). You can no longer use the aggregate function `avgWeighted` with arguments of type `Decimal`. Workaround: convert arguments to `Float64`. This closes . This closes . This closes . If you have used this function inside materialized views or projections with `Decimal` arguments, contact support@clickhouse.com. Fixed error in aggregate function `sumMap` and made it slower around 1.5..2 times. It does not matter because the function is garbage anyway. This closes . This closes . This closes . Fix a bug in function `groupArraySample` - it used the same random seed in case more than one aggregate state is generated in a query. (). The default ClickHouse server configuration file has enabled `accessmanagement` (user manipulation by SQL queries) and `namedcollection_control` (manipulation of named collection by SQL queries) for the `default` user by default. This closes . (). Multiple improvements for RESPECT/IGNORE NULLS. (). Remove optimization optimizemovefunctionsoutof_any. (). Added server setting `asyncloaddatabases` for asynchronous loading of databases and tables. Speeds up the server start time. Applies to databases with Ordinary, Atomic and Replicated engines. Their tables load metadata asynchronously. Query to a table increases the priority of the load job and waits for it to be done. Added table `system.async_loader`. (). Add function `extractPlainRanges` to `KeyCondition`. 2. Add some useful functions to `Range` 3. Add `PlainRanges` who represent a serious of ranges that ordered and no overlapping. 4. Add `NumbersRangedSource` who can accurately return user selected numbers. (). Add system table `blobstoragelog`. (). Use statistic to order prewhere conditions better. (). Added a new aggregation function `groupArraySorted(n)(value)` which returns an array with the n first values from a field value sorted by itself. (). Added support for compression in keeper protocol. Can be enabled on clickhouse by using this flag `use_compression` inside `zookeeper`. resolves . (). Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy. (). Introduce the feature `storagemetadatawritefullobjectkey`. If it is set as `true` then metadata files are written with new format VERSIONFULLOBJECTKEY. With that format CH stores full remote object key in the metadata file. (). Add new settings and syntax to protect named collections' fields from being overridden. This is meant to prevent a malicious user from obtaining unauthorized access to secrets. (). Add `hostname` column to all system log tables;. (). Add `CHECK ALL TABLES` query. (). Added function `fromDaysSinceYearZero()` which is similar to MySQL's `FROM_DAYS`. E.g. `SELECT fromDaysSinceYearZero(739136)` returns `2023-09-08`. (). Implemented series period detect method using FFT in pocketFFT lib. (). Add an external Python tool to view backups and to extract information from them without using ClickHouse. (). ... (). This pull request implements new setting called `preferredprojectionname`. If it is set to a non-empty string, the specified projection would be used if possible. (). S3 adaptive timeout means that first attempt made with low send and receive timeouts. (). Add 4-letter command for yielding/resigning leadership (https://github.com/ClickHouse/ClickHouse/issues/56352).

Added a new SQL function, "arrayRandomSample(arr, k)" which returns a sample of k elements from the input array. Similar functionality could previously be achieved only with less convenient syntax, e.g. "SELECT arrayReduce('groupArraySample(3)', range(10))". (). Added support for `float16` type data to use in `.npy` files. Closes . (). Added system view `information_schema.statistics` for better compatibility with Tableau Online. (). Add function `getClientHTTPHeader` for fetching values header values set in the HTTP request. (). Add a new table function named `fuzzJSON` with rows containing perturbed versions of the source JSON string with random variations. (). Add `system.symbols` table useful for introspection of the binary. (). Add 4-letter command for yielding/resigning leadership. (). Configurable dashboards. Queries for charts are now loaded using a query, which by default uses a new `system.dashboards` table. (). Introduce `fileCluster` table function. (). Add `_size` virtual column with file size in bytes to `s3/file/hdfs/url/azureBlobStorage` engines. (). Expose the number of errors occurred on a server since last restart from the Prometheus endpoint. (). Added a new SQL function `sqid` to generate Sqids (https://sqids.org/), example: `SELECT sqid(125, 126)`. (). Support window functions parallel evaluation. Fixes . (). Increase the default value of `maxconcurrentqueries` from 100 to 1000. This makes sense when there is a large number of connecting clients, which are slowly sending or receiving data, so the server is not limited by CPU, or when the number of CPU cores is larger than 100. Also, enable the concurrency control by default, and set the desired number of query processing threads in total as twice the number of CPU cores. It improves performance in scenarios with a very large number of concurrent queries. (). Fixed filtering by `IN(...)` condition for `Merge` table engine. (). An improvement which takes place when cache is full and there are big reads. (). Add ability to disable checksums for S3 to avoid excessive input file read (this new behavior could be enabled with `s3disablechecksum=true`). (). Now we read synchronously from remote tables when data is in page cache (like we do for local tables). It is faster, doesn't require synchronisation inside thread pool, doesn't hesitate to do `seek`-s on local fs and reduces cpu wait. (). ... This PR follows , it will bring about 30% speedup. - reduce the reserved memory - reduce the `resize` call. (). The performance experiments of OnTime on the ICX device (Intel Xeon Platinum 8380 CPU, 80 cores, 160 threads) show that this change could bring the improvements of 7.4%, 5.9%, 4.7%, 3.0%, and 4.6%* to the QPS of the query Q2, Q3, Q4, Q5 and Q6 respectively while having no impact on others. (). Limit the number of threads busy inside the query profiler. If there are more - they will skip profiling. (). WindowTransform decrease amount of virtual function calls. (). Allow recursive tuple field pruning in ORC to speed up scaning. (). This pull request provides countRows support for Npy data format. Now with setting `optimizecountfrom_files=1` queries like `select count() from file(data.npy)` will work much more fast because of caching the results. (). Queries with aggregation and a large number of streams will use less amount of memory during the plan's construction. (). Improve performance of executing queries for use cases with many users. (). Trivial improvement on array join, reuse some intermediate results. (). There are cases when stack unwinding was slow.

Now we use default read pool for reading from external storage when `max_streams = 1`. It is beneficial when read prefetches are enabled. (). Engine `Merge` filters the records according to the row policies of the underlying tables. (). Add a setting `maxexecutiontimeleaf` to limit the execution time on shard for distributed query, and `timeoutoverflowmodeleaf` to control the behaviour if timeout happens. (). Fix possible postgresql logical replication conversion_error when using MaterializedPostgreSQL. (). Set `backgroundfetchespoolsize` to 16, backgroundschedulepoolsize to 512 that is better for production usage with frequent small insertions. (). While read data from a csv format file, and at end of line is'\r' , which not followed by '\n', then we will enconter the exception as below ``` Cannot parse CSV format: found \r (CR) not followed by \n (LF). Line must end by \n (LF) or \r\n (CR LF) or \n\r.: ``` In clickhouse, the csv end of line must be \n or \r\n or \n\r, so the \r must be followed by \n , but in some suitation, the csv input data is abnormal, like above, \r is at end of line. (). Update arrow library to release-13.0.0 that supports new encodings. Closes . (). Improve performance of ON CLUSTER queries by removing heavy system calls to get all network interfaces when looking for local ip address in the DDL entry hosts list. (). Keeper improvement: improve memory-usage during startup by delaying log preprocessing. (). Fixed accounting of memory allocated before attaching thread to a query or a user. (). ClickHouse keeper reports its running availability zone at `/keeper/availability-zone` path, when running on AWS environment. (). Add support for LARGE_LIST with Arrow. (). Improved performance of glob matching for `file` and `hdfs` storages. (). Allow manual compaction of `EmbeddedRocksDB` via `OPTIMIZE` query. (). Posting lists in inverted indexes are now compressed which reduces their size by 10-30%. (). Add ability to specify BlockBasedTableOptions for EmbeddedRocksDB. (). `SHOW COLUMNS` now displays MySQL's equivalent data type name when the connection was made through the MySQL protocol. Previously, this was the case when setting `usemysqltypesinshow_columns = 1`. The setting is retained but made obsolete. (). Fixed possible `The local set of parts of table doesn't look like the set of parts in ZooKeeper` error if server was restarted just after `TRUNCATE` or `DROP PARTITION`. (). Parallelise `BackupEntriesCollector`. (). Fixed handling of non-const query strings in functions `formatQuery()`/ `formatQuerySingleLine()`. Also added `OrNull` variants of both functions that return a NULL when a query cannot be parsed instead of throwing an exception. (). Support create and materialized index in the same alter query, also support modity TTL and materialize TTL in the same query. Closes . (). Enable adding new disk to storage configuration without restart. (). Allow backup of materialized view with dropped inner table instead of failing the backup. (). Queries to `system.replicas` initiate requests to ZooKeeper when certain columns are queried. When there are thousands of tables these requests might produce a considerable load on ZooKeeper. If there are multiple simultaneous queries to `system.replicas` they do same requests multiple times. The change is to "deduplicate" requests from concurrent queries. (). Add transition from reading key to reading quoted key when double quotes are found. (). Fix transfer query to MySQL compatible query. (). Add support for backing up and restoring tables using KeeperMap engine.

404 response for CompleteMultipartUpload has to be rechecked. Operation could be done on server even if client got timeout or other network errors. The next retry of CompleteMultipartUpload receives 404 response. If the object key exists that operation is considered as successful. (). Enable the HTTP OPTIONS method by default - it simplifies requesting ClickHouse from a web browser. (). The value for `dnsmaxconsecutive_failures` was changed by mistake in - this is reverted and adjusted to a better value. Also, increased the HTTP keep-alive timeout to a reasonable value from production. (). Load base backups lazily (a base backup won't be loaded until it's needed). Also add some log message and profile events for backups. (). Setting `querycachestoreresultsofquerieswithnondeterministicfunctions` (with values `false` or `true`) was marked obsolete. It was replaced by setting `querycachenondeterministicfunctionhandling`, a three-valued enum that controls how the query cache handles queries with non-deterministic functions: a) throw an exception (default behavior), b) save the non-deterministic query result regardless, or c) ignore, i.e. don't throw an exception and don't cache the result. (). Rewrite equality with `is null` check in JOIN ON section. Analyzer only*. (). Function`concat` now supports arbitrary argument types (instead of only String and FixedString arguments). This makes it behave more similar to MySQL `concat` implementation. For example, `SELECT concat('ab', 42)` now returns `ab42`. (). Allow getting cache configuration from 'named_collection' section in config or from sql created named collection. (). Update `querymaskingrules` when reloading the config (). (). Make removeoutdatedtables() less aggressive with unsuccessful postgres connection. (). Currenting setting takes too much time to connnect to PG when URL is not right, so the relevant query stucks there and get cancelled. (). ClickHouse keeper reports its running availability zone at `/keeper/availability-zone` path. This can be configured via `<availabilityzone><value>us-west-1a</value></availabilityzone>`. (). Do not allow tables on different replicas have different aggregate functions in SimpleAggregateFunction columns. (). Add support for the in the Protobuf format. (). Keeper improvement: disable compressed logs by default in Keeper. (). Add config setting `waitdictionariesloadatstartup`:. (). There was a potential vulnerability in previous ClickHouse versions: if a user has connected and unsuccessfully tried to authenticate with the "interserver secret" method, the server didn't terminate the connection immediately but continued to receive and ignore the leftover packets from the client. While these packets are ignored, they are still parsed, and if they use a compression method with another known vulnerability, it will lead to exploitation of it without authentication. This issue was found with by https://twitter.com/malacupa. (). Fetching a part waits when that part is fully committed on remote replica. It is better not send part in PreActive state. In case of zero copy this is mandatory restriction. (). Implement user-level setting `altermovetospaceexecuteasync` which allow to execute queries `ALTER TABLE ... MOVE PARTITION|PART TO DISK|VOLUME` asynchronously. The size of pool for background executions is controlled by `backgroundmovepoolsize`. Default behavior is synchronous execution. Fixes . (). Able to filter by engine when scanning system.tables, avoid unnecessary (potentially time-consuming) connection. (). Show `totalbytes` and `totalrows` in system tables for RocksDB storage. (). Allow basic commands in ALTER for TEMPORARY tables. (). Lz4 compression. Buffer compressed block in a rare case when out buffer capacity is not enough for writing compressed block directly to out's buffer. (). Add metrics for the number of queued jobs, which is useful for the IO thread

(). Add a setting for PostgreSQL table engine setting in the config file Added a check for the setting Added documentation around the additional setting. (). Run interpreter with `only_analyze` flag in getsampleblock method. (). Add a new `MergeTree` setting `addimplicitsigncolumnconstraintforcollapsing_engine` (disabled by default). When enabled, it adds an implicit CHECK constraint for `CollapsingMergeTree` tables that restricts the value of the `Sign` column to be only -1 or 1. . (). Function `concat()` can now be called with a single argument, e.g., `SELECT concat('abc')`. This makes its behavior more consistent with MySQL's concat implementation. (). Signs all `x-amz-` headers as required by AWS S3 docs. (). Function `fromDaysSinceYearZero` (alias: `FROM_DAYS`) can now be used with unsigned and signed integer types (previously, it had to be an unsigned integer). This improve compatibility with 3rd party tools such as Tableau Online. (). Add system.s3queue_log to default config. (). Change the default for `waitdictionariesloadatstartup` to true, and use this setting only if `dictionarieslazyload` is false. (). Check dictionary source type on creation even if `dictionarieslazyload` is enabled. (). Plan-level optimizations can now be enabled/disabled individually. Previously, it was only possible to disable them all. The setting which previously did that (`queryplanenable_optimizations`) is retained and can still be used to disable all optimizations. (). The server's exit code will correspond to the exception code. For example, if the server cannot start due to memory limit, it will exit with the code 241 = MEMORYLIMITEXCEEDED. In previous versions, the exit code for exceptions was always 70 = Poco::Util::ExitCode::EXIT_SOFTWARE. (). Do not demangle and symbolize stack frames from functional c++ header. (). It is now possible to refer to ALIAS column in index (non-primary-key) definitions (issue ). Example: `CREATE TABLE tab(col UInt32, colalias ALIAS col + 1, INDEX idx (colalias) TYPE minmax) ENGINE = MergeTree ORDER BY col;`. (). HTTP server page `/dashboard` now supports charts with multiple lines. (). This pr gives possibility to use suffixes (K, M, G, T, E) along with the amount of memory to be used. Closes . (). Bumped Intel QPL (used by codec `DEFLATE_QPL`) from v1.2.0 to v1.3.1 . Also fixed a bug in case of BOF (Block On Fault) = 0, changed to handle page faults by falling back to SW path. (). Make alter materialized view non experimental and deprecate `allowexperimentalaltermaterializedview_structure` setting. Fixes . (). Increase default `replicateddeduplicationwindow` of MergeTree settings from 100 to 1k. (). Stop using `INCONSISTENTMETADATAFOR_BACKUP` that much. If possible prefer to continue scanning instead of stopping and starting the scanning for backup from the beginning. (). Introduce the limit for the maximum number of table projections (default 25). (). Enable `asyncblockidscache` by default for `asyncinserts` deduplication. (). Enable temporarydatain_cache in s3 tests in CI. (). Run sqllogic test. (). Add a new build option `SANITIZE_COVERAGE`. If it is enabled, the code is instrumented to track the coverage. The collected information is available inside ClickHouse with: (1) a new function `coverage` that returns an array of unique addresses in the code found after the previous coverage reset; (2) `SYSTEM RESET COVERAGE` query that resets the accumulated data. This allows us to compare the coverage of different tests, including differential code coverage. Continuation of . (). In the setup plan started to appear in the logs. It should be only in the `runnergetall_tests.log`

As well, send the failed infrastructure event to CI db. (). Some of the stack frames might not be resolved when collecting stacks. In such cases the raw address might be helpful. (). Add an option to disable libssh. (). Add automatic check that there are no large translation units. (). Lower the size of the single-binary distribution. This closes . (). Make `clickhouse-local` and `clickhouse-client` available under short names (`ch`, `chl`, `chc`) for usability. (). Information about the sizes of every translation unit and binary file after each build will be sent to the CI database in ClickHouse Cloud. This closes . (). Certain files of "Apache Arrow" library (which we use only for non-essential things like parsing the arrow format) were rebuilt all the time regardless of the build cache. This is fixed. (). Avoid recompiling translation units depending on the autogenerated source file about version. (). Do not fetch changed submodules in the builder container. (). Tracing data of the linker invocations will be sent to the CI database in ClickHouse Cloud. (). Use DWARF 5 debug symbols for the clickhouse binary (was DWARF 4 previously). (). Optimized build size further by removing unused code from external libraries. (). Set memory usage for client (`1G`) to address problems like this: https://s3.amazonaws.com/clickhouse-test-reports/0/f1bf3f1fc39f520871ec878d815e515e12fd3e7b/fuzzer_astfuzzertsan/report.html. (). There was an attempt to have the proper listing in , but the fix itself was in the wrong place, so it's still broken. See an . (). Fixed the memory leak in integration test of postgres dictionary. The case of network partition is not correctly handled at the time of the repo pulled years ago. (). Fix a test filename typo. (). Fix issue caught in https://github.com/docker-library/official-images/pull/15846. (). Fix analyzer - insertion from select with subquery referencing insertion table should process only insertion block. (). Setting JoinAlgorithm respect specified order (). Keeper `reconfig`: add timeout before yielding/taking leadership (). Fix incorrect header in grace hash join and filter pushdown (). Select from system tables when table based on table function. (). RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY (). Fix 'Cannot read from file:' while running client in a background (). Fix clickhouse-local exit on bad sendlogslevel setting (). Bug fix explain ast with parameterized view (). Fix a crash during table loading on startup (). Fix ClickHouse-sourced dictionaries with an explicit query (). Fix segfault in signal handler for Keeper (). Fix incomplete query result for UNION in view() function. (). Fix inconsistency of "cast('0' as DateTime64(3))" and "cast('0' as Nullable(DateTime64(3)))" (). Fix rare race condition related to Memory allocation failure (). Fix restore from backup with `flattennested` and `datatypedefaultnullable` (). Fix crash in case of adding a column with type Object(JSON) (). Fix crash in filterPushDown (). Fix restore from backup with mat view and dropped source table (). Fix segfault during Kerberos initialization (). Fix buffer overflow in T64 (). Fix nullable primary key in final (2) (). Fix ON CLUSTER queries without database on initial node (). Fix startup failure due to TTL dependency (). Fix ALTER COMMENT queries ON CLUSTER (). Fix ALTER COLUMN with ALIAS (). Fix empty NAMED COLLECTIONs (). Fix two cases of projection analysis. (). Fix handling of aliases in query cache (). Fix conversion from `Nullable(Enum)` to `Nullable(String)`

More reliable log handling in Keeper (). Fix configuration merge for nodes with substitution attributes (). Fix duplicate usage of table function input(). (). Fix: RabbitMQ OpenSSL dynamic loading issue (). Fix crash in GCD codec in case when zeros present in data (). Fix 'mutex lock failed: Invalid argument' in clickhouse-local during insert into function (). Fix Date text parsing in optimistic path (). Fix crash in FPC codec (). DatabaseReplicated: fix DDL query timeout after recovering a replica (). Fix incorrect nullable columns reporting in MySQL binary protocol (). Support Iceberg metadata files for metastore tables (). Fix TSAN report under transform (). Fix SET query and SETTINGS formatting (). Fix failure to start due to table dependency in joinGet (). Fix flattening existing Nested columns during ADD COLUMN (). Fix allow cr end of line for csv (). Fix `tryBase64Decode()` with invalid input (). Fix generating deep nested columns in CapnProto/Protobuf schemas (). Prevent incompatible ALTER of projection columns (). Fix sqlite file path validation (). S3Queue: fix metadata reference increment (). S3Queue minor fix (). Fix file path validation for DatabaseFileSystem (). Fix `fuzzBits` with `ARRAY JOIN` (). Fix Nullptr dereference in partial merge join with joinedsubqueryre (). Fix race condition in RemoteSource (). Implement `bitHammingDistance` for big integers (). S3-style links bug fix (). Fix JSON_QUERY function with multiple numeric paths (). Fix buffer overflow in Gorilla codec (). Close interserver connection on any exception before authentication (). Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column (). Fix incorrect JOIN plan optimization with partially materialized normal projection (). Ignore comments when comparing column descriptions (). Fix `ReadonlyReplica` metric for all cases (). Background merges correctly use temporary data storage in the cache (). Keeper fix for changelog and snapshots (). Ignore finished ON CLUSTER tasks if hostname changed (). MergeTree mutations reuse source part index granularity (). Fix function jsonMergePatch for partially const columns (). Fix ubsan error in `Arena` (). fs cache: add limit for background download (). bugfix: correctly parse SYSTEM STOP LISTEN TCP SECURE (). NO CL ENTRY: 'Revert "Add function `arrayRandomSample()`"'. (). NO CL ENTRY: 'Update README.md'. (). NO CL ENTRY: 'Revert "FunctionSleep exception message fix"'. (). NO CL ENTRY: 'Revert "Inserting only non-duplicate chunks in MV"'. (). NO CL ENTRY: 'Add new header for README with updated logo'. (). NO CL ENTRY: 'Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."'. (). NO CL ENTRY: 'Revert "Add 4-letter command for yielding/resigning leadership"'. (). NO CL ENTRY: 'fix(docs): correct default value for outputformatparquetcompressionmethod to 'lz4''. (). NO CL ENTRY: 'Update except.md'. (). NO CL ENTRY: 'Revert "Add a setting maxexecutiontime_leaf to limit the execution time on shard for distributed query"'. (). NO CL ENTRY: 'Revert "Better except for SSL authentication failure"'. (). NO CL ENTRY: 'Revert "s3 adaptive timeouts"'. (). NO CL ENTRY: 'Revert "Revert "s3 adaptive timeouts""'. (). NO CL ENTRY: 'Revert "Resubmit 01600partstypes_metrics test (possibly without flakiness)"'. (). NO CL ENTRY: 'Revert "Mark select() as harmful function"'. (). NO CL ENTRY: 'Revert "Update Sentry"'. (). NO CL ENTRY: 'Revert "Add debugging info for 01600partstypes_metrics on failures"'. (). NO CL ENTRY: 'Revert "Update date-time-functions.md"'. (). NO CL ENTRY: 'Revert "add function getClientHTTPHeader"'. (). NO CL ENTRY: 'Revert "Add `sqid()` function"'. (). NO CL ENTRY: 'Revert "Add new aggregation function groupArraySorted()"'.

NO CL ENTRY: 'Revert "Implemented series period detect method using pocketfft lib"'. (). NO CL ENTRY: 'Revert "Support use alias column in indices"'. (). Remove useless "install" from CMake (step 1) (). Analyzer support 'is not distinct from' in join on section (). Refactor merge join transform (). Add function jaccardIndex back with better performance (). Use more thread pools in BACKUP/RESTORE to avoid its hanging in tests (). Parallel replicas: progress bar (). Analyzer: Fix result type after IfConstantConditionPass (). RemoteSource: remove unnecessary flag (). Fix `REPLICAALREADYEXISTS` for ReplicatedMergeTree (). Rework to avoid coredump generation (). Bump gRPC to v1.47.5 (). See what happens if we use less different docker images in integration tests (). Add missing zookeeper retries in StorageReplicatedMergeTree::backupData (). Better process broken parts on table start for replicated tables (). Add more details to "Data after merge is not byte-identical to data on another replicas" (). Revert "Revert "Fix output/input of Arrow dictionary column"" (). Add a log message for DatabaseReplicated (). Correct aggregate function cross tab accessors to be endianness-independent. (). Fix client suggestions for user without grants (). Fix link to failed check report in status commit (). Analyzer: fix 01019altermaterializedviewconsistent (). Properly process aliases for aggregation-by-partition optimization. (). deltalake: Do not raise errors when processing add and remove actions (). Fix rare logical error in Replicated database (). Update version_date.tsv and changelogs after v23.10.1.1976-stable (). Add assertion that `SizePredictor` is set if `preferredblocksize_bytes` is set (). Implement digest helpers for different objects (). Removed stale events from README (). Fix more tests with analyzer. (). Change some exception codes (). Fix using table shared id during backup and improve logs. (). Print info while decompressing the binary (). remove unstable test testheavyinsertselectcheck_memory (). Update teststorages3_queue/test.py (). Update 02735systemzookeeper_connection.sql (). Cleanup convenience functions in IDataType (). Update teststorages3_queue (). Minor improvements for S3Queue (). Add obsolete setting back (). Rewrite jobs to use callable workflow (). Update stress.py (). Fix rocksdb with analyzer. (). Option to check particular file with utils/check-style/check-doc-aspell (). Add a metric for suspicious parts in ZooKeeper (). Fix 02404memorybound_merging with analyzer. (). move storagemetadatawritefullobject_key setting to the server scope (). Make autoscaling more responsive (). Fix `testattachwithout_fetching` (). Use `pcg` + `randomSeed()` instead of `std::mt19937`/`std::random_device` (). Fix test `02725databasehdfs.sh` (). Update the AMI receipt (). Make IMergeTreeDataPart::getState() inlinable (). Update version_date.tsv and changelogs after v23.10.2.13-stable (). Update version_date.tsv and changelogs after v23.9.4.11-stable (). Update version_date.tsv and changelogs after v23.8.6.16-lts (). Update version_date.tsv and changelogs after v23.3.16.7-lts (). Disable randomization of allowexperimentalblocknumbercolumn flag (). Parallel clone sparse/shallow submodules (). Fix default port for Replicated database cluster (). Updated compression to LZ4 (). Analyzer remove unused projection columns (). FunctionSleep exception message fix (). Continue rewriting workflows to reusable tests (). Analyzer special functions projection names fix (). CTE invalid query analysis add test (). Fix compilation of BackupsWorker.cpp (). Analyzer MoveFunctionsOutOfAnyPass refactoring (). Analyzer support EXPLAIN ESTIMATE (). Analyzer log used row policies (). Analyzer ORDER BY read in order query plan add test (). ReplicatedMergeTree: check shutdown flags in retry loops (). Fix race between REPLACERANGE and GETPART (set actual part name when fetching) (). Bump gRPC to v1.54.3 (). Fix flaky LDAP integration tests (). Remove useless using (). Better warning message (). Allow `chassert` to guide the static analyzer (). Remove C++ templates (). Fix `testkeeperfourwordcommand/test.py::testcmdcrst`

Delete unnecessary file from tests (). Analyzer: fix logical error with set in array join (). hide VERSIONINLINEDATA under feature flag (). Fix 02554fixgroupingsetspredicatepushdown with analyzer. (). Add "FunctionSleep exception message fix" again (). Update version_date.tsv and changelogs after v23.10.3.5-stable (). Remove bad test (). Symbolize `trace_log` for exporting (). Add indices to exported system logs (). Remove dependencies (). WIP: Add test describing MV deduplication issues (). Add test for ROW POLICY ON CLUSTER (). Enable --secure flag for clickhouse-client for hostnames pointing to clickhouse cloud (). Continue with work from (). Switch to SSL port for clickhouse-client for hostnames pointing to clickhouse cloud (). Remove garbage from libssh (). Delete a file (). Delete a file (2) (). Remove some entries from `analyzertechdebt.txt` (). Miscellaneous (). Bump gRPC to v1.55.4 and protobuf to v22.5 (). Small refactoring of AST hash calculation (follow-up to ) (). Analyzer: filtering by virtual columns for StorageS3 (). Add back flaky tests to analyzertechdebt.txt (). gRPC: remove build dependency on systemd (). Remove unused code (). Fix missing argument for style_check.py in master workflow (). Fix unexpected parts handling (). Revert "Revert "Add a setting maxexecutiontime_leaf to limit the execution time on shard for distributed query"" (). Fix usestructurefrominsertiontableintable_functions with new Analyzer (). Disable settings randomisation for `02896memoryaccountingforuser.sh` (). Light autogenerated file (). Less CMake checks (). Remove orphan header files (). Try to fix hang in 01104distributednumbers_test (). Test RabbitMQ with secure connection (). Fix flaky testreplicatedmergetreeencryption_codec. (). fix typo in ClickHouseDictionarySource (). Fix pygithub (). Add test for avoided recursion (). Fix randomization of Keeper configs in stress tests (). Try fix `No user in current context, it's a bug` (). Update avg_weighted.xml (). Better except for SSL authentication failure (). More stable `testkeeperreconfigreplaceleader` (). Add cancellation hook for moving background operation (). Updated comment in universal.sh (). Bump gRPC to v1.59 and protobuf to v24.4 (). Better exception messages (). Sparse checkout: Use `--remote` for `git submodule update` (). Fix `testkeeperbroken_logs` (). CMake: Small cleanup in cpu_features.cmake (). Planner support transactions (). Improve diagnostics in test 02908manyrequeststosystem_replicas (). Update 01052windowviewproctumbletonow.sh (). Call cache check a bit more often (). Update teststorages3_queue/test.py (). Fix perf tests report when there are no tests (). Remove ctest (). Simpler CMake (). test for (). Allow delegate disk to handle retries for createDirectories (). Update version_date.tsv and changelogs after v23.10.4.25-stable (). Update version_date.tsv and changelogs after v23.3.17.13-lts (). Update version_date.tsv and changelogs after v23.8.7.24-lts (). Update version_date.tsv and changelogs after v23.9.5.29-stable (). Remove outdated instructions (). Avoid dependencies with no fixed versions (). Fix race on zk_log initialization (). Check what will happen if I remove some lines (). Update fasttest (). Make some tests independent of macro settings (). Fix flaky 02494querycache_events (). Add CachedReadBufferReadFromCache{Hits,Misses} profile events (). Send fatal logs by default in clickhouse-local (). Resubmit: Better except for SSL authentication (). Fix `testkeeperauth` (). Fewer concurrent requests in 02908manyrequeststosystem_replicas (). Own CMake for GRPC (). Fix build in Backups/BackupIO_S3.cpp (). Add exclude for tryBase64Decode to backward compat test (follow-up to ) (). Prefer sccache to ccache by default (). update 02003memorylimitinclient.sh (). Make check for the limited cmake dependencies the part of sparse checkout (). Fix flaky and slow tests. (). Fix dropping tables in testcreateordroptablesduringbackup (). Enable Analyzer in Stress and Fuzz tests

Run CI for PRs with missing documentation (). tests3engineheavywritecheckmem: turn test off (). NamedCollections: make exception message more informative. (). Avoid returning biggest resolution when fpr > 0.283 (). Fix: suppress TSAN in RabbitMQ test (). Small Keeper fixes (). Parallel replicas: cleanup, narrow dependency (). Fix gRPC build on macOS (). Better comment for ITransformingStep::transformPipeline (). Fix `Duplicate set` for StorageSet with analyzer. (). Better metadata path (). Analyzer fuzzer 3 (aggregatefunctionsnullforempty for projections) (). Update numbers.md (). Fix FunctionNode::toASTImpl (). Analyzer fuzzer 5 (). Cancel PipelineExecutor properly in case of exception in spawnThreads (). Allow HashedDictionary/FunctionsConversion as large TU (). Disable checksums for builds with fuzzer (). Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor (). Split HashedDictionary CU (). Cancel executor in ~CreatingSetsTransform (). Fix system._log in artifacts on CI (). Fix something in ReplicatedMergeTree (). Do not symbolize traces for debug/sanitizer builds for sending to cloud (). Resubmit 01600partstypes_metrics test (possibly without flakiness) (). Follow up to (). Allow to disable reorder-functions-after-sorting optimization (). Fix bad test `00002logandexceptionmessages_formatting` (). Fix test testreplicatedmergetreeencryptioncodec/test.py::testdifferent_keys (). Remove partial results from build matrix for stress tests (). Minor changes in testchecktable (). Fix 02903rmtretriablemergeexception flakiness for replicated database (). Mark select() as harmful function (). Improve the cherry-pick PR description (). Add debugging info for 01600partstypes_metrics on failures (). Tiny improvement security (). Update blobstoragelog.md (). (). Add test for (). Analyzer fuzzer 6 (arrayJoin) (). Add test for (). Add test for (). Fix possible crash (in Rust) of fuzzy finder in client (). fix zero-copy locks leaking (). Fix testdistributedstorage_configuration flakiness (). Update Sentry (). Update version_date.tsv and changelogs after v23.10.5.20-stable (). Update version_date.tsv and changelogs after v23.9.6.20-stable (). Update version_date.tsv and changelogs after v23.3.18.15-lts (). Update version_date.tsv and changelogs after v23.8.8.20-lts (). Change cursor style for overwrite mode (INS) to blinking in client (). Remove test `01280ttlwheregroupby` (). Fix docs (). Remove addBatchSinglePlaceFromInterval (). Add some additional groups to CI (). Analyzer: fix result type of aggregate function with NULL (). Ignore memory exception in Keeper asio workers (). Fix code reports (). Follow up recommendations from (). Add back flaky tests to analyzertechdebt.txt (). Lower level for annoying S3 log (). Add regression test for skim (Rust) crash on pasting certain input (). Remove unused Strings from MergeTreeData (). Address 02668uliddecoding flakiness (). DiskWeb fix (). Update README.md (). Add information about new _size virtual column in file/s3/url/hdfs/azure table functions (). Follow-up to : Fix build with `cmake -DENABLE_LIBRARIES=0` (). Mark a setting obsolete (). Always renew ZK client in `WithRetries` (). Shutdown disks after tables (). Update DDLTask.cpp (). verbose exception messages for StorageFuzzJSON (). Initialize only required disks in clickhouse-disks (). Allow wildcards in directories for partitioned write with File storage (). Add tests for 43202 (). Consider whole check failure in bugfix validate check as an error (). Change type of s3cache in testencrypted_disk (). Add extra debug information on replication consistency errors (). Don't print server revision in client on connect (). Adding Sydney Meetup (). Fix adjusting log_comment in case of multiple files passed (). Fix flaky test 02697stopreadingonfirst_cancel.sh (). Tiny refactoring around cache (). Decrease default value for `filesystemprefetchminbytesforsingleread_task` (). Remove bad test (). Add changelog for 23.11 (). Simple cleanup in distributed (while dealing with parallel replicas) (). Remove a feature. (). `S3Queue` is production ready (). Revert "Merge pull request from canhld94/chreplicatedcolumn_mismatch" ().