2019 Changelog

#### New Feature[​](#new-feature-1 "Direct link to New Feature")

- Add `deduplicate_blocks_in_dependent_materialized_views` option to control the behaviour of idempotent inserts into tables with materialized views. This new feature was added to the bugfix release by a special request from Altinity.
  [#9070](https://github.com/ClickHouse/ClickHouse/pull/9070) [(urykhy)](https://github.com/urykhy)

### ClickHouse Release 19.16.2.2, 2019-10-30[​](#clickhouse-release-v19-16-2-2-2019-10-30 "Direct link to ClickHouse Release 19.16.2.2, 2019-10-30")

#### Backward Incompatible Change[​](#backward-incompatible-change-1 "Direct link to Backward Incompatible Change")

- Add missing arity validation for count/counIf.
  [#7095](https://github.com/ClickHouse/ClickHouse/issues/7095)
  [#7298](https://github.com/ClickHouse/ClickHouse/pull/7298) ([Vdimir](https://github.com/Vdimir))
- Remove legacy `asterisk_left_columns_only` setting (it was disabled by default).
  [#7335](https://github.com/ClickHouse/ClickHouse/pull/7335) ([Artem
  Zuikov](https://github.com/4ertus2))
- Format strings for Template data format are now specified in files.
  [#7118](https://github.com/ClickHouse/ClickHouse/pull/7118)
  ([tavplubix](https://github.com/tavplubix))

#### New Feature[​](#new-feature-2 "Direct link to New Feature")

- Introduce uniqCombined64() to calculate cardinality greater than UINT\_MAX.
  [#7213](https://github.com/ClickHouse/ClickHouse/pull/7213),
  [#7222](https://github.com/ClickHouse/ClickHouse/pull/7222) ([Azat
  Khuzhin](https://github.com/azat))
- Support Bloom filter indexes on Array columns.
  [#6984](https://github.com/ClickHouse/ClickHouse/pull/6984)
  ([achimbab](https://github.com/achimbab))
- Add a function `getMacro(name)` that returns String with the value of corresponding `<macros>`
  from server configuration. [#7240](https://github.com/ClickHouse/ClickHouse/pull/7240)
  ([alexey-milovidov](https://github.com/alexey-milovidov))
- Set two configuration options for a dictionary based on an HTTP source: `credentials` and
  `http-headers`. [#7092](https://github.com/ClickHouse/ClickHouse/pull/7092) ([Guillaume
  Tassery](https://github.com/YiuRULE))
- Add a new ProfileEvent `Merge` that counts the number of launched background merges.
  [#7093](https://github.com/ClickHouse/ClickHouse/pull/7093) ([Mikhail
  Korotov](https://github.com/millb))
- Add fullHostName function that returns a fully qualified domain name.
  [#7263](https://github.com/ClickHouse/ClickHouse/issues/7263)
  [#7291](https://github.com/ClickHouse/ClickHouse/pull/7291) ([sundyli](https://github.com/sundy-li))
- Add function `arraySplit` and `arrayReverseSplit` which split an array by "cut off"
  conditions. They are useful in time sequence handling.
  [#7294](https://github.com/ClickHouse/ClickHouse/pull/7294) ([hcz](https://github.com/hczhcz))
- Add new functions that return the Array of all matched indices in multiMatch family of functions.
  [#7299](https://github.com/ClickHouse/ClickHouse/pull/7299) ([Danila
  Kutenin](https://github.com/danlark1))
- Add a new database engine `Lazy` that is optimized for storing a large number of small -Log
  tables. [#7171](https://github.com/ClickHouse/ClickHouse/pull/7171) ([Nikita
  Vasilev](https://github.com/nikvas0))
- Add aggregate functions groupBitmapAnd, -Or, -Xor for bitmap columns. [#7109](https://github.com/ClickHouse/ClickHouse/pull/7109) ([Zhichang
  Yu](https://github.com/yuzhichang))
- Add aggregate function combinators -OrNull and -OrDefault, which return null
  or default values when there is nothing to aggregate.
  [#7331](https://github.com/ClickHouse/ClickHouse/pull/7331)
  ([hcz](https://github.com/hczhcz))
- Introduce CustomSeparated data format that supports custom escaping and
  delimiter rules. [#7118](https://github.com/ClickHouse/ClickHouse/pull/7118)
  ([tavplubix](https://github.com/tavplubix))
- Support Redis as source of external dictionary. [#4361](https://github.com/ClickHouse/ClickHouse/pull/4361) [#6962](https://github.com/ClickHouse/ClickHouse/pull/6962) ([comunodi](https://github.com/comunodi), [Anton
  Popov](https://github.com/CurtizJ))

#### Bug Fix[​](#bug-fix-2 "Direct link to Bug Fix")

- Fix wrong query result if it has `WHERE IN (SELECT ...)` section and `optimize_read_in_order` is
  used. [#7371](https://github.com/ClickHouse/ClickHouse/pull/7371) ([Anton
  Popov](https://github.com/CurtizJ))
- Disabled MariaDB authentication plugin, which depends on files outside of project.
  [#7140](https://github.com/ClickHouse/ClickHouse/pull/7140) ([Yuriy
  Baranov](https://github.com/yurriy))
- Fix exception `Cannot convert column ... because it is constant but values of constants are different in source and result` which could rarely happen when functions `now()`, `today()`,
  `yesterday()`, `randConstant()` are used.
  [#7156](https://github.com/ClickHouse/ClickHouse/pull/7156) ([Nikolai
  Kochetov](https://github.com/KochetovNicolai))
- Fixed issue of using HTTP keep alive timeout instead of TCP keep alive timeout.
  [#7351](https://github.com/ClickHouse/ClickHouse/pull/7351) ([Vasily
  Nemkov](https://github.com/Enmk))
- Fixed a segmentation fault in groupBitmapOr (issue [#7109](https://github.com/ClickHouse/ClickHouse/issues/7109)).
  [#7289](https://github.com/ClickHouse/ClickHouse/pull/7289) ([Zhichang
  Yu](https://github.com/yuzhichang))
- For materialized views the commit for Kafka is called after all data were written.
  [#7175](https://github.com/ClickHouse/ClickHouse/pull/7175) ([Ivan](https://github.com/abyss7))
- Fixed wrong `duration_ms` value in `system.part_log` table. It was ten times off.
  [#7172](https://github.com/ClickHouse/ClickHouse/pull/7172) ([Vladimir
  Chebotarev](https://github.com/excitoon))
- A quick fix to resolve crash in LIVE VIEW table and re-enabling all LIVE VIEW tests.
  [#7201](https://github.com/ClickHouse/ClickHouse/pull/7201)
  ([vzakaznikov](https://github.com/vzakaznikov))
- Serialize NULL values correctly in min/max indexes of MergeTree parts.
  [#7234](https://github.com/ClickHouse/ClickHouse/pull/7234) ([Alexander
  Kuzmenkov](https://github.com/akuzm))
- Don't put virtual columns to .sql metadata when table is created as `CREATE TABLE AS`.
  [#7183](https://github.com/ClickHouse/ClickHouse/pull/7183) ([Ivan](https://github.com/abyss7))
- Fix segmentation fault in `ATTACH PART` query.
  [#7185](https://github.com/ClickHouse/ClickHouse/pull/7185)
  ([alesapin](https://github.com/alesapin))
- Fix wrong result for some queries given by the optimization of empty IN subqueries and empty
  INNER/RIGHT JOIN. [#7284](https://github.com/ClickHouse/ClickHouse/pull/7284) ([Nikolai
  Kochetov](https://github.com/KochetovNicolai))
- Fixing AddressSanitizer error in the LIVE VIEW getHeader() method.
  [#7271](https://github.com/ClickHouse/ClickHouse/pull/7271)
  ([vzakaznikov](https://github.com/vzakaznikov))

#### Improvement[​](#improvement-1 "Direct link to Improvement")