Manticore Search 6.2.0
Published: 2023-08-07 07:55:56

We're continuing the Manticore 6 series with a new major release - Manticore Search 6.2.0. Here's what's new:

## Integrations

### mysqldump for logical backups

In past versions, we created the [manticore-backup](https://manual.manticoresearch.com/Securing_and_compacting_a_table/Backup_and_restore#Using-manticore-backup-command-line-tool) tool and the [BACKUP SQL](https://manual.manticoresearch.com/Securing_and_compacting_a_table/Backup_and_restore#BACKUP-SQL-command-reference) command. These are great for physical backup, but [logical backup](https://manual.manticoresearch.com/Securing_and_compacting_a_table/Backup_and_restore#Logical-Backups) is often just as important. mysqldump, a well-known and trusted tool for logical backups from the MySQL ecosystem, now works with Manticore. Since Manticore tightly integrates with MySQL, you can now use the mysql client to log in to Manticore, and [mysqldump to backup Manticore tables](https://manual.manticoresearch.com/Securing_and_compacting_a_table/Backup_and_restore#Backup-and-restore-with-mysqldump).

### Grafana and Apache Superset

[Grafana](https://grafana.com/) and [Apache Superset](https://superset.apache.org/) are two excellent platforms for visualizing data. Starting with this release, you can use them to visualize Manticore. Read more on our blog: [Grafana](https://manticoresearch.com/blog/manticoresearch-grafana-integration/), [Apache Superset](https://manticoresearch.com/blog/manticoresearch-apache-superset-integration/).

### HeidiSQL and DBForge

If you prefer GUI over command-line tools for Manticore access, you can now use [HeidiSQL](https://www.heidisql.com/) and [DBForge](https://www.devart.com/dbforge/).

### Fluentbit and Vector

You can now use not just [Logstash](/blog/integration-of-manticore-with-logstash-filebeat/) and [Filebeat](/blog/integration-of-manticore-with-logstash-filebeat/#filebeat-configuration) to upload data to Manticore, but also [Fluentbit](/blog/integration-of-manticore-with-fluentbit/) and [Vector](/blog/integration-of-manticore-with-vectordev/) by Datadog. Read more on our [blog](/blog/)

## Performance

* [COUNT(DISTINCT)](https://manual.manticoresearch.com/Searching/Grouping#COUNT(DISTINCT-field)) is now much quicker thanks to the use of hash tables and HyperLogLog.
* `select count(*)` should now be much faster in many cases due to closer integration with secondary indexes.
* Queries with secondary indexes can now be run in parallel. The number of threads is limited to the number of physical CPU cores, which should greatly improve query speed.
* Performance of [pseudo_sharding](https://manual.manticoresearch.com/Server_settings/Searchd#pseudo_sharding) which is ON by default has been significantly boosted in case of high concurrency workloads due to smarter thread utilization. According to our tests, the 99p response time under high concurrency is now a magnitude lower, e.g.: [before](https://overload.yandex.net/628267#tab=test_data&tags=&plot_groups=additional&machines=&metrics=&slider_start=1691040559&slider_end=1691040630&compress_ratio=1), [after](https://overload.yandex.net/628251#tab=test_data&tags=&plot_groups=additional&machines=&metrics=&slider_start=1691037050&slider_end=1691037096&compress_ratio=1).
* Users can now choose [the default attribute storage engine](https://manual.manticoresearch.com/Server_settings/Searchd#engine) through configuration settings, for better customization to fit specific needs.
* The logic of the cost-based query optimizer has been improved, and the default histogram resolution is now set to 8k for better accuracy with randomly distributed values. It also more precisely estimates the complexity of applying filters over string attributes.

## /cli

The [/cli](https://manual.manticoresearch.com/Connecting_to_the_server/HTTP#/cli) endpoint has been updated, making it even easier to manage Manticore through a browser.

{% embed https://youtu.be/sjOhnXIiFPw %} 

## Buddy PHP plugins

You can now [create your own Manticore Search SQL/JSON query as a plugin](https://manticoresearch.com/blog/manticoresearch-buddy-pluggable-design/), publish it on packagist.org, and install it using the [CREATE PLUGIN](https://manual.manticoresearch.com/Extensions/UDFs_and_Plugins/Plugins/Creating_a_plugin#CREATE-BUDDY-PLUGIN) SQL command.

## Packaging
* [Language packs](https://manual.manticoresearch.com/Creating_a_table/NLP_and_tokenization/Morphology#morphology) for English, German, and Russian can now be easily installed on Linux with the command `apt/yum install manticore-language-packs`. On macOS, use `brew install manticoresoftware/tap/manticore-language-packs`.
* [New Homebrew formulas](https://manticoresearch.com/install) for quicker installation.

## CI changes
* We've begun using [GitHub workflows](https://github.com/manticoresoftware/manticoresearch/actions), making it easier for contributors to use the same Continuous Integration (CI) process as the core team when preparing packages. All jobs can be run on GitHub-hosted runners, which allows for simple testing of changes in your Manticore Search fork.
* We've started using [CLT](https://github.com/manticoresoftware/clt) to test complex situations. For instance, we can now make sure that a package built after a commit can be installed across all supported Linux operating systems. The Command Line Tester (CLT) offers an easy way to record and replay tests.

## And many more
The above is just part of what's been done since Manticore 6.0.4 and is now available in the new release. Please read about:

🚀 10 major changes
✅ 38 minor changes
🐞 60 bug fixes

in the [changelog](https://manual.manticoresearch.com/Changelog).

We hope you enjoy using the new version of Manticore Search. Please share your thoughts by:
* starting a conversation on the [Community Forum](https://forum.manticoresearch.com/c/manticore-announcements-english/5)
* reporting bugs or requesting features on [GitHub](https://github.com/manticoresoftware/manticoresearch/issues/new/choose)
* chatting about it in the [Public Slack Chat](https://slack.manticoresearch.com/)
* sending an email to contact@manticoresearch.com