Project: OpenSearch (Observability and Analysis / Observability)
File: opensearch.release-notes-2.10.0.md

Add server version as REST response header Start replication checkpointTimers on primary before segments upload to remote store. (https://github.com/opensearch-project/OpenSearch/pull/8221) Introduce new static cluster setting to control slice computation for concurrent segment search. () Add configuration for file cache size to max remote data ratio to prevent oversubscription of file cache () Disallow compression level to be set for default and best_compression index codecs (https://github.com/opensearch-project/OpenSearch/pull/8737) https://github.com/opensearch-project/OpenSearch/pull/8195) Prioritize replica shard movement during shard relocation () Introducing Default and Best Compression codecs as their algorithm name () Make SearchTemplateRequest implement IndicesRequest.Replaceable () ) ) ) ) Allow test clusters to run with TLS () Add jdk.incubator.vector module support for JDK 20+ () ) Add support for reading partial files to HDFS repository () ) ) Add support for extensions to search responses using SearchExtBuilder () ) Core crypto library to perform encryption and decryption of source content () Expose DelimitedTermFrequencyTokenFilter to allow providing term frequencies along with terms () APIs for performing async blob reads and async downloads from the repository using multiple streams () Add concurrent segment search related metrics to node and index stats () Add average concurrency metric for concurrent segment search () Introduce cluster default remote translog buffer interval setting () Added encryption-sdk lib to provide encryption and decryption capabilities ( ) ) Added crypto-kms plugin to provide AWS KMS based key providers for encryption/decryption. () ) ) ) Bump `org.apache.logging.log4j:log4j-core` from 2.17.1 to 2.20.0 () Bump `io.grpc:grpc-context` from 1.46.0 to 1.57.1 (, ) Bump `com.netflix.nebula:gradle-info-plugin` from 12.1.5 to 12.1.6 () Bump `commons-codec:commons-codec` from 1.15 to 1.16.0 () Bump `org.apache.zookeeper:zookeeper` from 3.8.1 to 3.9.0 (, ) Bump `org.gradle.test-retry` from 1.5.3 to 1.5.4 () Bump `com.netflix.nebula.ospackage-base` from 11.3.0 to 11.4.0 () Bump `com.google.http-client:google-http-client-gson` from 1.43.2 to 1.43.3 () OpenJDK Update (July 2023 Patch releases) () Bump `hadoop` libraries from 3.3.4 to 3.3.6 () Bump `com.gradle.enterprise` from 3.13.3 to 3.14.1 () Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0 () Bump `com.google.cloud:google-cloud-core-http` from 2.21.0 to 2.21.1 () Bump `com.maxmind.geoip2:geoip2` from 4.0.1 to 4.1.0 () Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0 in /plugins/repository-hdfs () Bump `netty` from 4.1.94.Final to 4.1.96.Final () Bump `com.google.jimfs:jimfs` from 1.2 to 1.3.0 () Bump `io.projectreactor.netty:reactor-netty-http` from 1.1.8 to 1.1.9 () Bump `org.apache.maven:maven-model` from 3.9.3 to 3.9.4 () Bump `com.azure:azure-storage-blob` from 12.22.3 to 12.23.0 () Bump `com.diffplug.spotless` from 6.19.0 to 6.20.0 () Bump `org.xerial.snappy:snappy-java` from 1.1.8.2 to 1.1.10.3 () Bump `com.squareup.okhttp3:okhttp` from 4.9.3 to 4.11.0 () Bump `com.squareup.okio:okio` from 2.8.0 to 3.5.0 () Bump `com.google.code.gson:gson` from 2.9.0 to 2.10.1 () Bump `lycheeverse/lychee-action` from 1.2.0 to 1.8.0 () Bump `snakeyaml` from 2.0 to 2.1 () Bump `aws-actions/configure-aws-credentials` from 1 to 2 () Bump `com.github.luben:zstd-jni` from 1.5.5-3 to 1.5.5-5 ( Bump `netty` from 4.1.96.Final to 4.1.97.Final () Bump

from 1.57.1 to 1.57.2 () Add Encryption SDK dependencies () Default to mmapfs within hybridfs () Perform aggregation postCollection in ContextIndexSearcher after searching leaves () Make Span exporter configurable () Perform aggregation postCollection in ContextIndexSearcher after searching leaves () ) ) Remote Segment Store Repository setting moved from `index.remotestore.repository` to `index.remotestore.segment.repository` and `cluster.remotestore.repository` to `cluster.remotestore.segment.repository` respectively for Index and Cluster level settings () Change InternalSignificantTerms to sum shard-level superset counts only in final reduce () Exclude 'benchmarks' from codecov report () Create separate SourceLookup instance per segment slice in SignificantTextAggregatorFactory () Replace the deprecated IndexReader APIs with new storedFields() & termVectors() () ) Add safeguard limits for file cache during node level allocation () Performance improvements for BytesRefHash () Add support for aggregation profiler with concurrent aggregation () ) Add support for aggregation profiler with concurrent aggregation () ) ) Make MultiBucketConsumerService thread safe to use across slices during search () Removed blocking wait in TransportGetSnapshotsAction which was exhausting generic threadpool () Adds support for tracing runnable scenarios () Change shardsize and shardmindoccount evaluation to happen in shard level reduce phase () Add attributes to startSpan methods () ) Add support for wrapping CollectorManager with profiling during concurrent execution () Add base class for parameterizing the search based tests #9083 () Add support for wrapping CollectorManager with profiling during concurrent execution () Rethrow OpenSearch exception for non-concurrent path while using concurrent search () Improve performance of encoding composite keys in multi-term aggregations () Refactor Compressors from CompressorFactory to CompressorRegistry for extensibility () Fix sort related ITs for concurrent search ( ) Add support to use trace propagated from client () Separate request-based and settings-based concurrent segment search controls and introduce AggregatorFactory method to determine concurrent search support () ) ) Redefine telemetry context restoration and propagation () Use non-concurrent path for sort request on timeseries index and field() Added sampler based on `Blanket Probabilistic Sampling rate` and `Override for on demand` () Decouple replication lag from logic to fail stale replicas () Improve performance of rounding dates in date_histogram aggregation () ) Removing the vec file extension from INDEXSTOREHYBRIDNIOEXTENSIONS, to ensure the no performance degradation for vector search via Lucene Engine.()) Cleanup Unreferenced file on segment merge failure () Move zstd compression codec to external custom-codecs repository ( ) ) Remove provision to create Remote Indices without Remote Translog Store () Fix flaky ResourceAwareTasksTests.testBasicTaskResourceTracking test () Fix nullpointerexception when creating or updating ingest pipeline () Fix memory leak when using Zstd Dictionary () Fix condition to remove index create block () Add support to clear archived index setting () Fix range reads in respository-s3 () ) Disable shard/segment level searchafter short cutting if tracktotal_hits != false () )