## Version 1.2.0 Release Notes

* __Upgrading gson to 2.8.9 (#1541) (#1546)__

    [Vacha](mailto:vachshah@amazon.com) - Tue, 16 Nov 2021 15:22:38 -0800

    EAD -> refs/heads/1.2, refs/remotes/upstream/1.2, refs/remotes/origin/1.2
    Signed-off-by: Vacha <vachshah@amazon.com>

* __Add staged version 1.1.1 (#1505)__

    [Nick Knize](mailto:nknize@apache.org) - Thu, 4 Nov 2021 14:19:07 -0500


    Signed-off-by: Nicholas Walter Knize <nknize@apache.org>

* __Remove old ES libraries used in reindex due to CVEs (#1359) (#1497)__

    [Xue Zhou](mailto:85715413+xuezhou25@users.noreply.github.com) - Tue, 2 Nov 2021 15:54:24 -0700


    This commit removes old ES libraries version 090 and 176 due to CVE
     Signed-off-by: Xue Zhou <xuezhou@amazon.com>

* __Upgrading dependencies (#1491) (#1495)__

    [Vacha](mailto:vachshah@amazon.com) - Tue, 2 Nov 2021 15:46:18 -0700


    Signed-off-by: Vacha <vachshah@amazon.com>

* __remove codeQL warning about implicit narrowing conversion in compound assignment (#1403) (#1496)__

    [Xue Zhou](mailto:85715413+xuezhou25@users.noreply.github.com) - Tue, 2 Nov 2021 15:27:53 -0700


    Signed-off-by: Xue Zhou <xuezhou@amazon.com>

* __Cleanup for Checkstyle https://github.com/opensearch-project/OpenSearch/pull/1370 (#1492)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Tue, 2 Nov 2021 13:33:15 -0700


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Backporting #1488 spotless check on plugins (#1489)__

    [Himanshu Setia](mailto:58999915+setiah@users.noreply.github.com) - Mon, 1 Nov 2021 19:26:45 -0700


    Signed-off-by: Himanshu Setia <setiah@amazon.com>

* __Upgrading dependencies in hdfs plugin (#1466) (#1485)__

    [Vacha](mailto:vachshah@amazon.com) - Mon, 1 Nov 2021 17:12:48 -0700


    Signed-off-by: Vacha <vachshah@amazon.com>

* __Adding spotless support for subprojects under :test (#1479)__

    [Sarat Vemulapalli](mailto:vemulapallisarat@gmail.com) - Mon, 1 Nov 2021 15:16:45 -0700


    Signed-off-by: Sarat Vemulapalli <vemulapallisarat@gmail.com>

* __Make TranslogDeletionPolicy abstract for extension (#1456) (#1478)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Mon, 1 Nov 2021 12:41:05 -0700


    As part of the commit 2ebd0e04, we added a new method to the EnginePlugin to
    provide a
    custom TranslogDeletionPolicy. This commit makes
    minTranslogGenRequired method
    abstract in this class for implementation by
    child classes. The default implementation
    is provided by
    DefaultTranslogDeletionPolicy.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Remove deprecated settings and logic for translog pruning by retention lease. (#1416) (#1471)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Mon, 1 Nov 2021 10:26:20 -0500


    The settings and the corresponding logic for translog pruning by retention

    lease which were added as part of #1100 have been deprecated. This
    commit
    removes those deprecated code in favor of an extension point
    for providing a
    custom TranslogDeletionPolicy.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Run spotless and exclude checkstyle on rest-api-spec module (#1462) (#1472)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Fri, 29 Oct 2021 17:27:17 -0700




* __[Backport 1.x] Add extension point for custom TranslogDeletionPolicy in EnginePlugin (#1404) (#1424)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Fri, 29 Oct 2021 12:14:25 -0700


    * Add extension point for custom TranslogDeletionPolicy in EnginePlugin.
    (#1404)
     This commit adds a method that can be used to provide a custom
    TranslogDeletionPolicy from within plugins that implement the EnginePlugin
    interface. This enables plugins to provide a custom deletion policy with the
    current limitation that only one plugin can override the policy. An exception
    will be thrown if more than one plugin overrides the policy.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

    * Close first engine instance before creating second (#1457)
     When creating the second instance of an InternalEngine using the same translog
    config of the default InternalEngine instance, the second instance will attempt
    to delete all the existing translog files. I found
    a deterministic test
    failure when running with the seed `E3E6AAD95ABD299B`. As opposed to creating a
    second engine instance with a different translog location, just close the first
    one before creating the second.
     Signed-off-by: Andrew Ross <andrross@amazon.com>
     Co-authored-by: Andrew Ross <andrross@amazon.com>

* __Upgrade to Lucene 8.10.1 (#1440) (#1459)__

    [Nick Knize](mailto:nknize@apache.org) - Thu, 28 Oct 2021 13:23:25 -0700


    This commit upgrades to the latest release of lucene 8.10
     Signed-off-by: Nicholas Walter Knize <nknize@apache.org>

* __Run spotless and exclude checkstyle on modules module (#1442) (#1453)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Thu, 28 Oct 2021 11:02:02 -0700


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Fixing bwc test for repository-multi-version (#1441) (#1451)__

    [Vacha](mailto:vachshah@amazon.com) - Wed, 27 Oct 2021 20:22:12 -0400


    Signed-off-by: Vacha <vachshah@amazon.com>

* __[BUG] SymbolicLinkPreservingUntarTransform fails on Windows (#1433) (#1439)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Tue, 26 Oct 2021 15:03:44 -0400

    efs/heads/sr-sandbox
    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Upgrading mockito version to make it consistent across the repo (#1410) (#1435)__

    [Vacha](mailto:vachshah@amazon.com) - Tue, 26 Oct 2021 08:48:49 -0400


    Signed-off-by: Vacha <vachshah@amazon.com>

* __Adjust CodeCache size to eliminate JVM warnings (and crashes) (#1426) (#1432)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Tue, 26 Oct 2021 08:48:16 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Run spotless and checkstyle on libs module (#1428)(#1434)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Mon, 25 Oct 2021 15:13:54 -0700


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Run spotless and exclude checkstyle on plugins module (#1417) (#1423)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Fri, 22 Oct 2021 13:23:14 -0700


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Fix windows build (mostly) (#1412) (#1420)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Fri, 22 Oct 2021 12:41:44 -0400


    * Updated developer guide with Windows specifics.
     Signed-off-by: dblock <dblock@dblock.org>

    * Correct windows task name.
     Signed-off-by: dblock <dblock@dblock.org>

    * Use Docker desktop installation on Windows.
     Signed-off-by: dblock <dblock@dblock.org>

    * Locate docker-compose on Windows.
     Signed-off-by: dblock <dblock@dblock.org>

    * Default docker-compose location.
     Signed-off-by: dblock <dblock@dblock.org>

* __Run spotless and exclude checkstyle on client module https://github.com/opensearch-project/OpenSearch/pull/1392 (#1414)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Thu, 21 Oct 2021 19:44:46 -0400


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Removing Jenkinsfile (not used), replaced by opensearch-build/jenkins/opensearch/Jenkinsfile (#1408) (#1411)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Thu, 21 Oct 2021 19:42:09 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __[repository-azure] plugin should use Azure Storage SDK v12 for Java (#1302) (#1409)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Thu, 21 Oct 2021 19:41:44 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Add EngineConfig extensions to EnginePlugin (#1387) (#1401)__

    [Nick Knize](mailto:nknize@apache.org) - Thu, 21 Oct 2021 08:58:47 -0500


    This commit adds an extension point to EngineConfig through EnginePlugin using

    a new EngineConfigFactory mechanism. EnginePlugin provides interface methods to
     override configurations in EngineConfig. The EngineConfigFactory produces a
    new
    instance of the EngineConfig using these overrides. Defaults are used
    absent
    overridden configurations.
     This serves as a mechanism to override Engine configurations (e.g.,
    CodecService,
    TranslogConfig) enabling Plugins to have higher fidelity for
    changing Engine
    behavior without having to override the entire Engine (which
    is only permitted for
    a single plugin).
     Signed-off-by: Nicholas Walter Knize <nknize@apache.org>

* __Update node attribute check to version update (1.2) check for shard indexing pressure serialization. (#1398)__

    [Saurabh Singh](mailto:getsaurabh02@gmail.com) - Thu, 21 Oct 2021 09:20:52 -0400


    This is required to not mandate test have the cluster service initialized while
    asserting node attributes.
     Signed-off-by: Saurabh Singh <sisurab@amazon.com>
     Co-authored-by: Saurabh Singh <sisurab@amazon.com>

* __[BUG] Fix org.opensearch.action.admin.cluster.node.stats.NodeStatsTests.testSerialization (#1399)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Thu, 21 Oct 2021 09:16:15 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Run spotless and exclude checkstyle on server module https://github.com/opensearch-project/OpenSearch/pull/1380 (#1391)__

    [Owais Kazi](mailto:owaiskazi19@gmail.com) - Wed, 20 Oct 2021 17:51:26 -0500


    Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>

* __Minor fix for the flaky test to reduce concurrency (#1361) (#1397)__

    [Saurabh Singh](mailto:getsaurabh02@gmail.com) - Wed, 20 Oct 2021 15:29:04 -0400


    Signed-off-by: Saurabh Singh <sisurab@amazon.com>
     Co-authored-by: Saurabh Singh <sisurab@amazon.com>

* __[Backport] [1.x] Clarified JDK usage in DEVELOPER_GUIDE.md, fixed minor issue with configuring runtime JDK (#1372)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Wed, 20 Oct 2021 15:27:38 -0400


    * Clarified JDK usage in DEVELOPER_GUIDE.md, fixed minor issue with configuring
    runtime JDK
     Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

    * Fixed minor typos in DEVELOPER_GUIDE.md
     Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Upgrading netty version to 4.1.69.Final (#1363) (#1382)__

    [Vacha](mailto:vachshah@amazon.com) - Mon, 18 Oct 2021 22:05:45 -0400


    Signed-off-by: Vacha <vachshah@amazon.com>

* __Allow building on FreeBSD (#1091) (#1374)__

    [Romain Tartière](mailto:romain@blogreen.org) - Sun, 17 Oct 2021 15:53:10 -0400


    * Allow building on FreeBSD
     With this set of change, we are able to successfuly run:

    ```
    ./gradlew publishToMavenLocal -Dbuild.snapshot=false
    ```
     This step is used in the OpenSearch repository context when building
    plugins
    in the current state of the CI.
     While here, reorder OS conditions alphabetically.
     Before building, the openjdk14 package was installed and the environment
    was
    adjusted to use it:

    ```
    sudo pkg install openjdk14
    export JAVA_HOME=/usr/local/openjdk14/
    export
    PATH=$JAVA_HOME/bin:$PATH
    ```
     Signed-off-by: Romain Tartière <romain@blogreen.org>

    * Unbreak CI with FreeBSD support
     Signed-off-by: dblock <dblock@dblock.org>
     Co-authored-by: dblock <dblock@dblock.org>
     Co-authored-by: dblock <dblock@dblock.org>

* __Upgrade hadoop dependencies for hdfs plugin (#1335) (#1369)__

    [Vacha](mailto:vachshah@amazon.com) - Fri, 15 Oct 2021 08:56:48 -0400


    * Upgrade hadoop dependencies for hdfs plugin
     Signed-off-by: Vacha <vachshah@amazon.com>

    * Fixing gradle check failures
     Signed-off-by: Vacha <vachshah@amazon.com>

    * Upgrading htrace-core4 to 4.1.0
     Signed-off-by: Vacha <vachshah@amazon.com>

* __Add Shard Level Indexing Pressure (#1336) (#1343)__

    [Saurabh Singh](mailto:getsaurabh02@gmail.com) - Mon, 11 Oct 2021 12:14:18 -0700


    Shard level indexing pressure improves the current Indexing Pressure framework
    which performs memory accounting at node level and rejects the requests. This
    takes a step further to have rejections based on the memory accounting at shard
    level along with other key performance factors like throughput and last
    successful requests.

    **Key features**
    - Granular tracking of indexing tasks performance, at every shard level, for
    each node role i.e. coordinator, primary and replica.
    - Smarter rejections by discarding the requests intended only for problematic
    index or shard, while still allowing others to continue (fairness in
    rejection).
    - Rejections thresholds governed by combination of configurable parameters
    (such as memory limits on node) and dynamic parameters (such as latency
    increase, throughput degradation).
    - Node level and shard level indexing pressure statistics exposed through stats
    api.
    - Integration of Indexing pressure stats with Plugins for for metric visibility
    and auto-tuning in future.
    - Control knobs to tune to the key performance thresholds which control
    rejections, to address any specific requirement or issues.
    - Control knobs to run the feature in shadow-mode or enforced-mode. In
    shadow-mode only internal rejection breakdown metrics will be published while
    no actual rejections will be performed.
     The changes were divided into small manageable chunks as part of the following
    PRs against a feature branch.

    - Add Shard Indexing Pressure Settings. #716
    - Add Shard Indexing Pressure Tracker. #717
    - Refactor IndexingPressure to allow extension. #718
    - Add Shard Indexing Pressure Store #838
    - Add Shard Indexing Pressure Memory Manager #945
    - Add ShardIndexingPressure framework level construct and Stats #1015
    - Add Indexing Pressure Service which acts as orchestrator for IP #1084
    - Add plumbing logic for IndexingPressureService in Transport Actions. #1113
    - Add shard indexing pressure metric/stats via rest end point. #1171
    - Add shard indexing pressure integration tests. #1198
     Signed-off-by: Saurabh Singh <sisurab@amazon.com>
    Co-authored-by: Saurabh
    Singh <sisurab@amazon.com>
    Co-authored-by: Rabi Panda <adnapibar@gmail.com>

* __Replace securemock with mock-maker (test support), update Mockito to 3.12.4 (#1332) (#1354)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Mon, 11 Oct 2021 11:29:50 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __[BUG] ConcurrentSnapshotsIT#testAssertMultipleSnapshotsAndPrimaryFailOver fails intermittently (#1311) (#1322)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Thu, 30 Sep 2021 19:59:11 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Support for Heap after GC stats (opensearch-project#1265) (#1309)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Wed, 29 Sep 2021 17:20:06 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Switch to newSnapshot testing method to use helper__

    [Nicholas Walter Knize](mailto:nknize@apache.org) - Sun, 26 Sep 2021 00:00:35 -0500


    Signed-off-by: Nicholas Walter Knize <nknize@apache.org>


* __[Revert] Translog Pruning Setting Deprecation Removal (#1294)__

    [Nick Knize](mailto:nknize@apache.org) - Sat, 25 Sep 2021 23:04:26 -0500


    INDEX_PLUGINS_REPLICATION_TRANSLOG_RETENTION_LEASE_PRUNING_ENABLED_SETTING was

    deprecated, then deprecation was removed. This adds deprecation back so that
    the
    setting can be moved to the plugin in the next minor release.
     Signed-off-by: Nicholas Walter Knize <nknize@apache.org>

* __Update Jackson to 2.12.5 (#1247) (#1270)__

    [Andriy Redko](mailto:andriy.redko@aiven.io) - Wed, 22 Sep 2021 10:52:55 -0400


    Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* __Add support to generate code coverage report with JaCoCo (#1236)__

    [Tianli Feng](mailto:ftianli@amazon.com) - Mon, 20 Sep 2021 11:06:35 -0700


    * Apply JaCoCo Gradle plugin to the root project, and to all the sub-projects
    through BuildPlugin.
    * Add 3 Gradle tasks: codeCoverageReport, codeCoverageReportForUnitTest,
    codeCoverageReportForIntegrationTest to generate code coverage report for all
    the tests, unit tests, and integration tests correspondingly.
    * Attach Gradle codeCoverageReport task to check task.
    * Remove outdated code of giving JaCoCo files permission when Java security
    manager enabled
     Signed-off-by: Tianli Feng <ftianli@amazon.com>

* __[Version] Increment 1.x to 1.2 (#1239)__

  [Nick Knize](mailto:nknize@apache.org) - Tue, 14 Sep 2021 06:48:05 -0400


    Signed-off-by: Nicholas Walter Knize <nknize@apache.org>