opensearch-project

~data-platform/opensearch-project-components/+git/opensearch-k-nn:lp-2.13.0

Git
lp:~data-platform/opensearch-project-components/+git/opensearch-k-nn
lp-2.13.0

Last commit made on 2024-05-07

Get this branch:: git clone -b lp-2.13.0 https://git.launchpad.net/~data-platform/opensearch-project-components/+git/opensearch-k-nn

Members of Canonical Data Platform can upload to this branch. Log in for directions.

Branch merges

Branch information

Name:: lp-2.13.0

Repository:: lp:~data-platform/opensearch-project-components/+git/opensearch-k-nn

Recent commits

0af2f65... by Pedro Guimarães on 2024-05-07

changed gradle distro url

328f501... by "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> on 2024-03-19

Upgrade byte-buddy version to 1.14.9 (#1567) (#1569)

Signed-off-by: Varun Jain <email address hidden>
(cherry picked from commit e8c9cedd922ff4d36d7b133685c8a46919fab878)

Co-authored-by: Varun Jain <email address hidden>

5cd2ab8... by "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> on 2024-03-19

Add release notes for 2.13.0 release (#1564) (#1565)

* Add release notes for 2.13.0 release

Signed-off-by: Varun Jain <email address hidden>

* Add release notes for 2.13.0 release

Signed-off-by: Varun Jain <email address hidden>

---------

Signed-off-by: Varun Jain <email address hidden>
(cherry picked from commit 9a38cfcda78c68f28f90e8197b24a88677ac0d6a)

Co-authored-by: Varun Jain <email address hidden>

1d712da... by "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> on 2024-03-18

[Backport 2.x] Faiss SQFP16 Range Validation and Clipping (#1563)

* Faiss SQFP16 Range Validation and Clipping (#1562)

* Add Range Validation for SQFP16 (#1493)

* Add Range Validation for SQFP16 Vector Data

Signed-off-by: Naveen Tatikonda <email address hidden>

* Add index setting to clip vector data to FP16 range

Signed-off-by: Naveen Tatikonda <email address hidden>

* Add CHANGELOG

Signed-off-by: Naveen Tatikonda <email address hidden>

* Add an encoder parameter to clip fp16 range

Signed-off-by: Naveen Tatikonda <email address hidden>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <email address hidden>

* Add BWC Tests

Signed-off-by: Naveen Tatikonda <email address hidden>

---------

Signed-off-by: Naveen Tatikonda <email address hidden>

* SQFP16 Range Validation for Faiss IVF Models (#1557)

* SQFP16 Range Validation for Faiss IVF Models

Signed-off-by: Naveen Tatikonda <email address hidden>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <email address hidden>

---------

Signed-off-by: Naveen Tatikonda <email address hidden>

* Rebase Changes

Signed-off-by: Naveen Tatikonda <email address hidden>

---------

Signed-off-by: Naveen Tatikonda <email address hidden>
(cherry picked from commit d63ce2766bfd7551b680c1d2801b2c9e986f9613)

* Fix EntityUtils package

Signed-off-by: Naveen Tatikonda <email address hidden>

---------

Signed-off-by: Naveen Tatikonda <email address hidden>
Co-authored-by: Naveen Tatikonda <email address hidden>

6329f5f... by "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> on 2024-03-18

Remove faiss CI patch (#1560) (#1561)

Signed-off-by: Naveen Tatikonda <email address hidden>
(cherry picked from commit 4b0078d08148d61543cc993deec607700fd8a124)

Co-authored-by: Naveen Tatikonda <email address hidden>

715b79d... by John Mazanec <email address hidden> on 2024-03-18

Integrate index state sharing into mem management (#1545)

Adds the ability to share index state amongst indices during index load
operations into the plugins memory management system. Introduces a
manager of the shared state that will properly manage the lifecycle of
the shared state.

There was a bug in clear cache that had to be fixed to get this change
working as well. Previously, only one index file per clear cache would
be freed. This fixes that logic to clear everything.

Added unit tests and an integration test to confirm functionality. In
addition, modified recall integration tests to get more coverage on the
different algo configs. Along with this, had to fix a few things around
the computation of recall for non-l2 space types.

Signed-off-by: John Mazanec <email address hidden>

35a4eb4... by John Mazanec <email address hidden> on 2024-03-14

Add ability to share IVFPQ-l2 state in JNI (#1529)

Adds a set of JNI functions that allows IVFPQ-l2 dynamically precomputed
tables to be shared amongst indices at load time that use the same
model.

In addition, refactors JNIService interface to take KNNEngine as param instead of as string

In addition, add unit tests to confirm that the shared state operates as
expected.

Signed-off-by: John Mazanec <email address hidden>

ae6faa8... by John Mazanec <email address hidden> on 2024-03-07

Introduce faiss patch to share ivfpq precomp table (#1520)

Introduces a patch for faiss library to share ivfpq table between faiss
indices. Patch is built from:
https://github.com/jmazanec15/faiss/pull/1/commits/c5ca07299b427dedafc738b98bd20f8f286f6783.

In addition, modify different locations to apply patch.

Signed-off-by: John Mazanec <email address hidden>

67b54c0... by "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> on 2024-03-18

Enabled Inner Product Space Type support for Lucene Engine (#1551) (#1555)

Signed-off-by: Navneet Verma <email address hidden>
(cherry picked from commit eefc7d78aeb247c50e57a4ff1ce7ccbd54a23f35)

Co-authored-by: Navneet Verma <email address hidden>

06d395f... by Ryan Bogan <email address hidden> on 2024-03-15

[Backport 2.x] Persist model definition in model metadata (#1548)

* Persist model definition in model metadata (#1527)

* Add MethodComponentContext to ModelMetadata