1.36.22

1.36.22 (2025-03-13)

Fix

• fix: Ensure MIRACL pass trust_remote_code (#2346)

• fix: Add trust_remote_code to MIRACLRetrieval

• fix: Correctly pass trust remote code to Miracl

• fix (75961a0)

• fix: Correctly pass trust remote code to Miracl (d6d8552)

Unknown

• Merge branch 'main' of https://github.com/embeddings-benchmark/mteb (eadc38d)

• Merge branch 'fix-miracl' (7576b57)

1.36.21

1.36.21 (2025-03-13)

Fix

• fix: Add trust_remote_code to MIRACLRetrieval (#2344) (2d45653)

1.36.20

1.36.20 (2025-03-12)

Fix

• fix: Add WebFAQ bitext mining tasks (#2326)

• Add WebFAQ bitext mining tasks

Signed-off-by: Michael Dinzinger <[email protected]>

• Lower number of language pairs in WebFAQBitextMining

Signed-off-by: Michael Dinzinger <[email protected]>

---

Signed-off-by: Michael Dinzinger <[email protected]> (04cfe4d)

Unknown

• Update tasks table (d716408)

1.36.19

1.36.19 (2025-03-11)

Documentation

• docs: fix typos (849efbb)

Fix

• fix: Add ModelMeta rubert-mini-frida, BERTA (#2330)

• Add rubert-mini-frida model meta

• Add BERTA model meta (ae83b5f)

1.36.18

1.36.18 (2025-03-11)

Fix

• fix: add annotation models for stella zh (#2277)

• fix: add annotation models for stella zh

Additionally fixed a few annotation errors

• format

• Update mteb/models/stella_models.py

Co-authored-by: Isaac Chung <[email protected]>

---

Co-authored-by: Isaac Chung <[email protected]> (034da4d)

1.36.17

1.36.17 (2025-03-11)

Fix

• fix: remove SyntaxWarnings in py312 (#2325)

• fix: Resolve conflicting dependencies

These errors where discovered when trying to install the package using uv.

We have a problem with salesforce-lavis, which is not compatible with the current set of dependencies.

• fix: Remove syntax warnings occuring in python 3.12

Python 3.12.0 (main, Oct  2 2023, 20:56:14) [Clang 16.0.3 ] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import mteb # no syntax warnings
>>>
``` ([`fc176ad`](https://github.com/embeddings-benchmark/mteb/commit/fc176ad3df466ccb4a31a0f9b90aad1de96ca87a))

1.36.16

1.36.16 (2025-03-11)

Fix

• fix: Resolve conflicting dependencies (#2323)

These errors where discovered when trying to install the package using uv.

We have a problem with salesforce-lavis, which is not compatible with the current set of dependencies. (8f6bf45)

Unknown

• Added VDR Model (#2290)

• Added VDR Model

• change custom wrapper to SentenceTransformer Wrapper

• remove kwargs and add TODO for Image Modality

• Update mteb/models/vdr_models.py

Co-authored-by: Roman Solomatin <[email protected]>

---

Co-authored-by: Roman Solomatin <[email protected]> (7965aad)

1.36.15

1.36.15 (2025-03-11)

Fix

• fix: Update voyage name to include Org. (#2322) (746b411)

1.36.14

1.36.14 (2025-03-10)

Ci

• ci: Add pre-commit hook (#2194)

• make dev life nicer - pre-commit hooks

• add pre-commit to install

• update precommit

• update ruff pre-commit

• lint

• lint

---

Co-authored-by: sam021313 <[email protected]> (5b30d84)

Fix

• fix: bug in voyage implementation (#2304)

• fix: Fix bug in voyage implementation

"passage" is not a valid input for the voyage API. Remapped to "document".

• Update mteb/models/voyage_models.py

Co-authored-by: Roman Solomatin <[email protected]>

---

Co-authored-by: Roman Solomatin <[email protected]> (6193db1)

Unknown

• Update tasks table (5e3915e)

1.36.13

1.36.13 (2025-03-09)

Fix

• fix: Add ModelMeta license & custom validations (#2293)

• license validation

• move licenses

• update imports

---

Co-authored-by: Isaac Chung <[email protected]> (5dce601)