Skip to content

Pull requests: embeddings-benchmark/mteb

New pull request New
38 Open 2,727 Closed
38 Open 2,727 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

model: Fixed cohere model implementation
#4566 opened Apr 29, 2026 by KennethEnevoldsen Contributor Loading…
add jepa new model Questions related to adding a new model to the benchmark video video extension
#4565 opened Apr 29, 2026 by Samoed Member Loading…
6 of 7 tasks
1
4
fix: convert positional argument to a keyword argument preventing pylate bug
#4563 opened Apr 29, 2026 by KennethEnevoldsen Contributor Loading…
fix: Update error message on evaluate when only-cache is set
#4562 opened Apr 29, 2026 by KennethEnevoldsen Contributor Loading…
add IBM Granite multilingual r2 models
#4561 opened Apr 29, 2026 by aashka-trivedi Contributor Loading…
6 of 7 tasks
3
fix: ensure that get_model_metas raise an error if model name is incorrect
#4560 opened Apr 29, 2026 by KennethEnevoldsen Contributor Loading…
model: Add LanguageBind video and audio model wrapper new model Questions related to adding a new model to the benchmark video video extension
#4557 opened Apr 29, 2026 by Michelleyyy333 Loading…
10
fix: remove button from Gradio event handler inputs in benchmark selector
#4553 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
1
fix: Allow get_tasks to filter out a tasks
#4552 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
leaderboard: Reduce severity of not being able to produce the plot leaderboard issues related to the leaderboard
#4549 opened Apr 28, 2026 by KennethEnevoldsen Contributor Loading…
model: Add DenseOn/LateOn definitions new model Questions related to adding a new model to the benchmark
#4545 opened Apr 28, 2026 by NohTow Contributor Loading…
3
dataset: add news datasets new dataset Issues related to adding a new task or dataset
#4544 opened Apr 28, 2026 by guenthermi Member • Draft
12 tasks done
8
WIP: Added SomethingSomething zeroshot new dataset Issues related to adding a new task or dataset video video extension
#4542 opened Apr 28, 2026 by x-tabdeveloping Collaborator Loading…
5 of 7 tasks
3
Add AVMeme-Exam zero shot classification task new dataset Issues related to adding a new task or dataset video video extension
#4539 opened Apr 28, 2026 by deep9539 Contributor Loading…
6 of 7 tasks
2
Add Kinetics700 and Kinetics600 zeroshot classification task new dataset Issues related to adding a new task or dataset video video extension
#4537 opened Apr 28, 2026 by deep9539 Contributor Loading…
6 of 7 tasks
4
[MVEB] Add HMDB51ZeroShot for video zero-shot classification new dataset Issues related to adding a new task or dataset video video extension
#4532 opened Apr 28, 2026 by taidnguyen Contributor Loading…
7 tasks done
2
[MVEB] Add Daily-Omni video-centric QA task new dataset Issues related to adding a new task or dataset video video extension
#4530 opened Apr 27, 2026 by Rakshitha-Ireddi Contributor Loading…
5
ci: add .venv caching step to speed up dep install
#4516 opened Apr 26, 2026 by isaac-chung Collaborator • Draft
7
dataset: Add elastic kb retrieval new dataset Issues related to adding a new task or dataset
#4487 opened Apr 23, 2026 by emilia-elastic Loading…
6 tasks done
19
[MVEB] Add 3 native VideoPairClassification tasks new dataset Issues related to adding a new task or dataset video video extension
#4471 opened Apr 21, 2026 by stef41 Contributor Loading…
6 tasks done
9
Adding prompts to voyage-4-large 2048d model
#4464 opened Apr 20, 2026 by fzowl Contributor Loading…
5 of 7 tasks
13
Add model: TIPSv2 (google/tipsv2-b14/l14/so400m14/g14) image The image extension of MTEB new model Questions related to adding a new model to the benchmark
#4459 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
10
Add model: llm-semantic-router/aegis-embed new model Questions related to adding a new model to the benchmark
#4458 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
9
Track mteb_version per subset and allow cross-version merging
#4452 opened Apr 20, 2026 by Rakshitha-Ireddi Contributor Loading…
1
1
Make corpus_chunk_size tunable via the public evaluate() API
#4451 opened Apr 19, 2026 by Rakshitha-Ireddi Contributor Loading…
1
6
ProTip! What’s not been updated in a month: updated:<2026-03-29.