Skip to content

Pull requests: confident-ai/deepeval

New pull request New
114 Open 1,974 Closed
114 Open 1,974 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix task completion tool prompt rendering
#2814 opened Jun 28, 2026 by luochen211 Loading…
1
1
Update Cli login
#2813 opened Jun 28, 2026 by A-Vamshi Collaborator Loading…
1
feat(metrics): add AdversarialRobustnessMetric (RoMA-based) (#2150)
#2812 opened Jun 27, 2026 by xr843 Loading…
1
2
feat(metrics): add CitationFaithfulnessMetric
#2811 opened Jun 26, 2026 by rsrijith Loading…
2
Trace test runs
#2810 opened Jun 26, 2026 by A-Vamshi Collaborator Loading…
1
fix(task_completion): pass tools_called_formatted to extract_goal_and_outcome template
#2809 opened Jun 26, 2026 by itxsamad1 Loading…
1 task
1
1
fix(task_completion): pass tools_called_formatted to the extract_goal_and_outcome template
#2808 opened Jun 26, 2026 by ppcvote Loading…
1
1
fix: correct dataset field defaults, add source-grouping to ContextualRecall, short-circuit Summarization identity
#2806 opened Jun 26, 2026 by medhwu Loading…
1
docs: note logprob-less gpt-5 models are unsupported for G-Eval (#2280)
#2805 opened Jun 26, 2026 by minh2416294 Loading…
1
docs(tool-correctness): fix nonexistent ToolCallParams.TOOL reference (#1510)
#2804 opened Jun 26, 2026 by minh2416294 Loading…
1
2
fix(metrics): return score 1.0 when SummarizationMetric input equals output
#2803 opened Jun 25, 2026 by mimran-khan Loading…
1
2
feat(benchmarks): add batch_generate support to SQuAD benchmark
#2802 opened Jun 25, 2026 by GouravSingal-code Loading…
1
2
Add chatbot evaluation example awaiting code fix
#2801 opened Jun 25, 2026 by sunnyg-sdet Loading…
5
Add TS support for synthetic data, simulation parity, and prompt optimization
#2798 opened Jun 24, 2026 by theanuragg Loading…
3
fix(dag): make DAGMetric instances safely reusable across measure() calls
#2795 opened Jun 24, 2026 by jhochenbaum • Draft
2 of 3 tasks
1
Fix HallucinationMetric silently passing when context is empty
#2794 opened Jun 23, 2026 by k-dickinson Loading…
1
feat(synthesizer): add optional expected_output_schema for structured goldens
#2793 opened Jun 21, 2026 by bonpiedlaroute Contributor Loading…
1
1
fix(dataset): correct invalid field defaults and except clause
#2792 opened Jun 20, 2026 by bongho Contributor Loading…
3
feat(metrics): support document-type specific threshold overrides
#2791 opened Jun 20, 2026 by rohitmannur007 Loading…
2
docs(examples): add heterogeneous financial document RAG evaluation example with threshold_overrides
#2790 opened Jun 20, 2026 by Ruthwik-Data Contributor • Draft
1 task done
1
test(metrics): add overlapping-chunk regression fixtures for ContextualRecallMetric (closes #2788)
#2789 opened Jun 20, 2026 by Ruthwik-Data Contributor • Draft
1 task done
1
1
test(metrics): add overlapping-chunk regression fixtures for ContextualPrecisionMetric (rebased on #2743)
#2787 opened Jun 20, 2026 by Ruthwik-Data Contributor • Draft
1 task done
1
1
fix(execute): resolve #2216 — AsyncConfig import problem
#2786 opened Jun 20, 2026 by Sudhanwa-git Loading…
3 of 4 tasks
1
1
feat: add AgentLoopDetectionMetric scaffold
#2782 opened Jun 19, 2026 by rohitmannur007 Loading…
2
fix(llms): prevent trim_and_load_json from corrupting valid JSON strings
#2780 opened Jun 18, 2026 by cschanhniem Loading…
4 tasks done
1
1
ProTip! Exclude everything labeled bug with -label:bug.