-
Notifications
You must be signed in to change notification settings - Fork 338
Pull requests: huggingface/evaluate
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
feat(perplexity): forward kwargs to from_pretrained
#807
opened Sep 2, 2026 by
ShamikOfficial
Loading…
1 task done
fix(bertscore): cap tokenizer max_length for transformers>=5
#806
opened Sep 2, 2026 by
ShamikOfficial
Loading…
1 task done
fix(mse): support sklearn versions without root_mean_squared_error
#805
opened Sep 2, 2026 by
ShamikOfficial
Loading…
1 task done
fix(r_squared): implement the documented zero_division parameter
#804
opened Aug 29, 2026 by
hassaanch23
Loading…
fix(cuad): stop collapsing an undefined AUPR to a score of 0
#802
opened Aug 24, 2026 by
promptsmith1990
Loading…
fix(perplexity): use all_special_tokens for GPT-2 tokenizer compatibility
#789
opened Aug 16, 2026 by
akaashsa
Loading…
Fix typo and document normalize values in confusion_matrix README
#788
opened Aug 9, 2026 by
RudrenduPaul
Loading…
Use per-dimension mean (axis=0) in mahalanobis metric
#786
opened Aug 6, 2026 by
uttam12331
Loading…
Add Expected Calibration Error (ECE) metric using netcal
#785
opened Jul 31, 2026 by
itsfernn
Loading…
Add financial_llm_faithfulness metric for regulated financial AI evaluation
#783
opened Jul 25, 2026 by
priyanka25aug
Loading…
1 of 5 tasks
Add Retrieval-Conditioned Confidence Metric (RCCS) for RAG evaluation
#782
opened Jul 13, 2026 by
AIMindCrafter
Loading…
feat(module): add EvaluationModuleError to public API and wrap _compute exceptions
#779
opened Jul 8, 2026 by
rityagodala
Loading…
Add behavioral_drift: fine-tuning output integrity metric beyond loss curves
#778
opened Jul 8, 2026 by
YuhaoLin2005
Loading…
Fix evaluator task validation for text2text-generation, summarization, and translation
#775
opened Jul 5, 2026 by
zanvari
Loading…
export EvaluationModuleError and wrap _compute failures
#774
opened Jul 4, 2026 by
RavSinghChandan
Loading…
Add label_mapping support to TokenClassificationEvaluator
#772
opened Jul 1, 2026 by
SuryaSunil1326
Loading…
docs(naming): add missing docstrings to filename utility functions
#771
opened Jun 30, 2026 by
RavSinghChandan
Loading…
fix: pass download_config to LocalEvaluationModuleFactory calls
#770
opened Jun 29, 2026 by
aadhar-build
Loading…
Export EvaluationModuleError and wrap _compute failures (fixes #758)
#768
opened Jun 26, 2026 by
Robby955
Loading…
Fix GPT-2 compatibility and long-input handling in perplexity
#767
opened Jun 17, 2026 by
zanvari
Loading…
Previous Next
ProTip!
Exclude everything labeled
bug with -label:bug.