Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

[ENH] V1 → V2 API Migration - evaluation measures#1603

Merged
PGijsbers merged 249 commits intoopenml:mainopenml/openml-python:mainfrom
EmanAbdelhaleem:evaluation-measures-migEmanAbdelhaleem/openml-python:evaluation-measures-migCopy head branch name to clipboard
Mar 25, 2026
Merged

[ENH] V1 → V2 API Migration - evaluation measures#1603
PGijsbers merged 249 commits intoopenml:mainopenml/openml-python:mainfrom
EmanAbdelhaleem:evaluation-measures-migEmanAbdelhaleem/openml-python:evaluation-measures-migCopy head branch name to clipboard

Conversation

@EmanAbdelhaleem
Copy link
Contributor

@EmanAbdelhaleem EmanAbdelhaleem commented Jan 7, 2026

Fixes #1593
Depends on #1576
Related to #1575

Details

This PR implements EvaluationMeasures resource, and refactor its existing functions

@codecov-commenter
Copy link

codecov-commenter commented Jan 7, 2026

Codecov Report

❌ Patch coverage is 15.78947% with 16 lines in your changes missing coverage. Please review.
✅ Project coverage is 53.75%. Comparing base (8ff14eb) to head (7a7144a).

Files with missing lines Patch % Lines
openml/_api/resources/evaluation_measure.py 16.66% 15 Missing ⚠️
openml/evaluations/functions.py 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1603      +/-   ##
==========================================
- Coverage   53.96%   53.75%   -0.22%     
==========================================
  Files          61       61              
  Lines        5051     5062      +11     
==========================================
- Hits         2726     2721       -5     
- Misses       2325     2341      +16     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@geetu040 geetu040 mentioned this pull request Jan 7, 2026
18 tasks
Copy link
Collaborator

@geetu040 geetu040 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great. The implementation is clean and nicely decoupled. The next step should be adding tests, but let's wait until we have a clearer roadmap for that.
Also, please update the PR description to follow this format:

Fixes #1593
Depends on #1576
Related to #1575

Copy link
Collaborator

@geetu040 geetu040 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update with #1576 (comment)

@geetu040 geetu040 self-assigned this Mar 23, 2026
Copy link
Collaborator

@geetu040 geetu040 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@EmanAbdelhaleem Thanks for the PR. Nicely done!
I have updated the PR to sync with latest changes in base PR.

@PGijsbers please review/merge.

Copy link
Collaborator

@PGijsbers PGijsbers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good to me, minor changes for the tests. Also holding off for a second due to the CI failures that Armaghan is investigating.

tests/test_api/test_evaluation_measure.py Outdated Show resolved Hide resolved
tests/test_api/test_evaluation_measure.py Outdated Show resolved Hide resolved
tests/test_api/test_evaluation_measure.py Outdated Show resolved Hide resolved
@geetu040 geetu040 requested a review from PGijsbers March 24, 2026 10:45
@geetu040
Copy link
Collaborator

@PGijsbers I've updated the PR with your suggested changes and the only failing test is sporadic. This should be ready for review/merge.

@PGijsbers PGijsbers merged commit fe58eb0 into openml:main Mar 25, 2026
26 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ENH] V1 → V2 API Migration - evaluation measures

7 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.