Hide navigation sidebar

Hide table of contents sidebar

Skip to content

Toggle site navigation sidebar

Toggle table of contents sidebar

Quickstart

Installation
Using the Python API
Using the Command Line API

User Guide

The BOOMER Algorithm
Toggle navigation of The BOOMER Algorithm
- Overview of Parameters
The SeCo Algorithm
Toggle navigation of The SeCo Algorithm
- Overview of Parameters
MLRL-Testbed
Toggle navigation of MLRL-Testbed
References

Developer Guide

Project Structure
Building from Source
Generating the Documentation
Continuous Integration
Coding Standards
Python API Reference
Toggle navigation of Python API Reference
- Package mlrl-common
  Toggle navigation of Package mlrl-common
  - mlrl.common.config package
    Toggle navigation of mlrl.common.config package
    - mlrl.common.config.parameters module
  - mlrl.common.cython package
    Toggle navigation of mlrl.common.cython package
  - mlrl.common.testbed package
    Toggle navigation of mlrl.common.testbed package
    - mlrl.common.testbed.experiments package
      Toggle navigation of mlrl.common.testbed.experiments package
      - mlrl.common.testbed.experiments.output package
        Toggle navigation of mlrl.common.testbed.experiments.output package
        
        mlrl.common.testbed.experiments.output.characteristics package
        Toggle navigation of mlrl.common.testbed.experiments.output.characteristics package
        
        mlrl.common.testbed.experiments.output.characteristics.model package
        Toggle navigation of mlrl.common.testbed.experiments.output.characteristics.model package
        
        mlrl.common.testbed.experiments.output.characteristics.model.characteristics module
        
        mlrl.common.testbed.experiments.output.characteristics.model.extension module
        
        mlrl.common.testbed.experiments.output.characteristics.model.statistics module
        
        mlrl.common.testbed.experiments.output.characteristics.model.writer module
        
        mlrl.common.testbed.experiments.output.label_vectors package
        Toggle navigation of mlrl.common.testbed.experiments.output.label_vectors package
        
        mlrl.common.testbed.experiments.output.label_vectors.extension module
        
        mlrl.common.testbed.experiments.output.model_text package
        Toggle navigation of mlrl.common.testbed.experiments.output.model_text package
        
        mlrl.common.testbed.experiments.output.model_text.extension module
        
        mlrl.common.testbed.experiments.output.model_text.model_text module
        
        mlrl.common.testbed.experiments.output.model_text.writer module
      - mlrl.common.testbed.experiments.prediction package
        Toggle navigation of mlrl.common.testbed.experiments.prediction package
        
        mlrl.common.testbed.experiments.prediction.predictor_incremental module
      - mlrl.common.testbed.experiments.experiment module
    - mlrl.common.testbed.program_info module
    - mlrl.common.testbed.runnables module
  - mlrl.common.learners module
  - mlrl.common.mixins module
  - mlrl.common.package_info module
- Package mlrl-testbed-arff
  Toggle navigation of Package mlrl-testbed-arff
  - mlrl.testbed_arff.experiments package
    Toggle navigation of mlrl.testbed_arff.experiments package
    - mlrl.testbed_arff.experiments.input package
      Toggle navigation of mlrl.testbed_arff.experiments.input package
      - mlrl.testbed_arff.experiments.input.sources package
        Toggle navigation of mlrl.testbed_arff.experiments.input.sources package
        
        mlrl.testbed_arff.experiments.input.sources.source_arff module
    - mlrl.testbed_arff.experiments.output package
      Toggle navigation of mlrl.testbed_arff.experiments.output package
      - mlrl.testbed_arff.experiments.output.sinks package
        Toggle navigation of mlrl.testbed_arff.experiments.output.sinks package
        
        mlrl.testbed_arff.experiments.output.sinks.sink_arff module
- Package mlrl-boosting
  Toggle navigation of Package mlrl-boosting
  - mlrl.boosting.config package
    Toggle navigation of mlrl.boosting.config package
    - mlrl.boosting.config.parameters module
  - mlrl.boosting.cython package
    Toggle navigation of mlrl.boosting.cython package
  - mlrl.boosting.testbed package
    Toggle navigation of mlrl.boosting.testbed package
    - mlrl.boosting.testbed.experiments package
      Toggle navigation of mlrl.boosting.testbed.experiments package
      - mlrl.boosting.testbed.experiments.output package
        Toggle navigation of mlrl.boosting.testbed.experiments.output package
        
        mlrl.boosting.testbed.experiments.output.probability_calibration package
        Toggle navigation of mlrl.boosting.testbed.experiments.output.probability_calibration package
        
        mlrl.boosting.testbed.experiments.output.probability_calibration.extension module
        
        mlrl.boosting.testbed.experiments.output.probability_calibration.model_isotonic module
        
        mlrl.boosting.testbed.experiments.output.probability_calibration.model_no module
        
        mlrl.boosting.testbed.experiments.output.probability_calibration.writer module
    - mlrl.boosting.testbed.runnables module
  - mlrl.boosting.learners module
  - mlrl.boosting.package_info module
- Package mlrl-testbed-sklearn
  Toggle navigation of Package mlrl-testbed-sklearn
  - mlrl.testbed_sklearn.experiments package
    Toggle navigation of mlrl.testbed_sklearn.experiments package
    - mlrl.testbed_sklearn.experiments.input package
      Toggle navigation of mlrl.testbed_sklearn.experiments.input package
      - mlrl.testbed_sklearn.experiments.input.dataset package
        Toggle navigation of mlrl.testbed_sklearn.experiments.input.dataset package
        
        mlrl.testbed_sklearn.experiments.input.dataset.preprocessors package
        Toggle navigation of mlrl.testbed_sklearn.experiments.input.dataset.preprocessors package
        
        mlrl.testbed_sklearn.experiments.input.dataset.preprocessors.extension module
        
        mlrl.testbed_sklearn.experiments.input.dataset.preprocessors.one_hot_encoder module
        
        mlrl.testbed_sklearn.experiments.input.dataset.splitters package
        Toggle navigation of mlrl.testbed_sklearn.experiments.input.dataset.splitters package
        
        mlrl.testbed_sklearn.experiments.input.dataset.splitters.extension module
        
        mlrl.testbed_sklearn.experiments.input.dataset.splitters.splitter_bipartition module
        
        mlrl.testbed_sklearn.experiments.input.dataset.splitters.splitter_cross_validation module
        
        mlrl.testbed_sklearn.experiments.input.dataset.extension module
    - mlrl.testbed_sklearn.experiments.output package
      Toggle navigation of mlrl.testbed_sklearn.experiments.output package
      - mlrl.testbed_sklearn.experiments.output.characteristics package
        Toggle navigation of mlrl.testbed_sklearn.experiments.output.characteristics package
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data package
        Toggle navigation of mlrl.testbed_sklearn.experiments.output.characteristics.data package
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.characteristics module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.characteristics_data module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.characteristics_prediction module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.extension module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.extension_prediction module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.matrix_feature module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.matrix_label module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.matrix_output module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.writer_data module
        
        mlrl.testbed_sklearn.experiments.output.characteristics.data.writer_prediction module
      - mlrl.testbed_sklearn.experiments.output.dataset package
        Toggle navigation of mlrl.testbed_sklearn.experiments.output.dataset package
        
        mlrl.testbed_sklearn.experiments.output.dataset.dataset module
        
        mlrl.testbed_sklearn.experiments.output.dataset.dataset_ground_truth module
        
        mlrl.testbed_sklearn.experiments.output.dataset.dataset_prediction module
        
        mlrl.testbed_sklearn.experiments.output.dataset.extension_ground_truth module
        
        mlrl.testbed_sklearn.experiments.output.dataset.extension_prediction module
        
        mlrl.testbed_sklearn.experiments.output.dataset.writer_ground_truth module
        
        mlrl.testbed_sklearn.experiments.output.dataset.writer_prediction module
      - mlrl.testbed_sklearn.experiments.output.evaluation package
        Toggle navigation of mlrl.testbed_sklearn.experiments.output.evaluation package
        
        mlrl.testbed_sklearn.experiments.output.evaluation.evaluation_result module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.extension module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.extractor_classification module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.extractor_ranking module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.extractor_regression module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.measures_classification module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.measures_ranking module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.measures_regression module
        
        mlrl.testbed_sklearn.experiments.output.evaluation.writer module
      - mlrl.testbed_sklearn.experiments.output.label_vectors package
        Toggle navigation of mlrl.testbed_sklearn.experiments.output.label_vectors package
        
        mlrl.testbed_sklearn.experiments.output.label_vectors.extension module
        
        mlrl.testbed_sklearn.experiments.output.label_vectors.label_vector_histogram module
        
        mlrl.testbed_sklearn.experiments.output.label_vectors.label_vectors module
        
        mlrl.testbed_sklearn.experiments.output.label_vectors.writer module
    - mlrl.testbed_sklearn.experiments.prediction package
      Toggle navigation of mlrl.testbed_sklearn.experiments.prediction package
    - mlrl.testbed_sklearn.experiments.dataset module
    - mlrl.testbed_sklearn.experiments.experiment module
    - mlrl.testbed_sklearn.experiments.problem_domain module
  - mlrl.testbed_sklearn.runnables module
- Package mlrl-testbed
  Toggle navigation of Package mlrl-testbed
  - mlrl.testbed.experiments package
    Toggle navigation of mlrl.testbed.experiments package
    - mlrl.testbed.experiments.input package
      Toggle navigation of mlrl.testbed.experiments.input package
      - mlrl.testbed.experiments.input.dataset package
        Toggle navigation of mlrl.testbed.experiments.input.dataset package
        
        mlrl.testbed.experiments.input.dataset.preprocessors package
        Toggle navigation of mlrl.testbed.experiments.input.dataset.preprocessors package
        
        mlrl.testbed.experiments.input.dataset.preprocessors.preprocessor module
        
        mlrl.testbed.experiments.input.dataset.splitters package
        Toggle navigation of mlrl.testbed.experiments.input.dataset.splitters package
        
        mlrl.testbed.experiments.input.dataset.splitters.splitter module
        
        mlrl.testbed.experiments.input.dataset.splitters.splitter_no module
        
        mlrl.testbed.experiments.input.dataset.dataset module
        
        mlrl.testbed.experiments.input.dataset.extension module
        
        mlrl.testbed.experiments.input.dataset.reader module
      - mlrl.testbed.experiments.input.model package
        Toggle navigation of mlrl.testbed.experiments.input.model package
        
        mlrl.testbed.experiments.input.model.extension module
        
        mlrl.testbed.experiments.input.model.model module
        
        mlrl.testbed.experiments.input.model.reader module
      - mlrl.testbed.experiments.input.parameters package
        Toggle navigation of mlrl.testbed.experiments.input.parameters package
        
        mlrl.testbed.experiments.input.parameters.extension module
        
        mlrl.testbed.experiments.input.parameters.parameters module
        
        mlrl.testbed.experiments.input.parameters.reader module
      - mlrl.testbed.experiments.input.sources package
        Toggle navigation of mlrl.testbed.experiments.input.sources package
        
        mlrl.testbed.experiments.input.sources.source module
        
        mlrl.testbed.experiments.input.sources.source_csv module
        
        mlrl.testbed.experiments.input.sources.source_pickle module
      - mlrl.testbed.experiments.input.data module
      - mlrl.testbed.experiments.input.reader module
    - mlrl.testbed.experiments.output package
      Toggle navigation of mlrl.testbed.experiments.output package
      - mlrl.testbed.experiments.output.dataset package
        Toggle navigation of mlrl.testbed.experiments.output.dataset package
        
        mlrl.testbed.experiments.output.dataset.dataset module
      - mlrl.testbed.experiments.output.evaluation package
        Toggle navigation of mlrl.testbed.experiments.output.evaluation package
        
        mlrl.testbed.experiments.output.evaluation.measurements module
        
        mlrl.testbed.experiments.output.evaluation.measures module
      - mlrl.testbed.experiments.output.model package
        Toggle navigation of mlrl.testbed.experiments.output.model package
        
        mlrl.testbed.experiments.output.model.extension module
        
        mlrl.testbed.experiments.output.model.model module
        
        mlrl.testbed.experiments.output.model.writer module
      - mlrl.testbed.experiments.output.parameters package
        Toggle navigation of mlrl.testbed.experiments.output.parameters package
        
        mlrl.testbed.experiments.output.parameters.extension module
        
        mlrl.testbed.experiments.output.parameters.parameters module
        
        mlrl.testbed.experiments.output.parameters.writer module
      - mlrl.testbed.experiments.output.sinks package
        Toggle navigation of mlrl.testbed.experiments.output.sinks package
        
        mlrl.testbed.experiments.output.sinks.sink module
        
        mlrl.testbed.experiments.output.sinks.sink_csv module
        
        mlrl.testbed.experiments.output.sinks.sink_log module
        
        mlrl.testbed.experiments.output.sinks.sink_pickle module
        
        mlrl.testbed.experiments.output.sinks.sink_text module
      - mlrl.testbed.experiments.output.data module
      - mlrl.testbed.experiments.output.extension module
      - mlrl.testbed.experiments.output.writer module
    - mlrl.testbed.experiments.context module
    - mlrl.testbed.experiments.dataset module
    - mlrl.testbed.experiments.dataset_type module
    - mlrl.testbed.experiments.experiment module
    - mlrl.testbed.experiments.file_path module
    - mlrl.testbed.experiments.fold module
    - mlrl.testbed.experiments.prediction_scope module
    - mlrl.testbed.experiments.prediction_type module
    - mlrl.testbed.experiments.problem_domain module
    - mlrl.testbed.experiments.state module
    - mlrl.testbed.experiments.table module
    - mlrl.testbed.experiments.timer module
  - mlrl.testbed.extensions package
    Toggle navigation of mlrl.testbed.extensions package
    - mlrl.testbed.extensions.extension module
    - mlrl.testbed.extensions.extension_log module
  - mlrl.testbed.util package
    Toggle navigation of mlrl.testbed.util package
  - mlrl.testbed.main module
  - mlrl.testbed.program_info module
  - mlrl.testbed.runnables module
- Package mlrl-util
  Toggle navigation of Package mlrl-util
- Package mlrl-seco
  Toggle navigation of Package mlrl-seco
  - mlrl.seco.config package
    Toggle navigation of mlrl.seco.config package
    - mlrl.seco.config.parameters module
  - mlrl.seco.cython package
    Toggle navigation of mlrl.seco.cython package
  - mlrl.seco.testbed package
    Toggle navigation of mlrl.seco.testbed package
    - mlrl.seco.testbed.runnables module
  - mlrl.seco.learners module
  - mlrl.seco.package_info module
C++ API Reference
Toggle navigation of C++ API Reference

Further Information

Release Notes
Contributors
Code of Conduct
MIT License
Source Code
Issue Tracker

Toggle table of contents sidebar

mlrl.testbed_sklearn.experiments.output.evaluation.measures_ranking module¶

Author Michael Rapp (michael.rapp.ml@gmail.com)

Provides classes that implement ranking evaluation measures.

mlrl.testbed_sklearn.experiments.output.evaluation.measures_regression module

mlrl.testbed_sklearn.experiments.output.evaluation.measures_classification module

Copyright © 2020-2025, Michael Rapp et al.

Made with Sphinx and @pradyunsg's Furo