mlrl.testbed_sklearn.experiments.output.evaluation.writer module

Author: Michael Rapp (michael.rapp.ml@gmail.com)

Provides classes that allow writing evaluation results to one or several sinks.

class mlrl.testbed_sklearn.experiments.output.evaluation.writer.EvaluationDataExtractor

Bases: DataExtractor, ABC

An abstract base class for all classes that allow obtaining evaluation results according to different evaluation measures.

extract_data(state: ExperimentState, sinks: list[Sink]) → list[tuple[ExperimentState, OutputData]]

See mlrl.testbed.experiments.output.writer.DataExtractor.extract_data()

measurements: dict[DatasetType, Measurements] = {}

class mlrl.testbed_sklearn.experiments.output.evaluation.writer.EvaluationWriter(*extractors: EvaluationDataExtractor)

Bases: ResultWriter

Allows writing evaluation results to one or several sinks.

class InputExtractor(properties: TabularProperties, context: Context)

Bases: TabularDataExtractor

Uses TabularInputData that has previously been loaded via an input reader.

ALL_MEASURES = {<mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.data.OutputValue object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.evaluation.measures.Measure object>, <mlrl.testbed.experiments.output.data.OutputValue object>}

extract_data(state: ExperimentState, sinks: list[Sink]) → list[tuple[ExperimentState, OutputData]]

See mlrl.testbed.experiments.output.writer.DataExtractor.extract_data()

measurements: dict[DatasetType, dict[int, Measurements]] = {}