mlrl.testbed.experiments.output.evaluation.writer module

Author: Michael Rapp (michael.rapp.ml@gmail.com)

Provides classes that allow writing evaluation results that have been aggregated across several experiments to one or several sinks.

class mlrl.testbed.experiments.output.evaluation.writer.AggregatedEvaluationWriter(*extractors: DataExtractor)

Bases: ResultWriter

Allows writing evaluation results that have been aggregated across several experiments to one or several sinks.

class InputExtractor(properties: Properties, context: Context)

Bases: DataExtractor

Uses an AggregatedEvaluationResult that has previously been loaded via an input reader.

extract_data(state: ExperimentState, _: list[Sink]) → list[tuple[ExperimentState, OutputData]]

See mlrl.testbed.experiments.output.writer.DataExtractor.extract_data()