avalanche.evaluation.metric_definitions.GenericPluginMetric

class avalanche.evaluation.metric_definitions.GenericPluginMetric(metric, reset_at='experience', emit_at='experience', mode='eval')[source]

This class provides a generic implementation of a Plugin Metric. The user can subclass this class to easily implement custom plugin metrics.

__init__(metric, reset_at='experience', emit_at='experience', mode='eval')[source]

Creates an instance of a plugin metric.

Child classes can safely invoke this (super) constructor as the first experience.

Methods

__init__(metric[, reset_at, emit_at, mode])

Creates an instance of a plugin metric.

after_backward(strategy)

Called after criterion.backward() by the BaseStrategy.

after_eval(strategy)

Called after eval by the BaseStrategy.

after_eval_dataset_adaptation(strategy)

Called after eval_dataset_adaptation by the BaseStrategy.

after_eval_exp(strategy)

Called after eval_exp by the BaseStrategy.

after_eval_forward(strategy)

Called after model.forward() by the BaseStrategy.

after_eval_iteration(strategy)

Called after the end of an iteration by the BaseStrategy.

after_forward(strategy)

Called after model.forward() by the BaseStrategy.

after_train_dataset_adaptation(strategy)

Called after train_dataset_adapatation by the BaseStrategy.

after_training(strategy)

Called after train by the BaseStrategy.

after_training_epoch(strategy)

Called after train_epoch by the BaseStrategy.

after_training_exp(strategy)

Called after train_exp by the BaseStrategy.

after_training_iteration(strategy)

Called after the end of a training iteration by the BaseStrategy.

after_update(strategy)

Called after optimizer.update() by the BaseStrategy.

before_backward(strategy)

Called before criterion.backward() by the BaseStrategy.

before_eval(strategy)

Called before eval by the BaseStrategy.

before_eval_dataset_adaptation(strategy)

Called before eval_dataset_adaptation by the BaseStrategy.

before_eval_exp(strategy)

Called before eval_exp by the BaseStrategy.

before_eval_forward(strategy)

Called before model.forward() by the BaseStrategy.

before_eval_iteration(strategy)

Called before the start of a training iteration by the BaseStrategy.

before_forward(strategy)

Called before model.forward() by the BaseStrategy.

before_train_dataset_adaptation(strategy)

Called before train_dataset_adapatation by the BaseStrategy.

before_training(strategy)

Called before train by the BaseStrategy.

before_training_epoch(strategy)

Called before train_epoch by the BaseStrategy.

before_training_exp(strategy)

Called before train_exp by the BaseStrategy.

before_training_iteration(strategy)

Called before the start of a training iteration by the BaseStrategy.

before_update(strategy)

Called before optimizer.update() by the BaseStrategy.

reset(strategy)

Resets the metric internal state.

result(strategy)

Obtains the value of the metric.

update(strategy)