avalanche.evaluation.metrics.StreamRMSEForgetting

class avalanche.evaluation.metrics.StreamRMSEForgetting[source]

The StreamRMSEForgetting metric, describing the average evaluation RMSE loss detected over all experiences observed during training.

This plugin metric, computed over all observed experiences during training, is the average over the difference between the RMSE result obtained after first training on a experience and the RMSE result obtained on the same experience at the end of successive experiences.

Since RMSE is to be minimized, forgetting is observed when the result is negative.

This metric is computed during the eval phase only.

__init__()[source]

Creates an instance of the StreamRMSEForgetting metric.

Methods

__init__()

Creates an instance of the StreamRMSEForgetting metric.

after_backward(strategy)

after_eval(strategy)

after_eval_dataset_adaptation(strategy)

after_eval_exp(strategy)

after_eval_forward(strategy)

after_eval_iteration(strategy)

after_forward(strategy)

after_train_dataset_adaptation(strategy)

after_training(strategy)

after_training_epoch(strategy)

after_training_exp(strategy)

after_training_iteration(strategy)

after_update(strategy)

before_backward(strategy)

before_eval(strategy)

before_eval_dataset_adaptation(strategy)

before_eval_exp(strategy)

before_eval_forward(strategy)

before_eval_iteration(strategy)

before_forward(strategy)

before_train_dataset_adaptation(strategy)

before_training(strategy)

before_training_epoch(strategy)

before_training_exp(strategy)

before_training_iteration(strategy)

before_update(strategy)

exp_result(k)

Result for experience defined by a key.

exp_update(k, v[, initial])

Update forgetting metric.

metric_result(strategy)

metric_update(strategy)

reset()

Resets the forgetting metrics.

reset_last()

Resets the last metric value.

result()

The average forgetting over all experience.

result_key(k)

Result for experience defined by a key.

update(k, v[, initial])

Update forgetting metric.

Attributes

stream_forgetting

The average forgetting over all experiences

forgetting

The general metric to compute forgetting

eval_exp_id

The current evaluation experience id

train_exp_id

The last encountered training experience id