Training module
Training Strategies
Ready-to-use continual learning strategies.
|
Base class for continual learning strategies. |
|
Cumulative training strategy. |
|
Joint training on the entire stream. |
|
Naive finetuning. |
|
AR1 with Latent Replay. |
|
Deep Streaming Linear Discriminant Analysis. |
|
iCaRL Strategy. |
|
Progressive Neural Network strategy. |
|
CWR* Strategy. |
|
Experience replay strategy. |
|
Experience replay strategy. |
|
GDumb strategy. |
|
Learning without Forgetting (LwF) strategy. |
|
Average Gradient Episodic Memory (A-GEM) strategy. |
|
Gradient Episodic Memory (GEM) strategy. |
|
Elastic Weight Consolidation (EWC) strategy. |
|
Synaptic Intelligence strategy. |
|
Continual Prototype Evolution strategy. |
|
Less Forgetful Learning strategy. |
Replay Buffers
Buffers to store past samples according to different policies and selection strategies.
|
ABC for rehearsal buffers to store exemplars. |
|
Buffer updated with reservoir sampling. |
|
A buffer that stores exemplars for rehearsal in separate groups. |
|
Rehearsal buffer with samples balanced over experiences. |
|
Stores samples for replay, equally divided over classes. |
|
Stores samples for replay using a custom selection strategy and grouping. |
Selection strategies
Base class to define how to select a subset of exemplars from a dataset. |
|
Select the exemplars at random in the dataset |
|
Base class to select exemplars from their features |
|
|
The herding strategy as described in iCaRL. |
|
A greedy algorithm that selects the remaining exemplar that is the closest to the center of all elements (in feature space). |
Loss Functions
Similar to the Knowledge Distillation Loss. |
Training Plugins
Plugins can be added to any CL strategy to support additional behavior.
Utilities
Base class for strategy plugins. |
|
|
Early stopping plugin. |
|
Manager for logging and metrics. |
|
Learning Rate Scheduler Plugin. |
Strategies
|
Average Gradient Episodic Memory Plugin. |
|
Continual Prototype Evolution plugin. |
|
CWR* Strategy. |
|
Elastic Weight Consolidation (EWC) plugin. |
|
GDumb plugin. |
|
Gradient Episodic Memory Plugin. |
|
GSSPlugin replay plugin. |
|
Less-Forgetful Learning (LFL) Plugin. |
|
A Learning without Forgetting plugin. |
|
Experience replay plugin. |
|
The Synaptic Intelligence plugin. |