Exploring the Stability Gap in Continual Learning: The Role of the Classification Head
We conduct an investigation into the stability gap in continual learning and identify the critical role of the classification head in continual learning. We then suggest nearest mean classifer as a potential solution for improved model stability.
Jan 1, 2025