Modified-LwF method for continual learning

Abstract

In this dissertation, we show that it is possible to overcome the catastrophic forgetting with several different methods. What is more important is that our method remembers old tasks better by combining the original learning without forgetting and elastic weight consolidation, which is the main contribution that both the merits of elastic weight consolidation and learning without forgetting are put into one method (Modified LwF). Besides, the upper bound joint training method, fine tune, EWC and original LwF methods are experimented by adding the new tasks one by one. In this procedure, the paths of the training in the algorithm will be focused more on. We finally finished all four tasks, and the size of the fourth task is far bigger than the previous three.