Paper Summary: Learning to Forget: Continual Prediction with LSTM

Please note This post is mainly intended for my personal use . It is not peer-reviewed work and should not be taken as such. Learning to Forget: Continual Prediction with LSTM Source WHAT This paper introduces the "forget gate" to LSTM cells, that learn when they should "reset" the cell state. This was not present in the original 1997 paper by Hochreiter and Schmidhuber . WHY If LSTMs are applied…