LSTM

Long short-term memory (LSTM)

A way of adding memory to Neural networks using three "gates"

  • forget
  • Input
  • Output

Sometimes referred to as Temporal network with gates

Here is a very good video by Brandon Rohrer

Gates:

  • Forget gate vector. Weight of remembering old information.
  • : Input gate vector. Weight of acquiring new information.
  • : Output gate