LSTM
Long short-term memory (LSTM)
A way of adding memory to Neural networks using three "gates"
- forget
- Input
- Output
Sometimes referred to as Temporal network with gates
Here is a very good video by Brandon Rohrer
Gates:
- Forget gate vector. Weight of remembering old information.
- : Input gate vector. Weight of acquiring new information.
- : Output gate