Recurrent Neural Networks
- Recurrent Neural Networks are especially useful when past observations can help the current predictions.
- LSTMs with Peepholes allow the current memory (cell) state to influence the gates.
- GRUs tie the gates so every time something is forgotten, it is replaced by something new.
- LSTMs are very straightforward in PyTorch. It's just a loop.