ML//RNN//LSTM
- Long Short-Term Memory: gates control what the cell remembers and forgets.
Long Short-Term Memory: gates control what the cell remembers and forgets.
Forget gate, input gate, output gate: learned filters on the information flow.
Solved vanishing gradient for sequences, dominated NLP pre-transformer (1997-2017)