recurrent neural networks (rnn)

Tags: ml

• good for tasks that require sequential input
• processes and input sequence one element at a time, maintaining a hidden “state vector”
• has a vanishing problem since backpropagated gardients grow or shrink at each time step
• very good at predicting the next character in the text or the next word in a sequence
• https://www.youtube.com/watch?v=UNmqTiOnRfg