RNN

Ever Green References:

• http://karpathy.github.io/2015/05/21/rnn-effectiveness/
• http://colah.github.io/posts/2015-08-Understanding-LSTMs/
• http://blog.echen.me/2017/05/30/exploring-lstms/

Recurrent Neural Networks

• RNNs tie the weights at each time step
• Condition the neura network on allprevious words
• RAM requirementonly scales with number of words