https://www.cs.toronto.edu/~hinton/csc2535/notes/lec10new.pdf
Distributed hidden state that allows
them to store a lot of information
about the past efficiently.
Non-linear dynamics that allows
them to update their hidden state in
complicated ways.
RNN的哲学是过去指导现在。
![](https://images2017.cnblogs.com/blog/1006507/201711/1006507-20171106010621712-985068950.png)