Augmented RNN

cosmos 15th March 2017 at 5:12pm
Recurrent neural network

Nice review

Neural Turing Machines have external memory that they can read and write to.
Attentional Interfaces allow RNNs to focus on parts of their input.

Adaptive Computation Time allows for varying amounts of computation per step.
Neural Programmers can call functions, building programs as they run.

RNNs with memory

See Neural networks with memory

Neural Turing machine

Differentiable neural computer

RNNs with attention

See Attention in machine learning

Adaptive computation time

Neural programmers

Neural programmer-interpreter

http://www.thespermwhale.com/jaseweston/