Fig. 5.
Recurrent Neural Networks employ feedback such that the output of the system is dependent on both the current input state and also the preceding inputs, enabling the network to respond to trends that evolve over time. In the Elman network arrangement shown here, the context layer feeds from and to the hidden layer.