There are several possibilities of building a dynamic neural network that may be classified in two main classes: time-lagged feedforward networks, TLFN, or recurrent neural networks, RNN (cf.
The net topology is shown in Figure 1 and can be considered a special case of the TLFN where the dynamic is moved from the input to the output layer and, in this way, the advantage of the TLFN over the RNN is maintained.