Questions tagged [recurrent-layers]

For questions related to recurrent layers, such as layers composed of LSTM units.

3 questions
9
votes
1 answer

What is the difference between LSTM and RNN?

What is the difference between LSTM and RNN? I know that RNN is a layer used in neural networks, but what exactly is an LSTM? Is it also a layer with the same characteristics?
2
votes
1 answer

Distinguishing between the fundamental structures of the convolutional neural network and the recurrent neural network: hierarchical vs sequential

I'm trying to distinguish between the fundamental structures of the convolutional neural network and the recurrent neural network. Convolutional neural networks build a hierarchical model from the data using the convolutional layers. Recurrent…
0
votes
0 answers

What does recurrecence in depth and recurrence in time mean?

I've seen recurrence in depth mentioned in several papers by opposition to recurrence in time (e.g. https://arxiv.org/pdf/2106.04279v1). I am assuming that recurrence in depth means hidden layer to hidden layer - n connections (i.e. a topological…