0

For a regression task, I have sequences of training data and if I define the layers of deep neural network to be:

Layers=[ sequenceInputLayer(featuredimension) reluLayer dropoutLayer(0.05) fullyConnectedLayer(numResponse) regressionLayer]

Is it a valid deep neural network? Or do I need to add LSTM layer too?

DukeZhou
  • 6,209
  • 5
  • 27
  • 54
NM08
  • 9
  • 2

1 Answers1

1

Yes, it is a very common practice to use some RNN when your input data is a sequence. Besides, your network has some shape issue if your input data is 2D. You should, at least flatten your input data to a vector to be able to forward propagate to the dense layer, but instead of this use some kind of RNN. To the best of my knowledge, that dropout value doesn't good. It seems too low.

Molnár István
  • 712
  • 1
  • 7
  • 11