0

Recently, I ran a code on my system that involves deep neural networks. The number of epochs provided by the designers are 301.

I tried to increase the number of epochs to 501. To my shock, the model after 350 epochs is behaving eccentric. And I can say that they are just returning crazy values.

What makes such phenomena possible? Is "number of epochs" also a hyperaparameter/ magic number as an upper bound beyond which the model fails?

Mithical
  • 2,965
  • 5
  • 28
  • 39
hanugm
  • 4,102
  • 3
  • 29
  • 63

1 Answers1

1

There is nothing specific about this particular numbers. Everything depends on the NN, software, model and data. As illustrated as the number of epoch increases, more number of times the weights are changed and the curve goes from underfitting to overfitting. And overfitting is exactly eccentric and crazy, see the picture at left:.

enter image description here

Damir Tenishev
  • 188
  • 8