Jump to content
  • Advertisement
Sign in to follow this  
jolyqr

Hidden Layer number

This topic is 4485 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

I would like to create an ANN to solve some AI problems. How many hidden layers do I have to put? I have read that one hidden layer is sufficient to solve any problem... cheers

Share this post


Link to post
Share on other sites
Advertisement
Quote:
Original post by sidhantdash
theoretically yes, but only if you train it properly, avoiding local minima during the training process.


could you be a lot more precise, because i did not get what you said

Share this post


Link to post
Share on other sites
What I meant was that one hidden layer is enough to solve any problem, but only theoretically. Most often, during the training process (using back-propagation, or some similiar gradient descent algorithm) the network gets stuck in a local minima. So you then end up with sub-optimal weights, thereby failing to solve your problem. So you need to train your net properly, to ensure that it doesnt get stuck in a local minima. It doesnt mean you have to increase the number of hidden layers, it just means you need to look at the training process again. You also will need to pre-process your data, for best results.

One might use methods like genetic algorithms, simulated annealing etc to break out of local minima.

Hope that helps.

Share this post


Link to post
Share on other sites
Quote:
Original post by sidhantdash
What I meant was that one hidden layer is enough to solve any problem, but only theoretically. Most often, during the training process (using back-propagation, or some similiar gradient descent algorithm) the network gets stuck in a local minima. So you then end up with sub-optimal weights, thereby failing to solve your problem. So you need to train your net properly, to ensure that it doesnt get stuck in a local minima. It doesnt mean you have to increase the number of hidden layers, it just means you need to look at the training process again. You also will need to pre-process your data, for best results.

One might use methods like genetic algorithms, simulated annealing etc to break out of local minima.

Hope that helps.


ok, i get it

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

We are the game development community.

Whether you are an indie, hobbyist, AAA developer, or just trying to learn, GameDev.net is the place for you to learn, share, and connect with the games industry. Learn more About Us or sign up!

Sign me up!