Sign in to follow this  

Backpropagation question

This topic is 4275 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

If I want to construct the neural network using feed-forward and back-propogation , what factor should I use for determining the number of hidden neurons(hidden layer) of the network for a given problems.I know the input neuron should equal the number of input of your problem and the output neuron should equal the number of output of your problem.

Share this post


Link to post
Share on other sites
it depends on what you want to do. basically there is no rule. one hidden layer is often sufficient a lot of purporses. don't forget that the more hidden layers you have the more complicate your net becomes...

Share this post


Link to post
Share on other sites
The book 'AI for game programmers' tells us this:

"For three-layer networks in which you're not interested in autoassociation, the appropriate number of hidden neurons is approximately equal to the square root of the product of the number of input and output neurons. This is just an approximation, but it's as good a place to start as any"

I can't speak from personal experience since I'm just learning this stuff myself.

Share this post


Link to post
Share on other sites
Another way of dealing with this problem is so called cascade correlation, which build the network structure in the learning process, personally I have no experience with it. See also the articles Optimal Brain Damage and Efficient BackProp by Prof. Yann Le Cun, and there's more interesting stuff on his website http://yann.lecun.com/exdb/publis/index.html

Share this post


Link to post
Share on other sites

This topic is 4275 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this