Jump to content
  • Advertisement
Sign in to follow this  
sidhantdash

NN performance dependence on training method

This topic is 4616 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Different training techniques (like Conjugate Gradient, Simulated Annealing, GAs etc) help in avoiding local minima, but do they have any other effect on the performance of the NN? Like, if I used Time Series Data, and compared the performance of the Nets that had been trained using different methods, will I see any appreciable difference in their predictions? And no, this is not homework. This is something that I plan to carry out as a UG project, and it will be very helpful if I can get some experts to give me an opinion on this, before I take it to my prof. Thanks in advance. Sidhant

Share this post


Link to post
Share on other sites
Advertisement
What do you mean by "performance"? How well the neural nets generalize to novel data? In my experience, getting a neural net to generalize well has been something of a black art...no rules to follow, since different training algorithms will do better with different data sets.

The best way to find out (especially if this is your UG project), is to try all the algorithms and compare the results.

-Alex

Share this post


Link to post
Share on other sites
Well, sure they do, inasmuch as they are better or worse at finding global minima. As to which one is most likely to find a global minimum for a particular problem: "Who knows."

Share this post


Link to post
Share on other sites
By 'performance' I meant the accuracy of the NNs predictions when they are trained using Time Series Data. But thanks, I think I got my answer. Given the methods use different techniques to get to the global minimum, it should make sense that their abilities to fine-tune a particular net will vary. So I think investigating such algorithms should make an interesting project. Thanks a lot! I intend to use Time-Series Data, just to narrow down the application domain.

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

We are the game development community.

Whether you are an indie, hobbyist, AAA developer, or just trying to learn, GameDev.net is the place for you to learn, share, and connect with the games industry. Learn more About Us or sign up!

Sign me up!