Jump to content
  • Advertisement
Sign in to follow this  
domokato

Recurrent neural network with bias node?

This topic is 2280 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Hi guys,

I'm trying to use a genetic algorithm to train a recurrent neural network. I kind of understand what bias nodes are for in feed forward networks. Do I need one for a recurrent neural network?

Thanks

Share this post


Link to post
Share on other sites
Advertisement
Hello domokato smile.png


Hi guys,

I'm trying to use a genetic algorithm to train a recurrent neural network. I kind of understand what bias nodes are for in feed forward networks. Do I need one for a recurrent neural network?

Thanks


Yes, for the same reason as for feedforward networks. (it permits to shift the activation function along x axis) .

For example, if I have a 2-inputs unit with 1 recurrent loop (on its output), the input vector is for time n : [ input1[sub]n [/sub], input2[sub]n [/sub], output[sub]n-1 [/sub], 1 ]. So 4 weights too.
The output is then computed like in a feedfordward network.

Nico

EDIT :

About bias :

I take this activation function
bool f(float v)
{
return v>0.0f;
}
and I take a unit with 2 boolean inputs with weights equal to 1.

With a bias of 0, the unit performs a OR (input1+input2>0.0)
With a bias of -1, the unit performs a AND (input1+input2-1>0.0)

My point is that a bias must (should) be added to any unit that performs a linear combination of its inputs.

Share this post


Link to post
Share on other sites
I'm curious, I haven't encountered using a GA to train a neural net before. I guess it's one way to get a large amount of classified training data. How's it working out for you?

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

We are the game development community.

Whether you are an indie, hobbyist, AAA developer, or just trying to learn, GameDev.net is the place for you to learn, share, and connect with the games industry. Learn more About Us or sign up!

Sign me up!