# Recurrent neural network with bias node?

This topic is 2371 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

## Recommended Posts

Hi guys,

I'm trying to use a genetic algorithm to train a recurrent neural network. I kind of understand what bias nodes are for in feed forward networks. Do I need one for a recurrent neural network?

Thanks

##### Share on other sites
Hello domokato

Hi guys,

I'm trying to use a genetic algorithm to train a recurrent neural network. I kind of understand what bias nodes are for in feed forward networks. Do I need one for a recurrent neural network?

Thanks

Yes, for the same reason as for feedforward networks. (it permits to shift the activation function along x axis) .

For example, if I have a 2-inputs unit with 1 recurrent loop (on its output), the input vector is for time n : [ input1[sub]n [/sub], input2[sub]n [/sub], output[sub]n-1 [/sub], 1 ]. So 4 weights too.
The output is then computed like in a feedfordward network.

Nico

EDIT :

I take this activation function
bool f(float v)
{
return v>0.0f;
}
and I take a unit with 2 boolean inputs with weights equal to 1.

With a bias of 0, the unit performs a OR (input1+input2>0.0)
With a bias of -1, the unit performs a AND (input1+input2-1>0.0)

My point is that a bias must (should) be added to any unit that performs a linear combination of its inputs.

##### Share on other sites
Oh, I get it. Thanks for the explanation

##### Share on other sites
I'm curious, I haven't encountered using a GA to train a neural net before. I guess it's one way to get a large amount of classified training data. How's it working out for you?

1. 1
Rutin
29
2. 2
3. 3
4. 4
5. 5

• 13
• 13
• 11
• 10
• 14
• ### Forum Statistics

• Total Topics
632961
• Total Posts
3009492
• ### Who's Online (See full list)

There are no registered users currently online

×