Jump to content
  • Advertisement
Sign in to follow this  
aparaske

SoftMax activation function

This topic is 4644 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

What's the purpose of the softmax function? What sort of examples would it be good to use? Where exactly is it supposed to go?(I read somewhere that is only supposed to be applied to the output layer). Can we do without it? Alex

Share this post


Link to post
Share on other sites
Advertisement
I reinvented the softmax function for the problem of estimating the distribution of probabilities of chess moves in a given position. I assign a score to each move using a traditional alpha-beta search and then convert them to probabilities using softmax. You can train a few weights in the evaluation function to make the distribution of probabilities as close to a training database as possible.

I do this to decide what branches to explore deeper in an experimental chess program, but then I found out that other people have used the same technique to try to quantify playing styles: See this article.

Anyway, I didn't know until I did a Google search today that this thing was called softmax, but it makes sense. If you multiply all your scores by a large number, you get a probability distribution that just picks the maximum.

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

GameDev.net is your game development community. Create an account for your GameDev Portfolio and participate in the largest developer community in the games industry.

Sign me up!