Sign in to follow this  

Teaching my AI component

This topic is 4194 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

I want to create a component that will eventually be able to control an object in a game. To teach it how to control the object, I control that object my self, with the AI Component in the learning state. I am new to this AI stuff and this is my first attempt at the subject. What kind of AI do I need for this job. You can assume that the controlled object may range from an ant to a target-seeking missile.

Share this post


Link to post
Share on other sites
Welcome to assisted machine learning.

If I understand your problem, you want a machine that will learn, given an object state S, what action A to pose. That falls into the regression problem.

There are a lot of techniques you can employ for that. They all (to my knowledge) imply defining a model (be it a simple polynomial), then finding the parameters of that model (that is the actual regression)

I'll give you three ways to do regression.

The Simple Way: Use a simple, direct non-linear regression technique such as Levenberg-Marquart. You can find all theory and good implementations on the web.

The Way I would advise: Check out Support Vector Machines for Regression. Very solid theory, rather easy to use, very good results according to the numerous papers I read.

The popular way: Most people will probably tell you to use Neural Networks. I advise against it, though.

Share this post


Link to post
Share on other sites
Quote:
Original post by Steadtler
If I understand your problem, you want a machine that will learn, given an object state S, what action A to pose. That falls into the regression problem.


Just to add a slightly perturbed perspective...

If the action space of the object to be controlled is discrete, then you can view the learning problem as one of classification with supervised training.

Whether the problem space is discrete or continuous, you're trying to learn a relationship between states S and actions A. I agree with Steadtler that regression approaches are usually very appropriate for such problems. However, you'll also find that in machine learning there are a variety of techniques that don't obviously look or sound like regression, but which give a comparitive result. For instance, Decision Trees. So using 'regression' as the basis of a search of the literature is more likely to lead you toward statistical regression, rather than machine learning (but that might be what you want for some of your objects).

I'd recommend grabbing an introductory book on machine learning and starting there. Then, refine your literature based on the approaches you think are best for the objects you want to control and the complexity of the control problems.

Cheers,

Timkin

Share this post


Link to post
Share on other sites
meh, you know Im no good with formal terms :)

Timkin's right, of couse. I excluded the classification techniques because of the target-seeking missile example. Now I think I was partially wrong: Tracking a target would be difficult to pose as a classification problem, but choosing the target to track definetly falls into that category!

Share this post


Link to post
Share on other sites

This topic is 4194 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this