Teddybot

Members
  • Content count

    21
  • Joined

  • Last visited

Community Reputation

126 Neutral

About Teddybot

  • Rank
    Member
  1. [quote name='willh' timestamp='1327681696' post='4906775'] [quote name='wodinoneeye' timestamp='1327566293' post='4906355'] ... the problem becomes MUCH more difficult when you have a dynamic system with temporal effects (when you have to figure out which factors from the past in a sequence of actions were the cause of the results). [/quote] This is one of the things that hidden markov models aim to solve. The Viterbi algorithm allows you to determine the most likely sequence of events that could have resulted in a particular outcome. ANNs may have a bad reputation, but there have been some very interesting developments relating to neural networks recently (see Geoffrey Hinton and U. of Toronto). It's plausible that HTMs are something new and fascinating. If only someone who has used them could explain what they do...... <*cough*teddybot*cough*> [/quote] Thank you for the positive viewpoint! Slower changing events higher in the hierarchy separate small things in time such as motor movements getting up off the couch from the key way points on the way to the fridge. (Temporal Credit Assignment Problem) is specifically addressed in posted pdf. Which invariant representations to reward or punish during and after the task? Modules around the system make it all happen. Zero modules were published with the HTM psuedocode. Some of the modules operation are mentioned in On Intelligence. It is up to us to innovate with it and develop how it is used. A new paradigm is a great challenge to take on. Thread continued here: http://www.gamedev.net/topic/618710-neocortex-based-algorithms/
  2. Second video: [url="http://www.dartmouth.edu/%7Erhg/videos2.html"]http://www.dartmouth...hg/videos2.html[/url] [media]http://www.youtube.com/watch?v=oozFn2d45tg[/media] Continued here: [url="http://www.gamedev.net/topic/618710-neocortex-based-algorithms/"]http://www.gamedev.n...sed-algorithms/[/url]
  3. Neocortex based algorithms

    http://www.co-bw.com/BSC%20B1%20C1.htm
  4. Neocortex based algorithms

    Helpful images
  5. Neocortex based algorithms

    Helpful PDFs
  6. ... remove my account ...
  7. Neocortex based algorithms

    Now onto the "Binary" implementation of HTM. Binary is chosen as a 'mentally tangible' starting point to work from. The leaves off temporal calculation and sparsification and is replaced with non-sparsified direct input. The implications of these choices will be better understood though attempts to progress in any particular direction. Here are some links to the first version of the random access string retrieval from the hierarchy. When one hierarchy is used to represent a set of string the nodes may be setup with counters and an temporal memory object. The temporal memory object is a list of previously active nodes which may used by a node to predict its own activity. Adding multiple lists per node gets a bit tricky and that is covered in the Numenta PDF. Videos of the PHP/Java/Javascript applications: It is not a Grammar according to a few who responded as each child may have more than one parent. This project is designed to pit you against some A.I. problems in a way that you have not been before. Please take it lightly and try to have a good time. Thank you! Multiple texts stored and retrieved in a tree structure. [media]http://www.youtube.com/watch?v=sk0dSQ6snnw[/media] Only the bottom nodes store character values of text. Every node above only stores indexes of nodes below. When a string is done being inserted a list comes up with at most one index per level to recurse in order to rebuild the text. Regardless of the size of the system the ability to pull a string out stays relatively constant. [media]http://www.youtube.com/watch?v=wG6lsmlc8UI[/media] The horizontal arcs between nodes are 'single' cell per column temporal predictions. Meaning they do not hold context. We need that also for games- if something doesn't match this exact context out of context solutions may still be applied. An issue with 'temporal shift' was solved with this algorithm. Given a string such as 123456789123456789 or 123456789-123456789 results in basically only adding '-' to the hierarchy. This will be illustrated in posted image showing strings going in, their representation and how that could be used in gameplay. [media]http://www.youtube.com/watch?v=koawa2l1xIE[/media] [media]http://www.youtube.com/watch?v=uvXygqPudsw[/media] [media]http://www.youtube.com/watch?v=5d3v27Kn9oA[/media] [media]http://www.youtube.com/watch?v=DBDUZsI7i9Y[/media]
  8. Neocortex based algorithms

    These videos are available source of some HTM implementations. The next post shows video of the HTM influenced 'binary' encoder algorithm. Javascript HTM classes: Sparsification: The first video takes input from the pixels in a photo for instance. Sparsification makes it so just a few of the proximal dendrites activate and that is the winning columns which are output to a program like the video below [media]http://www.youtube.com/watch?v=wvKn79e4zOU[/media] Winning temporal columns: [media]http://www.youtube.com/watch?v=yQXu-sKdNeM[/media] This second video is the reciever of the winning columns. Both its activity and predictions are sent up to the next layer which is sparsification. Sparsification handles space. The temproal links handle predictions. Both activity and prediction is sent up to the next layer which is crucial to the contextual thinking which we have such a hard time attempting to represent algorithmically. [media]http://www.youtube.com/watch?v=VW5nDqTbP2I&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=gUYigC41Mow&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=yHr02K3yp5o&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=XF6SUi49CK0&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=4aRLXtfq-vg&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=8bsDn6_VqXQ&feature=channel&list=UL[/media] [media]http://www.youtube.com/watch?v=gc44s6XIoKo&feature=channel&list=UL[/media] This is open source Javascript/Java/PHP for anyone. It will be included in an upcoming zip file. The zip file will have the PHP version, database files, Java version, Java Tron light cycle auto feeding into one and others.
  9. Neocortex based algorithms

    [quote name='laztrezort' timestamp='1335919353' post='4936608'] Intersting post, since I'm just now finishing reading [i]On Intelligence[/i], which I found fascinating. To me it seemed like solving the problem of pattern invarience is itself a huge step forward in AI. I'll read through the paper, but I fear some of it may be over my head, not being a neuroscientist nor having a strong math background in ANN [/quote] congratulations! The book explains a lot about my visual mistakes or how can miss the car keys on the counter (part of tree turned off from inhibition circuits due to other belief being active and filtering for that belief...) The thing I made is because the HTM is too hard in general. I wanted an incremental way to run into problems while having a solid foundation behind me and tangible tools to work with. This has taken me a lot of work and I am just thankful for the forum to post it up so I can share the benefits I've found through source code and some examples. On Tron Lightcycles: The second video talks about landmarks in layers. With lightcycles a landmark method draws a line between the midpoints of each segment. The angle of the line is used for variance and to group games. The next layer up creates lines between the midpoints of the lines on the level below. You eventually get one line to describe the game. During gameplay the most active sets are displayed and the results from those games is also displayed. Given trouble pick the best matching game and move in the direction opposite the slope of a losing landmark or go the same as a winning one and sometimes choose a random direction. A pure HTM system will develop salient landmarks through the goal system and memory system by increasing permanence. In a binary stack style HTM special functions could mark certain items in the list as more important. The program was run on some text and the regeneration routine left out parts with less than n occurances. It was a test to see how readable text is with some of the most common bits taken out. Can you tell what the 3 words are which is represented by the second word? You calwayscify that
  10. Neocortex based algorithms

    The second video at Brainlab is very very interesting. [url="http://www.dartmouth.edu/%7Erhg/"]http://www.dartmouth.edu/~rhg/[/url] (second video) Jeff Hawkins [media]http://www.youtube.com/watch?v=oozFn2d45tg[/media] his book On Intelligence or the audio of it.
  11. Neocortex based algorithms

    I appreciate the practical and positive responses. >>Yeah... the kicker question is, considering this is a game dev forum, [i]how would this work for games?[/i] By it I do not refer to the HTM psuedode alone but with extra modules which are well described in various places online. It can and will be used for games when it is more evolved and better understood by game programmers. This is an extremely difficult paradigm at current however if there are pieces which could potentially suit our needs hiding about in pdfs and videos it could be of benefit to bring them to the surface. My opinion is that it will trickle down from industry in more ready to use modules and have more of a science developed around its use at that time. On the other hand I would appreciate being able to voice some of the things I have found which inspire me from my decades of wishing we had game algorithms which could behave similar to humans. How to make it work in games is easier understood with some pursuit of the videos- ideas will come to you. The examples in some a certain video and a pdf relate to goals, dyanmic motor output and more. As time progresses I believe it will be common for programmers to talk about such things as the 'invariant representation' for feeling cornered firing and how the systems around it play out. When you have a Visual, Kinesthetic and Audiio spatial/temporal predictor integrated with goal systems I promise you will see the best A.I players ever. We will have games that become more difficult without speeding up. Most people need something ready now this is for people who need something new, very difficult and holds a lot of promise. How would it perform at chess? The psuedocode is basically a fuzzy pattern recognizer which if given patterns over time is also able to use temporal context on various levels of granularity. It does not have thalomocortical loops or feedback which is required for imagining various scenarious based on the past and current contexts. In chess it would develope invariant representations for game states in context. During gameplay it is able to make contextual predictions. The goal system would drive the play which may be modeled directly from information at: http://www.dartmouth.edu/~rhg/ (second video) http://www.dartmouth.edu/~rhg/pubs/FGbrainbots10.pdf Could it be used to create intelligent unscripted bots? Yes. It is based on how our neural columns operate and models our goal, motor output and learning systems. Is this the end of CAPTCHA authentication? Not for a long time to be as good as people. Same with certain aspects of game A.I. There are two histories we have. A genetic history with social rules and biases basically hard wired. And our cultural history. These will eventually be transferred but the world may be a better place with Captcha working. Are there any military applications to this? Yes the 100 step rule is used to recognize pictures and the main motivation to post it at a game forum. Why? We can store millions of strings then give it one. A few nodes light up which represent that string. Give it a different string and the shared nodes represent which part of the strings are in common. I have this working and it is a big variant off of HTM to try and suit our needs. Lets say you record the paths of poeple playing games and where shots were fired and where players died. A method to compare the current state to all games faster than sequential search may be what this is great for. The thing that this is very good for is predicting the next state and with contextual accuracy. So if you usually do m at area n while bot is doing x at area y it knows the difference if you did m when the bot wasn't at y. The version I have does not have generalization buit in specifically and it is designed to bring out the things in HTM development which seem too difficult with the grid/plasticity/maxboost/columns/synapses model. Generalization may be added however it will become clear in certain situations where each paradigm has its strengths in relation to the problems discussed above. Could it make simulations obsolete? Major work is done to simulate the brain at a molecular level which will be used to test drugs. That is a welcome simulation given that the awareness sections are turned off. Major work is done to run the same algorithms the brain does in a different medium. What the neuron does is less than its number of parts which has been verified by comparing models to actual neurons. Link: http://rodrinkus.zxq.net/
  12. I appreciate your opinions. Thanks, Teddybot
  13. The core of the technology is required to accomplish proper AI for a light cycle game. It is possible to add fundamentals to the technology and create a box for specific solutions.
  14. http://www.youtube.com/results?search_query=jeff+hawkins&oq=jeff+hawkins&aq=f&aqi=g5&aql=&gs_sm=e&gs_upl=1200l3123l0l3866l12l11l0l3l3l1l220l1304l0.6.2l8l0 [img]http://i4.ytimg.com/vi/G6CVj5IQkzk/default.jpg[/img] Jeff Hawkins Derivatives of this technology will be the foundation for tomorrows software. The first person or group to sucessfully apply HTM technology to gaming will recorded in history.
  15. Everything in the last two posts has been extremely considered and gone over for years before making this thread. Thank you for your replies, Teddybot