• Advertisement
Sign in to follow this  

video and ann

This topic is 1787 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Ive seen individual images feedbacking out of a neural network, but ive never seen motion video.

 

Im actually attempting this with htm (heirarchical temporal memory) right now, Ive got single pictures feedbacking out of a single layer, but I havent got up to temporal yet, im having an issue with what the output message is going to be for intermediate nodes.

 

Motion video would be amazing coming out of a neural network, but there doesnt seem to be anything on the internet about it?

 

I was thinking maybe there is huge potential for photorealistic games produced from recorded footage by hacking some inputs of the ann with controls.    

 

Any info on this subject?

 

thanks.

Share this post


Link to post
Share on other sites
Advertisement

I don't know enought about this HTM model sorry, but a Mc Culloch & Pitts based neural model is a hyperplane. You can represent, visualize it as a plane in 3D, a line in 2D, in a visual application.

Edited by Tournicoti

Share this post


Link to post
Share on other sites

yes, I also know that neural networks model functions, like you could even get a 3d landscape out of a neural network.   but my question is how to deal with learning motion video, instead of just static characters, or static volumes.

 

heres the best pdf on htm at the moment, and yes - it is motion video, just i cant get it to work. (not yet anyway, i was just maybe seeing if i could get some pointers.)

http://bias.csr.unibo.it/maltoni/HTM_TR_v1.0.pdf

 

but im not just interested in htm, i love ann's too.

 

It is a bit of an advanced topic, like- ive seen NOWHERE with any info about it.

Edited by rouncer

Share this post


Link to post
Share on other sites

I just got temporal working, in my htm, its now pumping out 64 frame sections of a little man running and jumping up and down.

 

htmfeedback.png

 

the matrices on the screen are the regions, the yellow numbers are how many space types its stored at that node, and the pink number is how many temporal types at that node.   A problem I have now is if I let it record for too long, the amount of space types shoots through the roof (past the capacity of the memory) so I need some way to remedy this problem.

 

But its working. smile.png

Edited by rouncer

Share this post


Link to post
Share on other sites

heres another screenshot, its 8 bit space type memory its at its limit after ~640 frames of unique data pumped into it.

bustedcapacity.png

im gonna try raising the limit to 16 bit, and see if thats enough to fit the game inside the finite space. smile.png

 

 

heres a choppy movie of it going, it actually goes full framerate +.

 

Edited by rouncer

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement