Ive seen individual images feedbacking out of a neural network, but ive never seen motion video.

Im actually attempting this with htm (heirarchical temporal memory) right now, Ive got single pictures feedbacking out of a single layer, but I havent got up to temporal yet, im having an issue with what the output message is going to be for intermediate nodes.

Motion video would be amazing coming out of a neural network, but there doesnt seem to be anything on the internet about it?

I was thinking maybe there is huge potential for photorealistic games produced from recorded footage by hacking some inputs of the ann with controls.

Any info on this subject?

thanks.

I don't know enought about this HTM model sorry, but a Mc Culloch & Pitts based neural model is a hyperplane. You can represent, visualize it as a plane in 3D, a line in 2D, in a visual application.

yes, I also know that neural networks model functions, like you could even get a 3d landscape out of a neural network. but my question is how to deal with learning motion video, instead of just static characters, or static volumes.

heres the best pdf on htm at the moment, and yes - it is motion video, just i cant get it to work. (not yet anyway, i was just maybe seeing if i could get some pointers.)

http://bias.csr.unibo.it/maltoni/HTM_TR_v1.0.pdf

but im not just interested in htm, i love ann's too.

It is a bit of an advanced topic, like- ive seen NOWHERE with any info about it.

I just got temporal working, in my htm, its now pumping out 64 frame sections of a little man running and jumping up and down.

the matrices on the screen are the regions, the yellow numbers are how many space types its stored at that node, and the pink number is how many temporal types at that node. A problem I have now is if I let it record for too long, the amount of space types shoots through the roof (past the capacity of the memory) so I need some way to remedy this problem.

But its working.

heres another screenshot, its 8 bit space type memory its at its limit after ~640 frames of unique data pumped into it.

im gonna try raising the limit to 16 bit, and see if thats enough to fit the game inside the finite space.

heres a choppy movie of it going, it actually goes full framerate +.