Some people here might be familiar with Model mechas. If you're anime fan, you may have seen an anime called Gundam Builders. The long and the short of that is: kids build actual model replicas of mechs, place them on a board, and then fight with holographic versions of those replicas.

So what if tech like Kinect and PSEye were used in such a manner. Basically, you'd buy a mech model and allow the Kinect/PSEye (from here on out, I'll just call it Eye) to scan the model. Or the Eye could just scan in paper (ex: barcodes) showing what parts were used. Then in the game itself, you could adjust parameters to your liking. Afterwards, the game would play from 1st person view, with you viewing everything through the VR helmet. And the Eye would track your hands so you could manipulate the virtual console/controls in the game. Granted, having your hands free-float like that would be fatiguing.

Is this too engaging or is this where we are hoping to go? I remember long ago, Fable or the guy who made Fable, demonstrated something similar to this.