I just need to know if it's ok to give the PhsyX driver with my game?

Check the license information given to you / that you agreed to when you downloaded the sdk. If you are working on the academic license, you may not have the right to distribute. There is also a difference between distributables and nondistributable parts of the SDK. I suggest reading your license information, or contacting Ageia support directly.