I import FBX and convert it to my mesh and animation format. This is the way used by Unreal and Unity too.
The other way is to write your plugin, I used this way on 3dsmax and maya before FBX was good enough.
One limitation from the FBX is to not support shear on the transformation matrix.
FBX SDK is not thread safe too.