As you can see that the tiny model works fine. This is because Tiny Model has only 1 subset and my code had some issues with handing multiple subsets. I had forgot to add bone start to the bone index so subsets after the first subset would get messed. I have finally fixed and you can see that in this video :
You can find more info on my blog.