Weid bug on rigidbodies positions.

Options
So, i'm developing a multiplayer rpg with PUN. i'm running into a weird issue where some objects (with rigidbodies) get very wacky positions as time goes by.
this it's how it looks like on the start (and should look like). (Look for the sword and the stick on the back of the character)
7UuHd1G.png
And that's what happens after some time (about 12 minutes i think)
JtrvSuq.png
These objects seem to be moving away from it's local position.
Could these be related to photon view, or photon animation view, or photon transform view?
I really don't think there's anything else interfering with it.