interact with objects not visible to second player.

Options
I was using the OnPhotonSerializeView in orther to let other players know where the object was, I was using a corroutine with
transform.position = Vector3.Lerp(transform.position,networkposition,Time.deltaTime*10f);
but the object keeps lerping to the 0,0,0 position.
is there another way let other player interact with the same objects. and all the players can see the position of those objects.