How to remove Photon Transform View component in Unity

I need to remove PhotonTransformView and PhotonView components in Unity, so that object will not be synchronized any more. I did that with Destroy(item.GetComponent<PhotonTransformView>());. The component is removed and the same for PhotonView. The problem is, that when I remove this components, I get this error every update : "MissingReferenceException: The object of type 'PhotonView' has been destroyed but you are still trying to access it.
Your script should either check if it is null or you should not destroy the object.". So I expect I need to do the opposite of AllocateViewID, but I don't know how or if that's even possible.