Pause OnPhotonSerializeView or alternatives

Options
I'm making a football (soccer) game.
Im using OnPhotonSerializeView for the transform syncing.
The player only controlls one player at a time, all the other players are controlled by AI.
So my issue is that I only want OnPhotonSerializeView to be active on the player controlled player, to avoid sending too network data for no reason. Is there any way to do this?