Having some major choppy/laggy movements - only in PvP mode

Options

Versions and link to the game below. I am having some heavy choppy movements and un-synced characters only when playing PvP. If I start the game with bots only, everything is fine, game runs very smooth. As long as there is another player in the lobby - host generally works fine but for P2, P3, P4 - game stutters. I am using a single fixed server - EU.


Any suggestion, idea, help - if someone has time to check it out via TeamViewer - more than happy to pay for your time. This is driving me crazy :/


Versions:

Unity 2020.3.19f1

PUN 2 Plus 2.40

Link to the game: https://bitfreaks.io/beta