FPS dropped

Options

Hi, I'm working on VR Game on Quest 2, the game is physics based

When a client or more joins the game, the fps is dropped to 58-72 but on the other hand, the fps in the host is fixed at 72.

These are my network config fusion and profiler


How can I solve this problem?