Wheel overspin

Options

In the game i'm building players get physics-controlled cars that use the builtin Unity Wheel collider to control the wheels. It seems that on any connection except of the host, every wheel on every car of every player has the wheels visually spinning 3-4 times faster than they should. This effect is not visible for the host player, there everything seems to be normal. It also doesn't seem to affect the physics of the wheels in any way.

I have a feeling this a bug caused by the way Fusion resimulates physics for client connections, anyone else deal with this or found a workaround?