Spawned object movement is laggy on players but smooth on master

Options
I have up to 16 spawned prefabs with just Text and a collider. On the master client the movement is smooth but on the other 3 players it laggy.
The spawned objects rotate around the center of the scene via a script see below.
They all have these components: Ridgidbody, photonview, photonTransformView, photonRigidBody view. See images for settings.
https://ibb.co/rchjVTr
https://ibb.co/YppB4hs

What am I doing wrong? How can I smooth out the movement on the other 3 players?
    void Update()
    {
       if (center != null) {
            transform.RotateAround(center.transform.position, axis, angle);
        }
    }
}