late joining players don't see any changes made in the scene

I am trying to build a simple FPS multiplayer game using Photon PUN 2. In my game, there are some targets, and players can raycast at them to change their color. I am using RPC with RpcTarget.AllBuffered.

Everything gets synchronized well if players join in the room first and then start shooting at targets. Unfortunately, late joining players in the room don't see any changes made so far by other players.

In my code, I used -

PhotonNetwork.AutomaticallySyncScene = true;

PhotonNetwork.LoadLevel(1);

Any help to fix this issue would be much appreciated. Thanks in advanced.