Destroyed Objects respawn on connect

Hello,

I am facing a issue where my previously destroyed objects are respawned. Essentially I shoot bullets and when they hit something I call Destroy (on master client). If i disconnect as a non master clients and connect again, everything that the master client did (shoot bullets) gets respawned at those locations.

Has anyone ever encountered that?

Thank you for your help.