Visual Studio 2017 debug performance issue

Not sure if it is only me or what. If I attach VS to Unity and debug the project. Sometime Unity is not responding, I have to stop the debug in VS. while the Unity responded, then the VS is not responding and have to be killed. I don't have such issue if the project is not installed with Bolt.