This is a followup of 1540609.
In the above bug, we add a feature which cancel the connection after a certain period of time. However, that handles only the UI state, not the actual connection. Thus, for example, even this canceling processing runs, the connection prompt on remote runtime is still showing.
To resolve the issue, when cancel the connection, we should close the debugger client as well.