Revert "Update graph connectivity on unit movement / removal / addition."

This reverts commit 0c78f7784dac8635cfee264641619645e086c40a.