No, GPU components are not hot plugging friendly so you have to turn off the system to change the components.