To fix the Xbox One controller drift without opening, you need to clean the grime on your controller using isopropyl alcohol and cotton swabs. Clean until the controller is totally dust-free. After cleaning, you need to check if the controller is functioning properly. If not, you need to open the controller to fix the drift.