Ensure we do not create duplicate device handlers