Fix bug that presents only on multi-GPU systems