Check if executing before attempting to stop