Fix handling of images we can't make derivs for.