Only make the pad_image if using it for noise padding
(#238)