Do not assume equal sized images when downsampling