For all the 3 modes, I have kept in `range(max_scale - min_scale + 1)` to resonate with scales[:, :, i] and I extract the scale specific info(filter size) using `min_scale + i`.