Iterate in column-major order when convolving

Summary:

Test Plan:

Reviewers:

CC: