AVX512 Convolution Implementation Optimization for Knights Landing
Channel: gamozolabs
Date: 05/06/2017

This was recorded from a live stream done at https://twitch.tv/gamozo . It's uploaded in its raw form and thus has some dead space during breaks and such, but it's meant to show the raw process of how I go through optimization problems.

Ultimately we were able to get to 3300 GFLOP/s for a 16x16 input image, with 16 output convolutions (717.8M convolutions per second). This is quite close to the theoretical maximum Phi 7210 performance of 4500 GFLOP/s, which would be unlikely to achieve with realistic input and output streams.

The bottleneck in this case was discovered to be the output image. The simple process of outputting the image was the ultimate delay. Without outputting the convolution (only performing the math) we were able to hit 3700 GFLOP/s (803.7M convolutions per second).