I would rather compare with a CPU implementation of Conv3d that is known to be good.