Make sure to initialize the cudnn descriptors.