Issue 1:

Issue 2:
With this issue I would like to track the efforts in integrating the

cudnn library within tensorflow.

As of June 17th 2016 doing a manual grep on the repository gives these

functions as being mapped from cudnn to the stream executor,

From chapter 4 of the cudnn User Guide version 5.0 (April 2016):

cudnnGetVersion

cudnnGetErrorString

cudnnCreate

cudnnDestroy

cudnnSetStream

cudnnGetStream

cudnnCreateTensorDescriptor

cudnnSetTensor4dDescriptor

cudnnSetTensor4dDescriptorEx

cudnnGetTensor4dDescriptor

cudnnSetTensorNdDescriptor

cudnnDestroyTensorDescriptor

cudnnTransformTensor

cudnnAddTensor

cudnnOpTensor

cudnnSetTensor

cudnnScaleTensor

cudnnCreateFilterDescriptor

cudnnSetFilter4dDescriptor

cudnnGetFilter4dDescriptor

cudnnSetFilter4dDescriptor_v3 (versioned)

cudnnGetFilter4dDescriptor_v3 (versioned)

cudnnSetFilter4dDescriptor_v4 (versioned)

cudnnGetFilter4dDescriptor_v4 (versioned)

cudnnSetFilterNdDescriptor

cudnnGetFilterNdDescriptor

cudnnGetFilterNdDescriptor_v3 (versioned)

cudnnGetFilterNdDescriptor_v3 (versioned)

cudnnGetFilterNdDescriptor_v4 (versioned)

cudnnGetFilterNdDescriptor_v4 (versioned)

cudnnDestroyFilterDescriptor

cudnnCreateConvolutionDescriptor

cudnnSetConvolution2dDescriptor

cudnnGetConvolution2dDescriptor

cudnnGetConvolution2dForwardOutputDim

cudnnSetConvolutionNdDescriptor

cudnnGetConvolutionNdDescriptor

cudnnGetConvolutionNdForwardOutputDim

cudnnDestroyConvolutionDescriptor

cudnnFindConvolutionForwardAlgorithm

cudnnFindConvolutionForwardAlgorithmEx

cudnnGetConvolutionForwardAlgorithm

cudnnGetConvolutionForwardWorkspaceSize

cudnnConvolutionForward

cudnnConvolutionBackwardBias

cudnnFindConvolutionBackwardFilterAlgorithm

cudnnFindConvolutionBackwardFilterAlgorithmEx

cudnnGetConvolutionBackwardFilterAlgorithm

cudnnGetConvolutionBackwardFilterWorkspaceSize

cudnnConvolutionBackwardFilter

cudnnFindConvolutionBackwardDataAlgorithm

cudnnFindConvolutionBackwardDataAlgorithmEx

cudnnGetConvolutionBackwardDataAlgorithm

cudnnGetConvolutionBackwardDataWorkspaceSize

cudnnConvolutionBackwardData

cudnnSoftmaxForward

cudnnSoftmaxBackward

cudnnCreatePoolingDescriptor

cudnnSetPooling2dDescriptor

cudnnGetPooling2dDescriptor

cudnnSetPoolingNdDescriptor

cudnnGetPoolingNdDescriptor

cudnnSetPooling2dDescriptor_v3 (versioned)

cudnnGetPooling2dDescriptor_v3 (versioned)

cudnnSetPoolingNdDescriptor_v3 (versioned)

cudnnGetPoolingNdDescriptor_v3 (versioned)

cudnnSetPooling2dDescriptor_v4 (versioned)

cudnnGetPooling2dDescriptor_v4 (versioned)

cudnnSetPoolingNdDescriptor_v4 (versioned)

cudnnGetPoolingNdDescriptor_v4 (versioned)

cudnnDestroyPoolingDescriptor

cudnnGetPooling2dForwardOutputDim

cudnnGetPoolingNdForwardOutputDim

cudnnPoolingForward

cudnnPoolingBackward

cudnnActivationForward

cudnnActivationBackward

cudnnCreateActivationDescriptor

cudnnSetActivationDescriptor

cudnnGetActivationDescriptor

cudnnDestroyActivationDescriptor

cudnnActivationForward_v3 (versioned)

cudnnActivationBackward_v3 (versioned)

cudnnActivationForward_v4 (versioned)

cudnnActivationBackward_v4 (versioned)

cudnnCreateLRNDescriptor

cudnnSetLRNDescriptor

cudnnGetLRNDescriptor

cudnnDestroyLRNDescriptor

cudnnLRNCrossChannelForward

cudnnLRNCrossChannelBackward

cudnnDivisiveNormalizationForward

cudnnDivisiveNormalizationBackward

cudnnBatchNormalizationForwardInference

cudnnBatchNormalizationForwardTraining

cudnnBatchNormalizationBackward

cudnnDeriveBNTensorDescriptor

cudnnCreateRNNDescriptor

cudnnDestroyRNNDescriptor

cudnnSetRNNDescriptor

cudnnGetRNNWorkspaceSize

cudnnGetRNNTrainingReserveSize

cudnnGetRNNParamsSize

cudnnGetRNNLinLayerMatrixParams

cudnnGetRNNLinLayerBiasParams

cudnnRNNForwardInference

cudnnRNNForwardTraining

cudnnRNNBackwardData

cudnnRNNBackwardWeights

cudnnCreateDropoutDescriptor

cudnnDestroyDropoutDescriptor

cudnnDropoutGetStatesSize

cudnnDropoutGetReserveSpaceSize

cudnnSetDropoutDescriptor

cudnnDropoutForward

cudnnDropoutBackward

cudnnCreateSpatialTransformerDescriptor

cudnnDestroySpatialTransformerDescriptor

cudnnSetSpatialTransformerNdDescriptor

cudnnSpatialTfGridGeneratorForward

cudnnSpatialTfGridGeneratorBackward

cudnnSpatialTfSamplerForward

cudnnSpatialTfSamplerBackward

Batch Normalization

Seems @lukemetz was working on it but has stalled for a bit #1759

What is the plan for the RNN ?

I know @wchan was working on a cpu version. I was trying to get a stub at using the cudnn version but from the comments in that thread seemed like @zheng-xq was working on it internally.

Can anyone comment on the status of these ops?

Other Questions

Any reasons why the Softmax functions are not being used ?

Would make sense to split the above list in chunks and create issues with contribution welcome, so external contributors can tackle them without duplicating internal work, or mark what google will be working on internally ?

I hope this helps in organizing the work around the cudnn and inspire the community to contribute. I will try to keep this issue up to date.