Repository: pytorch
Issue: Pytorch 1.4 does not detect gpu
Labels: module: cuda,triaged

## 🐛 Bug

Installing pytorch 1.4 does not detect GPU, but pytorch-1.2 does work fine.
## To Reproduce

Steps to reproduce the behavior:

1. Create a new environment using conda: `conda create -n py14 python=3.7`
1. Activate the conda environment `conda activate py14`
1. Install pytorch using the command `conda install pytorch -c pytorch`
1. `python -c "import torch; print(torch.cuda.is_available())"`

Repeat The same sequence of steps but use pytorch 1.2 and a different environment say py12
1. Create a new environment using conda: `conda create -n py12 python=3.7`
1. Activate the conda environment `conda activate py12`
1. Install pytorch using the command `conda install pytorch=1.2 -c pytorch`
1. `python -c "import torch; print(torch.cuda.is_available())"`


<!-- If you have a code sample, error messages, stack traces, please provide it here as well -->
The key difference seems to be in the toolkit, cudnn version:

pytorch-1.4 pulls: `pytorch/linux-64::pytorch-1.4.0-py3.7_cuda10.1.243_cudnn7.6.3_0`
pytorch-1.2 pulls: `pytorch/linux-64::pytorch-1.2.0-py3.7_cuda10.0.130_cudnn7.6.2_0`


## Expected behavior

<!-- A clear and concise description of what you expected to happen. -->
In both cases step 4 should print True. But pytorch-1.2 prints True and pytorch-1.4 prints False
## Environment
For environment py14:
```
Collecting environment information...
PyTorch version: 1.4.0
Is debug build: No
CUDA used to build PyTorch: 10.1

OS: Ubuntu 18.04.1 LTS
GCC version: (Ubuntu 7.4.0-1ubuntu1~18.04.1) 7.4.0
CMake version: version 3.10.2

Python version: 3.7
Is CUDA available: No
CUDA runtime version: Could not collect
GPU models and configuration:
GPU 0: GeForce RTX 2080 Ti
GPU 1: GeForce RTX 2080 Ti

Nvidia driver version: 410.78
cuDNN version: /usr/lib/x86_64-linux-gnu/libcudnn.so.7.4.2

Versions of relevant libraries:
[pip] numpy==1.18.1
[pip] torch==1.4.0
[conda] blas                      1.0                         mkl
[conda] mkl                       2019.4                      243
[conda] mkl-service               2.3.0            py37he904b0f_0
[conda] mkl_fft                   1.0.15           py37ha843d7b_0
[conda] mkl_random                1.1.0            py37hd6b4f25_0
[conda] pytorch                   1.4.0           py3.7_cuda10.1.243_cudnn7.6.3_0    pytorch
```

For environment py12:
```
Collecting environment information...
PyTorch version: 1.2.0
Is debug build: No
CUDA used to build PyTorch: 10.0.130

OS: Ubuntu 18.04.1 LTS
GCC version: (Ubuntu 7.4.0-1ubuntu1~18.04.1) 7.4.0
CMake version: version 3.10.2

Python version: 3.7
Is CUDA available: Yes
CUDA runtime version: Could not collect
GPU models and configuration:
GPU 0: GeForce RTX 2080 Ti
GPU 1: GeForce RTX 2080 Ti

Nvidia driver version: 410.78
cuDNN version: /usr/lib/x86_64-linux-gnu/libcudnn.so.7.4.2

Versions of relevant libraries:
[pip] numpy==1.18.1
[pip] torch==1.2.0
[conda] blas                      1.0                         mkl
[conda] mkl                       2019.4                      243
[conda] mkl-service               2.3.0            py37he904b0f_0
[conda] mkl_fft                   1.0.15           py37ha843d7b_0
[conda] mkl_random                1.1.0            py37hd6b4f25_0
[conda] pytorch                   1.2.0           py3.7_cuda10.0.130_cudnn7.6.2_0    pytorch
```

cc @ngimel