Issue 1:
🐛 Bug

Search datasets...

Original length: 900

Offset: 0

Limit: 900

Final length: 900

Search datasets...

Original length: 120

Offset: 0

Limit: 120

Final length: 120

Using CuDNN in the experiment.

Traceback (most recent call last):

File "", line 1, in

runfile('C:/Users/Administrator/Desktop/haoxiang_CRN/train.py', wdir='C:/Users/Administrator/Desktop/haoxiang_CRN')

File "C:\Users\Administrator\Anaconda3\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 827, in runfile

execfile(filename, namespace)

File "C:\Users\Administrator\Anaconda3\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 110, in execfile

exec(compile(f.read(), filename, 'exec'), namespace)

File "C:/Users/Administrator/Desktop/haoxiang_CRN/train.py", line 103, in

main(config, resume=resume)

File "C:/Users/Administrator/Desktop/haoxiang_CRN/train.py", line 93, in main

validation_dataloader=valid_data_loader

File "C:\Users\Administrator\Desktop\haoxiang_CRN\trainer\trainer.py", line 27, in init

super(Trainer, self).init(config, resume, model, optimizer, loss_function)

File "C:\Users\Administrator\Desktop\haoxiang_CRN\trainer\base_trainer.py", line 15, in init

self.model = model.to(self.device)

File "C:\Users\Administrator\Anaconda3\lib\site-packages\torch\nn\modules\module.py", line 432, in to

return self._apply(convert)

File "C:\Users\Administrator\Anaconda3\lib\site-packages\torch\nn\modules\module.py", line 208, in _apply

module._apply(fn)

File "C:\Users\Administrator\Anaconda3\lib\site-packages\torch\nn\modules\module.py", line 230, in _apply

param_applied = fn(param)

File "C:\Users\Administrator\Anaconda3\lib\site-packages\torch\nn\modules\module.py", line 430, in convert

return t.to(device, dtype if t.is_floating_point() else None, non_blocking)

RuntimeError: CUDA error: unspecified launch failure

Expected behavior

When I run on a small data set, the above error occurs when the data set becomes larger.

Environment

Collecting environment information...

PyTorch version: 1.2.0

Is debug build: No

CUDA used to build PyTorch: 10.0

OS: Microsoft Windows 10 Professional

GCC version: Could not collect

CMake version: Could not collect

Python version: 3.7

Is CUDA available: Yes

CUDA runtime version: 10.0.130

GPU models and configuration: Could not collect

Nvidia driver version: Could not collect

cuDNN version: C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.0\bin\cudnn64_7.dll

Versions of relevant libraries:

[pip] numpy==1.16.5

[pip] numpydoc==0.9.1

[pip] torch==1.2.0

[pip] torchvision==0.4.0

[conda] blas 1.0 mkl defaults

[conda] mkl 2019.4 245 defaults

[conda] mkl-service 2.3.0 py37hb782905_0 defaults

[conda] mkl_fft 1.0.14 py37h14836fe_0 defaults

[conda] mkl_random 1.1.0 py37h675688f_0 defaults

[conda] torch 1.2.0 pypi_0 pypi

[conda] torchvision 0.4.0 pypi_0 pypi

Additional context

win10[1903]

Graphics card model：RTX2060

anaconda 4.7.12

Graphics driver 441.20

CUDA:cuda_10.0.130_411.31_win10

CUDNN:cudnn-10.0-windows10-x64-v7.6.0.64

Python:3.7.4

Do you have any good suggestions for this kind of problem?

Issue 2:
🐛 Bug

No problem in PyTorch 1.2. Archive with code and data: https://github.com/pytorch/pytorch/files/3723821/PyTorch.zip

Windows 10 (1903), Python 3.7.4, RTX 2060 (driver version 436.48)

---------------------------------------------------------------------------
RuntimeError Traceback (most recent call last)
<ipython-input-6-68308ed1e055> in <module>
35 cum_loss.append(loss.item())
36
---> 37 loss.backward()
38 optimizer.step()
39

C:\Anaconda3\envs\torch13\lib\site-packages\torch\tensor.py in backward(self, gradient, retain_graph, create_graph)
148 products. Defaults to ``False``.
149 """
--> 150 torch.autograd.backward(self, gradient, retain_graph, create_graph)
151
152 def register_hook(self, hook):

C:\Anaconda3\envs\torch13\lib\site-packages\torch\autograd\__init__.py in backward(tensors, grad_tensors, retain_graph, create_graph, grad_variables)
97 Variable._execution_engine.run_backward(
98 tensors, grad_tensors, retain_graph, create_graph,
---> 99 allow_unreachable=True) # allow_unreachable flag
100
101

RuntimeError: CUDA error: unspecified launch failure

cc @ezyang @gchanan @zou3519 @ssnl @albanD @gqchen @ngimel @peterjc123