Issue 1:
🐛 Bug

Sorry if a duplicate of existing bug-report (can't easily find it)

To Reproduce

torch.zeros((16*2**20 - 512)//2 + 1, 1, dtype=torch.float16, device='cuda:0') @ torch.zeros(1, 2, dtype=torch.float16, device='cuda:0')

RuntimeError: cublas runtime error : the GPU program failed to execute at /opt/conda/conda-bld/pytorch_1556653114079/work/aten/src/THC/THCBlas.cu:315

It also fails if cublasGemmEx called via pytorch extension, with stacktrace:

frame #0: c10::Error::Error(c10::SourceLocation, std::string const&) + 0x45 (0x7fe8d5a44dc5 in /opt/anaconda3/lib/python3.7/site-packages/torch/lib/libc10.so)
frame #1: mm_fp16_fp16_acc32(at::Tensor, at::Tensor, at::Tensor) + 0x7dd (0x7fe884d2873d in /mnt/live/research/hffx/SharedCodes/python/xtx/nn/gemm_11/gemm_bind.cpython-37m-x86_64-linux-gnu.so)
frame #2: <unknown function> + 0x199f0 (0x7fe884d389f0 in /mnt/live/research/hffx/SharedCodes/python/xtx/nn/gemm_11/gemm_bind.cpython-37m-x86_64-linux-gnu.so)
frame #3: <unknown function> + 0x19eda (0x7fe884d38eda in /mnt/live/research/hffx/SharedCodes/python/xtx/nn/gemm_11/gemm_bind.cpython-37m-x86_64-linux-gnu.so)
frame #4: <unknown function> + 0x16a79 (0x7fe884d35a79 in /mnt/live/research/hffx/SharedCodes/python/xtx/nn/gemm_11/gemm_bind.cpython-37m-x86_64-linux-gnu.so)
frame #5: _PyMethodDef_RawFastCallKeywords + 0x264 (0x5632b1b5f494 in /opt/anaconda3/bin/python)
frame #6: _PyCFunction_FastCallKeywords + 0x21 (0x5632b1b5f5b1 in /opt/anaconda3/bin/python)
frame #7: _PyEval_EvalFrameDefault + 0x4f32 (0x5632b1bbb5b2 in /opt/anaconda3/bin/python)
frame #8: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #9: PyEval_EvalCodeEx + 0x44 (0x5632b1afc8a4 in /opt/anaconda3/bin/python)
frame #10: PyEval_EvalCode + 0x1c (0x5632b1afc8cc in /opt/anaconda3/bin/python)
frame #11: <unknown function> + 0x1e140d (0x5632b1bc640d in /opt/anaconda3/bin/python)
frame #12: _PyMethodDef_RawFastCallKeywords + 0xe9 (0x5632b1b5f319 in /opt/anaconda3/bin/python)
frame #13: _PyCFunction_FastCallKeywords + 0x21 (0x5632b1b5f5b1 in /opt/anaconda3/bin/python)
frame #14: _PyEval_EvalFrameDefault + 0x47e3 (0x5632b1bbae63 in /opt/anaconda3/bin/python)
frame #15: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #16: _PyFunction_FastCallKeywords + 0x325 (0x5632b1b5e765 in /opt/anaconda3/bin/python)
frame #17: _PyEval_EvalFrameDefault + 0x6f5 (0x5632b1bb6d75 in /opt/anaconda3/bin/python)
frame #18: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #19: _PyFunction_FastCallKeywords + 0x387 (0x5632b1b5e7c7 in /opt/anaconda3/bin/python)
frame #20: _PyEval_EvalFrameDefault + 0x14e3 (0x5632b1bb7b63 in /opt/anaconda3/bin/python)
frame #21: _PyEval_EvalCodeWithName + 0xb99 (0x5632b1afc2d9 in /opt/anaconda3/bin/python)
frame #22: _PyFunction_FastCallKeywords + 0x387 (0x5632b1b5e7c7 in /opt/anaconda3/bin/python)
frame #23: _PyEval_EvalFrameDefault + 0x6f5 (0x5632b1bb6d75 in /opt/anaconda3/bin/python)
frame #24: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #25: _PyFunction_FastCallKeywords + 0x387 (0x5632b1b5e7c7 in /opt/anaconda3/bin/python)
frame #26: _PyEval_EvalFrameDefault + 0x14e3 (0x5632b1bb7b63 in /opt/anaconda3/bin/python)
frame #27: _PyFunction_FastCallKeywords + 0xfb (0x5632b1b5e53b in /opt/anaconda3/bin/python)
frame #28: _PyEval_EvalFrameDefault + 0x6f5 (0x5632b1bb6d75 in /opt/anaconda3/bin/python)
frame #29: _PyFunction_FastCallKeywords + 0xfb (0x5632b1b5e53b in /opt/anaconda3/bin/python)
frame #30: _PyEval_EvalFrameDefault + 0x6f5 (0x5632b1bb6d75 in /opt/anaconda3/bin/python)
frame #31: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #32: _PyFunction_FastCallKeywords + 0x325 (0x5632b1b5e765 in /opt/anaconda3/bin/python)
frame #33: _PyEval_EvalFrameDefault + 0x6f5 (0x5632b1bb6d75 in /opt/anaconda3/bin/python)
frame #34: _PyFunction_FastCallKeywords + 0xfb (0x5632b1b5e53b in /opt/anaconda3/bin/python)
frame #35: _PyEval_EvalFrameDefault + 0x466 (0x5632b1bb6ae6 in /opt/anaconda3/bin/python)
frame #36: _PyFunction_FastCallKeywords + 0xfb (0x5632b1b5e53b in /opt/anaconda3/bin/python)
frame #37: _PyEval_EvalFrameDefault + 0x4b54 (0x5632b1bbb1d4 in /opt/anaconda3/bin/python)
frame #38: _PyEval_EvalCodeWithName + 0x2f8 (0x5632b1afba38 in /opt/anaconda3/bin/python)
frame #39: PyEval_EvalCodeEx + 0x44 (0x5632b1afc8a4 in /opt/anaconda3/bin/python)
frame #40: PyEval_EvalCode + 0x1c (0x5632b1afc8cc in /opt/anaconda3/bin/python)
frame #41: <unknown function> + 0x230f24 (0x5632b1c15f24 in /opt/anaconda3/bin/python)
frame #42: PyRun_FileExFlags + 0xa1 (0x5632b1c20111 in /opt/anaconda3/bin/python)
frame #43: PyRun_SimpleFileExFlags + 0x1c3 (0x5632b1c20303 in /opt/anaconda3/bin/python)
frame #44: <unknown function> + 0x23c41b (0x5632b1c2141b in /opt/anaconda3/bin/python)
frame #45: _Py_UnixMain + 0x3c (0x5632b1c214fc in /opt/anaconda3/bin/python)
frame #46: __libc_start_main + 0xf5 (0x7fe8f24b33d5 in /lib64/libc.so.6)
frame #47: <unknown function> + 0x1e14e2 (0x5632b1bc64e2 in /opt/anaconda3/bin/python)

It all works as expected for fp32, it also works for fp16 if matrix is slightly smaller:

torch.zeros((16*2**20 - 512)//2, 1, dtype=torch.float16, device='cuda:0') @ torch.zeros(1, 2, dtype=torch.float16, device='cuda:0')

Environment

PyTorch: 1.1.0

OS: Linux

Python version: 3.7

CUDA/cuDNN version: 10.0.130

GPU: V-100

Issue 2:
🐛 Bug

Error using the pytorch.hub API:

code:

entrypoints = torch.hub.list('pytorch/vision', force_reload=True)

Downloading: "https://github.com/pytorch/vision/archive/master.zip" to .../.cache\torch\hub\master.zip
Traceback (most recent call last):
File "..../test.py", line 2, in <module>
entrypoints = torch.hub.list('pytorch/vision', force_reload=True)
File "...\.conda\envs\hackaton\lib\site-packages\torch\hub.py", line 285, in list
hub_module = import_module(MODULE_HUBCONF, repo_dir + '/' + MODULE_HUBCONF)
File "..\.conda\envs\hackaton\lib\site-packages\torch\hub.py", line 72, in import_module
spec.loader.exec_module(module)
File "<frozen importlib._bootstrap_external>", line 678, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File ".../.cache\torch\hub\pytorch_vision_master/hubconf.py", line 4, in <module>
from torchvision.models.alexnet import alexnet
File "..../.cache\torch\hub\pytorch_vision_master\torchvision\__init__.py", line 1, in <module>
from torchvision import models
File "...../.cache\torch\hub\pytorch_vision_master\torchvision\models\__init__.py", line 6, in <module>
from .densenet import *
File "...../.cache\torch\hub\pytorch_vision_master\torchvision\models\densenet.py", line 22, in <module>
class _DenseLayer(nn.Module):
File ".../.cache\torch\hub\pytorch_vision_master\torchvision\models\densenet.py", line 52, in _DenseLayer
@torch.jit.unused # noqa: T484
AttributeError: module 'torch.jit' has no attribute 'unused'

Process finished with exit code 1

cc @ezyang @gchanan @zou3519 @ailzhang @suo