NechkaP

/

pytorch_distilbert_arxiv

like 0

• "torch.nn.modules.dropout.Dropout",
• "__main__.DistilBERTClass",
• "transformers.models.distilbert.modeling_distilbert.Transformer",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2",
• "torch.nn.modules.sparse.Embedding",
• "transformers.models.distilbert.modeling_distilbert.Embeddings",
• "transformers.models.distilbert.modeling_distilbert.MultiHeadSelfAttention",
• "torch.nn.modules.container.ModuleList",
• "transformers.models.distilbert.configuration_distilbert.DistilBertConfig",
• "__builtin__.set",
• "torch.LongStorage",
• "transformers.models.distilbert.modeling_distilbert.DistilBertModel",
• "transformers.models.distilbert.modeling_distilbert.FFN",
• "collections.OrderedDict",
• "transformers.models.distilbert.modeling_distilbert.TransformerBlock",
• "torch._C._nn.gelu",
• "torch.FloatStorage",
• "torch.nn.modules.linear.Linear",
• "torch.nn.modules.normalization.LayerNorm",
• "transformers.activations.GELUActivation"

How to fix it?