Spaces:

Yiqin
/

ChatVID

Paused

Yiqin commited on Jun 11, 2023

Commit

e19b610

•

1 Parent(s): 6ef31de

init

Files changed (1) hide show

model/fastchat/serve/compression.py CHANGED Viewed

@@ -28,7 +28,7 @@ class CLinear(nn.Module):
     def __init__(self, weight, bias, device):
         super().__init__()
-        self.weight = compress(weight.data.to(device), default_compression_config)
         self.bias = bias
     def forward(self, input: Tensor) -> Tensor:

     def __init__(self, weight, bias, device):
         super().__init__()
+        self.weight = compress(weight.detach().to(device), default_compression_config)
         self.bias = bias
     def forward(self, input: Tensor) -> Tensor: