KoichiYasuoka
/

roberta-classical-chinese-base-ud-goeswith

Token Classification Transformers PyTorch

Literary Chinese roberta classical chinese literary chinese ancient chinese pos dependency-parsing Inference Endpoints

Model card Files Files and versions Community

KoichiYasuoka commited on Feb 19, 2023

Commit

c23de62

•

1 Parent(s): 570fb37

bug fix

Files changed (1) hide show

maker.py +3 -2

maker.py CHANGED Viewed

@@ -14,8 +14,9 @@ class UDgoeswithDataset(object):
       dep,c="-|_|dep",[]
       for s in r:
         t=s.split("\t")
-        if len(t)==10 and t[0].isdecimal():
-          c.append(t)
         elif c!=[]:
           v=tokenizer([t[1] for t in c],add_special_tokens=False)["input_ids"]
           for i in range(len(v)-1,-1,-1):

       dep,c="-|_|dep",[]
       for s in r:
         t=s.split("\t")
+        if len(t)==10:
+          if t[0].isdecimal():
+            c.append(t)
         elif c!=[]:
           v=tokenizer([t[1] for t in c],add_special_tokens=False)["input_ids"]
           for i in range(len(v)-1,-1,-1):