KoichiYasuoka
/

deberta-large-japanese-unidic-ud-head

Question Answering Transformers PyTorch

Japanese deberta-v2 japanese dependency-parsing Inference Endpoints

Model card Files Files and versions Community

KoichiYasuoka commited on Nov 5, 2023

Commit

0aa1640

•

1 Parent(s): fbcc304

spacy-alignments

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -51,7 +51,7 @@ class TaggerPipeline(TokenClassificationPipeline):
   def __call__(self,text):
     d=super().__call__(text)
     if len(d)>0 and ("start" not in d[0] or d[0]["start"]==None):
-      import tokenizations
       v=[x["word"].replace(" ","") for x in d]
       a2b,b2a=tokenizations.get_alignments(v,text)
       for i,t in enumerate(a2b):
@@ -113,4 +113,4 @@ nlp=TransformersSlowUD("KoichiYasuoka/deberta-large-japanese-unidic-ud-head")
 print(nlp("全学年にわたって小学校の国語の教科書に挿し絵が用いられている"))
 ```
-[fugashi](https://pypi.org/project/fugashi) [unidic-lite](https://pypi.org/project/unidic-lite) [pytokenizations](https://pypi.org/project/pytokenizations) and [ufal.chu-liu-edmonds](https://pypi.org/project/ufal.chu-liu-edmonds/) required.

   def __call__(self,text):
     d=super().__call__(text)
     if len(d)>0 and ("start" not in d[0] or d[0]["start"]==None):
+      import spacy_alignments as tokenizations
       v=[x["word"].replace(" ","") for x in d]
       a2b,b2a=tokenizations.get_alignments(v,text)
       for i,t in enumerate(a2b):
 print(nlp("全学年にわたって小学校の国語の教科書に挿し絵が用いられている"))
 ```
+[fugashi](https://pypi.org/project/fugashi) [unidic-lite](https://pypi.org/project/unidic-lite) [spacy-alignments](https://pypi.org/project/spacy-alignments) and [ufal.chu-liu-edmonds](https://pypi.org/project/ufal.chu-liu-edmonds/) required.