Omkar008 commited on
Commit
c640a67
1 Parent(s): 50ba811

Add Core ML conversion

Browse files

Core ML conversion, task=question-answering, precision=float32

coreml/question-answering/float32_model.mlpackage/Data/com.apple.CoreML/model.mlmodel ADDED
@@ -0,0 +1,6067 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ �
2
+ L
3
+ input_ids2Indices of input sequence tokens in the vocabulary *
4
+ ���
5
+ w
6
+ attention_maskXMask to avoid performing attention on padding token indices (1 = not masked, 0 = masked) *
7
+ ���R>
8
+ start_scores!Span-start scores (after softmax) *
9
+ ���R:
10
+
11
+ end_scoresSpan-end scores (after softmax) *
12
+ �����
13
+ :distilbert-base-cased-distilled-squad (question-answering)�3
14
+ #com.github.apple.coremltools.source torch==2.0.1�+
15
+ $com.github.apple.coremltools.version7.0�F
16
+ co.huggingface.exporters.name%distilbert-base-cased-distilled-squad�3
17
+ co.huggingface.exporters.taskquestion-answering�G
18
+ %co.huggingface.exporters.architectureDistilBertForQuestionAnswering�-
19
+ "co.huggingface.exporters.frameworkpytorch�-
20
+ "co.huggingface.exporters.precisionfloat32�����
21
+ main��
22
+
23
+ input_ids
24
+ 
25
+ 
26
+ �
27
+ %
28
+ attention_mask
29
+ 
30
+ 
31
+ �CoreML5��
32
+ CoreML5�� start_scores
33
+ end_scores�
34
+ constK
35
+ 2model_distilbert_embeddings_word_embeddings_weight
36
+  
37
+ ��
38
+ �*H
39
+ name@
40
+ 8
41
+ 6"4
42
+ 2model_distilbert_embeddings_word_embeddings_weight*B
43
+ val;
44
+  
45
+ ��
46
+ �*"
47
+ @model_path/weights/weight.bin@�
48
+ const;
49
+ *model_distilbert_embeddings_LayerNorm_bias
50
+  
51
+ �*@
52
+ name8
53
+ 0
54
+ .",
55
+ *model_distilbert_embeddings_LayerNorm_bias*=
56
+ val6
57
+  
58
+ �*%
59
+ @model_path/weights/weight.bin��*�
60
+ const=
61
+ ,model_distilbert_embeddings_LayerNorm_weight
62
+  
63
+ �*B
64
+ name:
65
+ 2
66
+ 0".
67
+ ,model_distilbert_embeddings_LayerNorm_weight*=
68
+ val6
69
+  
70
+ �*%
71
+ @model_path/weights/weight.bin���*�
72
+ constJ
73
+ 9model_distilbert_transformer_layer_0_attention_q_lin_bias
74
+  
75
+ �*O
76
+ nameG
77
+ ?
78
+ =";
79
+ 9model_distilbert_transformer_layer_0_attention_q_lin_bias*=
80
+ val6
81
+  
82
+ �*%
83
+ @model_path/weights/weight.bin���*�
84
+ constS
85
+ ;model_distilbert_transformer_layer_0_attention_q_lin_weight
86
+  
87
+ �
88
+ �*Q
89
+ nameI
90
+ A
91
+ ?"=
92
+ ;model_distilbert_transformer_layer_0_attention_q_lin_weight*D
93
+ val=
94
+  
95
+ �
96
+ �*%
97
+ @model_path/weights/weight.bin���*�
98
+ constJ
99
+ 9model_distilbert_transformer_layer_0_attention_k_lin_bias
100
+  
101
+ �*O
102
+ nameG
103
+ ?
104
+ =";
105
+ 9model_distilbert_transformer_layer_0_attention_k_lin_bias*=
106
+ val6
107
+  
108
+ �*%
109
+ @model_path/weights/weight.bin���+�
110
+ constS
111
+ ;model_distilbert_transformer_layer_0_attention_k_lin_weight
112
+  
113
+ �
114
+ �*Q
115
+ nameI
116
+ A
117
+ ?"=
118
+ ;model_distilbert_transformer_layer_0_attention_k_lin_weight*D
119
+ val=
120
+  
121
+ �
122
+ �*%
123
+ @model_path/weights/weight.bin���+�
124
+ constJ
125
+ 9model_distilbert_transformer_layer_0_attention_v_lin_bias
126
+  
127
+ �*O
128
+ nameG
129
+ ?
130
+ =";
131
+ 9model_distilbert_transformer_layer_0_attention_v_lin_bias*=
132
+ val6
133
+  
134
+ �*%
135
+ @model_path/weights/weight.bin���,�
136
+ constS
137
+ ;model_distilbert_transformer_layer_0_attention_v_lin_weight
138
+  
139
+ �
140
+ �*Q
141
+ nameI
142
+ A
143
+ ?"=
144
+ ;model_distilbert_transformer_layer_0_attention_v_lin_weight*D
145
+ val=
146
+  
147
+ �
148
+ �*%
149
+ @model_path/weights/weight.bin���,�
150
+ constL
151
+ ;model_distilbert_transformer_layer_0_attention_out_lin_bias
152
+  
153
+ �*Q
154
+ nameI
155
+ A
156
+ ?"=
157
+ ;model_distilbert_transformer_layer_0_attention_out_lin_bias*=
158
+ val6
159
+  
160
+ �*%
161
+ @model_path/weights/weight.bin���-�
162
+ constU
163
+ =model_distilbert_transformer_layer_0_attention_out_lin_weight
164
+  
165
+ �
166
+ �*S
167
+ nameK
168
+ C
169
+ A"?
170
+ =model_distilbert_transformer_layer_0_attention_out_lin_weight*D
171
+ val=
172
+  
173
+ �
174
+ �*%
175
+ @model_path/weights/weight.bin���-�
176
+ constH
177
+ 7model_distilbert_transformer_layer_0_sa_layer_norm_bias
178
+  
179
+ �*M
180
+ nameE
181
+ =
182
+ ;"9
183
+ 7model_distilbert_transformer_layer_0_sa_layer_norm_bias*=
184
+ val6
185
+  
186
+ �*%
187
+ @model_path/weights/weight.bin���.�
188
+ constJ
189
+ 9model_distilbert_transformer_layer_0_sa_layer_norm_weight
190
+  
191
+ �*O
192
+ nameG
193
+ ?
194
+ =";
195
+ 9model_distilbert_transformer_layer_0_sa_layer_norm_weight*=
196
+ val6
197
+  
198
+ �*%
199
+ @model_path/weights/weight.bin���.�
200
+ constC
201
+ 2model_distilbert_transformer_layer_0_ffn_lin1_bias
202
+  
203
+ �*H
204
+ name@
205
+ 8
206
+ 6"4
207
+ 2model_distilbert_transformer_layer_0_ffn_lin1_bias*=
208
+ val6
209
+  
210
+ �*%
211
+ @model_path/weights/weight.bin���.�
212
+ constL
213
+ 4model_distilbert_transformer_layer_0_ffn_lin1_weight
214
+  
215
+ �
216
+ �*J
217
+ nameB
218
+ :
219
+ 8"6
220
+ 4model_distilbert_transformer_layer_0_ffn_lin1_weight*D
221
+ val=
222
+  
223
+ �
224
+ �*%
225
+ @model_path/weights/weight.bin���.�
226
+ constC
227
+ 2model_distilbert_transformer_layer_0_ffn_lin2_bias
228
+  
229
+ �*H
230
+ name@
231
+ 8
232
+ 6"4
233
+ 2model_distilbert_transformer_layer_0_ffn_lin2_bias*=
234
+ val6
235
+  
236
+ �*%
237
+ @model_path/weights/weight.bin���3�
238
+ constL
239
+ 4model_distilbert_transformer_layer_0_ffn_lin2_weight
240
+  
241
+ �
242
+ �*J
243
+ nameB
244
+ :
245
+ 8"6
246
+ 4model_distilbert_transformer_layer_0_ffn_lin2_weight*D
247
+ val=
248
+  
249
+ �
250
+ �*%
251
+ @model_path/weights/weight.bin���3�
252
+ constL
253
+ ;model_distilbert_transformer_layer_0_output_layer_norm_bias
254
+  
255
+ �*Q
256
+ nameI
257
+ A
258
+ ?"=
259
+ ;model_distilbert_transformer_layer_0_output_layer_norm_bias*=
260
+ val6
261
+  
262
+ �*%
263
+ @model_path/weights/weight.bin���7�
264
+ constN
265
+ =model_distilbert_transformer_layer_0_output_layer_norm_weight
266
+  
267
+ �*S
268
+ nameK
269
+ C
270
+ A"?
271
+ =model_distilbert_transformer_layer_0_output_layer_norm_weight*=
272
+ val6
273
+  
274
+ �*%
275
+ @model_path/weights/weight.bin���7�
276
+ constJ
277
+ 9model_distilbert_transformer_layer_1_attention_q_lin_bias
278
+  
279
+ �*O
280
+ nameG
281
+ ?
282
+ =";
283
+ 9model_distilbert_transformer_layer_1_attention_q_lin_bias*=
284
+ val6
285
+  
286
+ �*%
287
+ @model_path/weights/weight.bin���7�
288
+ constS
289
+ ;model_distilbert_transformer_layer_1_attention_q_lin_weight
290
+  
291
+ �
292
+ �*Q
293
+ nameI
294
+ A
295
+ ?"=
296
+ ;model_distilbert_transformer_layer_1_attention_q_lin_weight*D
297
+ val=
298
+  
299
+ �
300
+ �*%
301
+ @model_path/weights/weight.bin���7�
302
+ constJ
303
+ 9model_distilbert_transformer_layer_1_attention_k_lin_bias
304
+  
305
+ �*O
306
+ nameG
307
+ ?
308
+ =";
309
+ 9model_distilbert_transformer_layer_1_attention_k_lin_bias*=
310
+ val6
311
+  
312
+ �*%
313
+ @model_path/weights/weight.bin��9�
314
+ constS
315
+ ;model_distilbert_transformer_layer_1_attention_k_lin_weight
316
+  
317
+ �
318
+ �*Q
319
+ nameI
320
+ A
321
+ ?"=
322
+ ;model_distilbert_transformer_layer_1_attention_k_lin_weight*D
323
+ val=
324
+  
325
+ �
326
+ �*%
327
+ @model_path/weights/weight.bin���9�
328
+ constJ
329
+ 9model_distilbert_transformer_layer_1_attention_v_lin_bias
330
+  
331
+ �*O
332
+ nameG
333
+ ?
334
+ =";
335
+ 9model_distilbert_transformer_layer_1_attention_v_lin_bias*=
336
+ val6
337
+  
338
+ �*%
339
+ @model_path/weights/weight.bin���:�
340
+ constS
341
+ ;model_distilbert_transformer_layer_1_attention_v_lin_weight
342
+  
343
+ �
344
+ �*Q
345
+ nameI
346
+ A
347
+ ?"=
348
+ ;model_distilbert_transformer_layer_1_attention_v_lin_weight*D
349
+ val=
350
+  
351
+ �
352
+ �*%
353
+ @model_path/weights/weight.bin���:�
354
+ constL
355
+ ;model_distilbert_transformer_layer_1_attention_out_lin_bias
356
+  
357
+ �*Q
358
+ nameI
359
+ A
360
+ ?"=
361
+ ;model_distilbert_transformer_layer_1_attention_out_lin_bias*=
362
+ val6
363
+  
364
+ �*%
365
+ @model_path/weights/weight.bin���;�
366
+ constU
367
+ =model_distilbert_transformer_layer_1_attention_out_lin_weight
368
+  
369
+ �
370
+ �*S
371
+ nameK
372
+ C
373
+ A"?
374
+ =model_distilbert_transformer_layer_1_attention_out_lin_weight*D
375
+ val=
376
+  
377
+ �
378
+ �*%
379
+ @model_path/weights/weight.bin���;�
380
+ constH
381
+ 7model_distilbert_transformer_layer_1_sa_layer_norm_bias
382
+  
383
+ �*M
384
+ nameE
385
+ =
386
+ ;"9
387
+ 7model_distilbert_transformer_layer_1_sa_layer_norm_bias*=
388
+ val6
389
+  
390
+ �*%
391
+ @model_path/weights/weight.bin���<�
392
+ constJ
393
+ 9model_distilbert_transformer_layer_1_sa_layer_norm_weight
394
+  
395
+ �*O
396
+ nameG
397
+ ?
398
+ =";
399
+ 9model_distilbert_transformer_layer_1_sa_layer_norm_weight*=
400
+ val6
401
+  
402
+ �*%
403
+ @model_path/weights/weight.bin���<�
404
+ constC
405
+ 2model_distilbert_transformer_layer_1_ffn_lin1_bias
406
+  
407
+ �*H
408
+ name@
409
+ 8
410
+ 6"4
411
+ 2model_distilbert_transformer_layer_1_ffn_lin1_bias*=
412
+ val6
413
+  
414
+ �*%
415
+ @model_path/weights/weight.bin���<�
416
+ constL
417
+ 4model_distilbert_transformer_layer_1_ffn_lin1_weight
418
+  
419
+ �
420
+ �*J
421
+ nameB
422
+ :
423
+ 8"6
424
+ 4model_distilbert_transformer_layer_1_ffn_lin1_weight*D
425
+ val=
426
+  
427
+ �
428
+ �*%
429
+ @model_path/weights/weight.bin���<�
430
+ constC
431
+ 2model_distilbert_transformer_layer_1_ffn_lin2_bias
432
+  
433
+ �*H
434
+ name@
435
+ 8
436
+ 6"4
437
+ 2model_distilbert_transformer_layer_1_ffn_lin2_bias*=
438
+ val6
439
+  
440
+ �*%
441
+ @model_path/weights/weight.bin�ȁA�
442
+ constL
443
+ 4model_distilbert_transformer_layer_1_ffn_lin2_weight
444
+  
445
+ �
446
+ �*J
447
+ nameB
448
+ :
449
+ 8"6
450
+ 4model_distilbert_transformer_layer_1_ffn_lin2_weight*D
451
+ val=
452
+  
453
+ �
454
+ �*%
455
+ @model_path/weights/weight.bin���A�
456
+ constL
457
+ ;model_distilbert_transformer_layer_1_output_layer_norm_bias
458
+  
459
+ �*Q
460
+ nameI
461
+ A
462
+ ?"=
463
+ ;model_distilbert_transformer_layer_1_output_layer_norm_bias*=
464
+ val6
465
+  
466
+ �*%
467
+ @model_path/weights/weight.bin���E�
468
+ constN
469
+ =model_distilbert_transformer_layer_1_output_layer_norm_weight
470
+  
471
+ �*S
472
+ nameK
473
+ C
474
+ A"?
475
+ =model_distilbert_transformer_layer_1_output_layer_norm_weight*=
476
+ val6
477
+  
478
+ �*%
479
+ @model_path/weights/weight.bin���E�
480
+ constJ
481
+ 9model_distilbert_transformer_layer_2_attention_q_lin_bias
482
+  
483
+ �*O
484
+ nameG
485
+ ?
486
+ =";
487
+ 9model_distilbert_transformer_layer_2_attention_q_lin_bias*=
488
+ val6
489
+  
490
+ �*%
491
+ @model_path/weights/weight.bin���E�
492
+ constS
493
+ ;model_distilbert_transformer_layer_2_attention_q_lin_weight
494
+  
495
+ �
496
+ �*Q
497
+ nameI
498
+ A
499
+ ?"=
500
+ ;model_distilbert_transformer_layer_2_attention_q_lin_weight*D
501
+ val=
502
+  
503
+ �
504
+ �*%
505
+ @model_path/weights/weight.bin���E�
506
+ constJ
507
+ 9model_distilbert_transformer_layer_2_attention_k_lin_bias
508
+  
509
+ �*O
510
+ nameG
511
+ ?
512
+ =";
513
+ 9model_distilbert_transformer_layer_2_attention_k_lin_bias*=
514
+ val6
515
+  
516
+ �*%
517
+ @model_path/weights/weight.bin���F�
518
+ constS
519
+ ;model_distilbert_transformer_layer_2_attention_k_lin_weight
520
+  
521
+ �
522
+ �*Q
523
+ nameI
524
+ A
525
+ ?"=
526
+ ;model_distilbert_transformer_layer_2_attention_k_lin_weight*D
527
+ val=
528
+  
529
+ �
530
+ �*%
531
+ @model_path/weights/weight.bin���F�
532
+ constJ
533
+ 9model_distilbert_transformer_layer_2_attention_v_lin_bias
534
+  
535
+ �*O
536
+ nameG
537
+ ?
538
+ =";
539
+ 9model_distilbert_transformer_layer_2_attention_v_lin_bias*=
540
+ val6
541
+  
542
+ �*%
543
+ @model_path/weights/weight.bin���G�
544
+ constS
545
+ ;model_distilbert_transformer_layer_2_attention_v_lin_weight
546
+  
547
+ �
548
+ �*Q
549
+ nameI
550
+ A
551
+ ?"=
552
+ ;model_distilbert_transformer_layer_2_attention_v_lin_weight*D
553
+ val=
554
+  
555
+ �
556
+ �*%
557
+ @model_path/weights/weight.bin���G�
558
+ constL
559
+ ;model_distilbert_transformer_layer_2_attention_out_lin_bias
560
+  
561
+ �*Q
562
+ nameI
563
+ A
564
+ ?"=
565
+ ;model_distilbert_transformer_layer_2_attention_out_lin_bias*=
566
+ val6
567
+  
568
+ �*%
569
+ @model_path/weights/weight.bin���H�
570
+ constU
571
+ =model_distilbert_transformer_layer_2_attention_out_lin_weight
572
+  
573
+ �
574
+ �*S
575
+ nameK
576
+ C
577
+ A"?
578
+ =model_distilbert_transformer_layer_2_attention_out_lin_weight*D
579
+ val=
580
+  
581
+ �
582
+ �*%
583
+ @model_path/weights/weight.bin���H�
584
+ constH
585
+ 7model_distilbert_transformer_layer_2_sa_layer_norm_bias
586
+  
587
+ �*M
588
+ nameE
589
+ =
590
+ ;"9
591
+ 7model_distilbert_transformer_layer_2_sa_layer_norm_bias*=
592
+ val6
593
+  
594
+ �*%
595
+ @model_path/weights/weight.bin���J�
596
+ constJ
597
+ 9model_distilbert_transformer_layer_2_sa_layer_norm_weight
598
+  
599
+ �*O
600
+ nameG
601
+ ?
602
+ =";
603
+ 9model_distilbert_transformer_layer_2_sa_layer_norm_weight*=
604
+ val6
605
+  
606
+ �*%
607
+ @model_path/weights/weight.bin���J�
608
+ constC
609
+ 2model_distilbert_transformer_layer_2_ffn_lin1_bias
610
+  
611
+ �*H
612
+ name@
613
+ 8
614
+ 6"4
615
+ 2model_distilbert_transformer_layer_2_ffn_lin1_bias*=
616
+ val6
617
+  
618
+ �*%
619
+ @model_path/weights/weight.bin���J�
620
+ constL
621
+ 4model_distilbert_transformer_layer_2_ffn_lin1_weight
622
+  
623
+ �
624
+ �*J
625
+ nameB
626
+ :
627
+ 8"6
628
+ 4model_distilbert_transformer_layer_2_ffn_lin1_weight*D
629
+ val=
630
+  
631
+ �
632
+ �*%
633
+ @model_path/weights/weight.bin���J�
634
+ constC
635
+ 2model_distilbert_transformer_layer_2_ffn_lin2_bias
636
+  
637
+ �*H
638
+ name@
639
+ 8
640
+ 6"4
641
+ 2model_distilbert_transformer_layer_2_ffn_lin2_bias*=
642
+ val6
643
+  
644
+ �*%
645
+ @model_path/weights/weight.bin���N�
646
+ constL
647
+ 4model_distilbert_transformer_layer_2_ffn_lin2_weight
648
+  
649
+ �
650
+ �*J
651
+ nameB
652
+ :
653
+ 8"6
654
+ 4model_distilbert_transformer_layer_2_ffn_lin2_weight*D
655
+ val=
656
+  
657
+ �
658
+ �*%
659
+ @model_path/weights/weight.bin���N�
660
+ constL
661
+ ;model_distilbert_transformer_layer_2_output_layer_norm_bias
662
+  
663
+ �*Q
664
+ nameI
665
+ A
666
+ ?"=
667
+ ;model_distilbert_transformer_layer_2_output_layer_norm_bias*=
668
+ val6
669
+  
670
+ �*%
671
+ @model_path/weights/weight.bin���S�
672
+ constN
673
+ =model_distilbert_transformer_layer_2_output_layer_norm_weight
674
+  
675
+ �*S
676
+ nameK
677
+ C
678
+ A"?
679
+ =model_distilbert_transformer_layer_2_output_layer_norm_weight*=
680
+ val6
681
+  
682
+ �*%
683
+ @model_path/weights/weight.bin���S�
684
+ constJ
685
+ 9model_distilbert_transformer_layer_3_attention_q_lin_bias
686
+  
687
+ �*O
688
+ nameG
689
+ ?
690
+ =";
691
+ 9model_distilbert_transformer_layer_3_attention_q_lin_bias*=
692
+ val6
693
+  
694
+ �*%
695
+ @model_path/weights/weight.bin�҄S�
696
+ constS
697
+ ;model_distilbert_transformer_layer_3_attention_q_lin_weight
698
+  
699
+ �
700
+ �*Q
701
+ nameI
702
+ A
703
+ ?"=
704
+ ;model_distilbert_transformer_layer_3_attention_q_lin_weight*D
705
+ val=
706
+  
707
+ �
708
+ �*%
709
+ @model_path/weights/weight.bin��S�
710
+ constJ
711
+ 9model_distilbert_transformer_layer_3_attention_k_lin_bias
712
+  
713
+ �*O
714
+ nameG
715
+ ?
716
+ =";
717
+ 9model_distilbert_transformer_layer_3_attention_k_lin_bias*=
718
+ val6
719
+  
720
+ �*%
721
+ @model_path/weights/weight.bin��T�
722
+ constS
723
+ ;model_distilbert_transformer_layer_3_attention_k_lin_weight
724
+  
725
+ �
726
+ �*Q
727
+ nameI
728
+ A
729
+ ?"=
730
+ ;model_distilbert_transformer_layer_3_attention_k_lin_weight*D
731
+ val=
732
+  
733
+ �
734
+ �*%
735
+ @model_path/weights/weight.bin���T�
736
+ constJ
737
+ 9model_distilbert_transformer_layer_3_attention_v_lin_bias
738
+  
739
+ �*O
740
+ nameG
741
+ ?
742
+ =";
743
+ 9model_distilbert_transformer_layer_3_attention_v_lin_bias*=
744
+ val6
745
+  
746
+ �*%
747
+ @model_path/weights/weight.bin���U�
748
+ constS
749
+ ;model_distilbert_transformer_layer_3_attention_v_lin_weight
750
+  
751
+ �
752
+ �*Q
753
+ nameI
754
+ A
755
+ ?"=
756
+ ;model_distilbert_transformer_layer_3_attention_v_lin_weight*D
757
+ val=
758
+  
759
+ �
760
+ �*%
761
+ @model_path/weights/weight.bin���U�
762
+ constL
763
+ ;model_distilbert_transformer_layer_3_attention_out_lin_bias
764
+  
765
+ �*Q
766
+ nameI
767
+ A
768
+ ?"=
769
+ ;model_distilbert_transformer_layer_3_attention_out_lin_bias*=
770
+ val6
771
+  
772
+ �*%
773
+ @model_path/weights/weight.bin���V�
774
+ constU
775
+ =model_distilbert_transformer_layer_3_attention_out_lin_weight
776
+  
777
+ �
778
+ �*S
779
+ nameK
780
+ C
781
+ A"?
782
+ =model_distilbert_transformer_layer_3_attention_out_lin_weight*D
783
+ val=
784
+  
785
+ �
786
+ �*%
787
+ @model_path/weights/weight.bin���V�
788
+ constH
789
+ 7model_distilbert_transformer_layer_3_sa_layer_norm_bias
790
+  
791
+ �*M
792
+ nameE
793
+ =
794
+ ;"9
795
+ 7model_distilbert_transformer_layer_3_sa_layer_norm_bias*=
796
+ val6
797
+  
798
+ �*%
799
+ @model_path/weights/weight.bin���W�
800
+ constJ
801
+ 9model_distilbert_transformer_layer_3_sa_layer_norm_weight
802
+  
803
+ �*O
804
+ nameG
805
+ ?
806
+ =";
807
+ 9model_distilbert_transformer_layer_3_sa_layer_norm_weight*=
808
+ val6
809
+  
810
+ �*%
811
+ @model_path/weights/weight.bin���W�
812
+ constC
813
+ 2model_distilbert_transformer_layer_3_ffn_lin1_bias
814
+  
815
+ �*H
816
+ name@
817
+ 8
818
+ 6"4
819
+ 2model_distilbert_transformer_layer_3_ffn_lin1_bias*=
820
+ val6
821
+  
822
+ �*%
823
+ @model_path/weights/weight.bin���W�
824
+ constL
825
+ 4model_distilbert_transformer_layer_3_ffn_lin1_weight
826
+  
827
+ �
828
+ �*J
829
+ nameB
830
+ :
831
+ 8"6
832
+ 4model_distilbert_transformer_layer_3_ffn_lin1_weight*D
833
+ val=
834
+  
835
+ �
836
+ �*%
837
+ @model_path/weights/weight.bin���W�
838
+ constC
839
+ 2model_distilbert_transformer_layer_3_ffn_lin2_bias
840
+  
841
+ �*H
842
+ name@
843
+ 8
844
+ 6"4
845
+ 2model_distilbert_transformer_layer_3_ffn_lin2_bias*=
846
+ val6
847
+  
848
+ �*%
849
+ @model_path/weights/weight.bin�Ȇ\�
850
+ constL
851
+ 4model_distilbert_transformer_layer_3_ffn_lin2_weight
852
+  
853
+ �
854
+ �*J
855
+ nameB
856
+ :
857
+ 8"6
858
+ 4model_distilbert_transformer_layer_3_ffn_lin2_weight*D
859
+ val=
860
+  
861
+ �
862
+ �*%
863
+ @model_path/weights/weight.bin���\�
864
+ constL
865
+ ;model_distilbert_transformer_layer_3_output_layer_norm_bias
866
+  
867
+ �*Q
868
+ nameI
869
+ A
870
+ ?"=
871
+ ;model_distilbert_transformer_layer_3_output_layer_norm_bias*=
872
+ val6
873
+  
874
+ �*%
875
+ @model_path/weights/weight.bin���`�
876
+ constN
877
+ =model_distilbert_transformer_layer_3_output_layer_norm_weight
878
+  
879
+ �*S
880
+ nameK
881
+ C
882
+ A"?
883
+ =model_distilbert_transformer_layer_3_output_layer_norm_weight*=
884
+ val6
885
+  
886
+ �*%
887
+ @model_path/weights/weight.bin���`�
888
+ constJ
889
+ 9model_distilbert_transformer_layer_4_attention_q_lin_bias
890
+  
891
+ �*O
892
+ nameG
893
+ ?
894
+ =";
895
+ 9model_distilbert_transformer_layer_4_attention_q_lin_bias*=
896
+ val6
897
+  
898
+ �*%
899
+ @model_path/weights/weight.bin���`�
900
+ constS
901
+ ;model_distilbert_transformer_layer_4_attention_q_lin_weight
902
+  
903
+ �
904
+ �*Q
905
+ nameI
906
+ A
907
+ ?"=
908
+ ;model_distilbert_transformer_layer_4_attention_q_lin_weight*D
909
+ val=
910
+  
911
+ �
912
+ �*%
913
+ @model_path/weights/weight.bin���`�
914
+ constJ
915
+ 9model_distilbert_transformer_layer_4_attention_k_lin_bias
916
+  
917
+ �*O
918
+ nameG
919
+ ?
920
+ =";
921
+ 9model_distilbert_transformer_layer_4_attention_k_lin_bias*=
922
+ val6
923
+  
924
+ �*%
925
+ @model_path/weights/weight.bin���a�
926
+ constS
927
+ ;model_distilbert_transformer_layer_4_attention_k_lin_weight
928
+  
929
+ �
930
+ �*Q
931
+ nameI
932
+ A
933
+ ?"=
934
+ ;model_distilbert_transformer_layer_4_attention_k_lin_weight*D
935
+ val=
936
+  
937
+ �
938
+ �*%
939
+ @model_path/weights/weight.bin���a�
940
+ constJ
941
+ 9model_distilbert_transformer_layer_4_attention_v_lin_bias
942
+  
943
+ �*O
944
+ nameG
945
+ ?
946
+ =";
947
+ 9model_distilbert_transformer_layer_4_attention_v_lin_bias*=
948
+ val6
949
+  
950
+ �*%
951
+ @model_path/weights/weight.bin���b�
952
+ constS
953
+ ;model_distilbert_transformer_layer_4_attention_v_lin_weight
954
+  
955
+ �
956
+ �*Q
957
+ nameI
958
+ A
959
+ ?"=
960
+ ;model_distilbert_transformer_layer_4_attention_v_lin_weight*D
961
+ val=
962
+  
963
+ �
964
+ �*%
965
+ @model_path/weights/weight.bin���b�
966
+ constL
967
+ ;model_distilbert_transformer_layer_4_attention_out_lin_bias
968
+  
969
+ �*Q
970
+ nameI
971
+ A
972
+ ?"=
973
+ ;model_distilbert_transformer_layer_4_attention_out_lin_bias*=
974
+ val6
975
+  
976
+ �*%
977
+ @model_path/weights/weight.bin���c�
978
+ constU
979
+ =model_distilbert_transformer_layer_4_attention_out_lin_weight
980
+  
981
+ �
982
+ �*S
983
+ nameK
984
+ C
985
+ A"?
986
+ =model_distilbert_transformer_layer_4_attention_out_lin_weight*D
987
+ val=
988
+  
989
+ �
990
+ �*%
991
+ @model_path/weights/weight.bin���c�
992
+ constH
993
+ 7model_distilbert_transformer_layer_4_sa_layer_norm_bias
994
+  
995
+ �*M
996
+ nameE
997
+ =
998
+ ;"9
999
+ 7model_distilbert_transformer_layer_4_sa_layer_norm_bias*=
1000
+ val6
1001
+  
1002
+ �*%
1003
+ @model_path/weights/weight.bin���e�
1004
+ constJ
1005
+ 9model_distilbert_transformer_layer_4_sa_layer_norm_weight
1006
+  
1007
+ �*O
1008
+ nameG
1009
+ ?
1010
+ =";
1011
+ 9model_distilbert_transformer_layer_4_sa_layer_norm_weight*=
1012
+ val6
1013
+  
1014
+ �*%
1015
+ @model_path/weights/weight.bin���e�
1016
+ constC
1017
+ 2model_distilbert_transformer_layer_4_ffn_lin1_bias
1018
+  
1019
+ �*H
1020
+ name@
1021
+ 8
1022
+ 6"4
1023
+ 2model_distilbert_transformer_layer_4_ffn_lin1_bias*=
1024
+ val6
1025
+  
1026
+ �*%
1027
+ @model_path/weights/weight.bin���e�
1028
+ constL
1029
+ 4model_distilbert_transformer_layer_4_ffn_lin1_weight
1030
+  
1031
+ �
1032
+ �*J
1033
+ nameB
1034
+ :
1035
+ 8"6
1036
+ 4model_distilbert_transformer_layer_4_ffn_lin1_weight*D
1037
+ val=
1038
+  
1039
+ �
1040
+ �*%
1041
+ @model_path/weights/weight.bin���e�
1042
+ constC
1043
+ 2model_distilbert_transformer_layer_4_ffn_lin2_bias
1044
+  
1045
+ �*H
1046
+ name@
1047
+ 8
1048
+ 6"4
1049
+ 2model_distilbert_transformer_layer_4_ffn_lin2_bias*=
1050
+ val6
1051
+  
1052
+ �*%
1053
+ @model_path/weights/weight.bin���i�
1054
+ constL
1055
+ 4model_distilbert_transformer_layer_4_ffn_lin2_weight
1056
+  
1057
+ �
1058
+ �*J
1059
+ nameB
1060
+ :
1061
+ 8"6
1062
+ 4model_distilbert_transformer_layer_4_ffn_lin2_weight*D
1063
+ val=
1064
+  
1065
+ �
1066
+ �*%
1067
+ @model_path/weights/weight.bin���i�
1068
+ constL
1069
+ ;model_distilbert_transformer_layer_4_output_layer_norm_bias
1070
+  
1071
+ �*Q
1072
+ nameI
1073
+ A
1074
+ ?"=
1075
+ ;model_distilbert_transformer_layer_4_output_layer_norm_bias*=
1076
+ val6
1077
+  
1078
+ �*%
1079
+ @model_path/weights/weight.bin���n�
1080
+ constN
1081
+ =model_distilbert_transformer_layer_4_output_layer_norm_weight
1082
+  
1083
+ �*S
1084
+ nameK
1085
+ C
1086
+ A"?
1087
+ =model_distilbert_transformer_layer_4_output_layer_norm_weight*=
1088
+ val6
1089
+  
1090
+ �*%
1091
+ @model_path/weights/weight.bin���n�
1092
+ constJ
1093
+ 9model_distilbert_transformer_layer_5_attention_q_lin_bias
1094
+  
1095
+ �*O
1096
+ nameG
1097
+ ?
1098
+ =";
1099
+ 9model_distilbert_transformer_layer_5_attention_q_lin_bias*=
1100
+ val6
1101
+  
1102
+ �*%
1103
+ @model_path/weights/weight.bin�҉n�
1104
+ constS
1105
+ ;model_distilbert_transformer_layer_5_attention_q_lin_weight
1106
+  
1107
+ �
1108
+ �*Q
1109
+ nameI
1110
+ A
1111
+ ?"=
1112
+ ;model_distilbert_transformer_layer_5_attention_q_lin_weight*D
1113
+ val=
1114
+  
1115
+ �
1116
+ �*%
1117
+ @model_path/weights/weight.bin��n�
1118
+ constJ
1119
+ 9model_distilbert_transformer_layer_5_attention_k_lin_bias
1120
+  
1121
+ �*O
1122
+ nameG
1123
+ ?
1124
+ =";
1125
+ 9model_distilbert_transformer_layer_5_attention_k_lin_bias*=
1126
+ val6
1127
+  
1128
+ �*%
1129
+ @model_path/weights/weight.bin��o�
1130
+ constS
1131
+ ;model_distilbert_transformer_layer_5_attention_k_lin_weight
1132
+  
1133
+ �
1134
+ �*Q
1135
+ nameI
1136
+ A
1137
+ ?"=
1138
+ ;model_distilbert_transformer_layer_5_attention_k_lin_weight*D
1139
+ val=
1140
+  
1141
+ �
1142
+ �*%
1143
+ @model_path/weights/weight.bin���o�
1144
+ constJ
1145
+ 9model_distilbert_transformer_layer_5_attention_v_lin_bias
1146
+  
1147
+ �*O
1148
+ nameG
1149
+ ?
1150
+ =";
1151
+ 9model_distilbert_transformer_layer_5_attention_v_lin_bias*=
1152
+ val6
1153
+  
1154
+ �*%
1155
+ @model_path/weights/weight.bin���p�
1156
+ constS
1157
+ ;model_distilbert_transformer_layer_5_attention_v_lin_weight
1158
+  
1159
+ �
1160
+ �*Q
1161
+ nameI
1162
+ A
1163
+ ?"=
1164
+ ;model_distilbert_transformer_layer_5_attention_v_lin_weight*D
1165
+ val=
1166
+  
1167
+ �
1168
+ �*%
1169
+ @model_path/weights/weight.bin���p�
1170
+ constL
1171
+ ;model_distilbert_transformer_layer_5_attention_out_lin_bias
1172
+  
1173
+ �*Q
1174
+ nameI
1175
+ A
1176
+ ?"=
1177
+ ;model_distilbert_transformer_layer_5_attention_out_lin_bias*=
1178
+ val6
1179
+  
1180
+ �*%
1181
+ @model_path/weights/weight.bin���q�
1182
+ constU
1183
+ =model_distilbert_transformer_layer_5_attention_out_lin_weight
1184
+  
1185
+ �
1186
+ �*S
1187
+ nameK
1188
+ C
1189
+ A"?
1190
+ =model_distilbert_transformer_layer_5_attention_out_lin_weight*D
1191
+ val=
1192
+  
1193
+ �
1194
+ �*%
1195
+ @model_path/weights/weight.bin���q�
1196
+ constH
1197
+ 7model_distilbert_transformer_layer_5_sa_layer_norm_bias
1198
+  
1199
+ �*M
1200
+ nameE
1201
+ =
1202
+ ;"9
1203
+ 7model_distilbert_transformer_layer_5_sa_layer_norm_bias*=
1204
+ val6
1205
+  
1206
+ �*%
1207
+ @model_path/weights/weight.bin���r�
1208
+ constJ
1209
+ 9model_distilbert_transformer_layer_5_sa_layer_norm_weight
1210
+  
1211
+ �*O
1212
+ nameG
1213
+ ?
1214
+ =";
1215
+ 9model_distilbert_transformer_layer_5_sa_layer_norm_weight*=
1216
+ val6
1217
+  
1218
+ �*%
1219
+ @model_path/weights/weight.bin���r�
1220
+ constC
1221
+ 2model_distilbert_transformer_layer_5_ffn_lin1_bias
1222
+  
1223
+ �*H
1224
+ name@
1225
+ 8
1226
+ 6"4
1227
+ 2model_distilbert_transformer_layer_5_ffn_lin1_bias*=
1228
+ val6
1229
+  
1230
+ �*%
1231
+ @model_path/weights/weight.bin���r�
1232
+ constL
1233
+ 4model_distilbert_transformer_layer_5_ffn_lin1_weight
1234
+  
1235
+ �
1236
+ �*J
1237
+ nameB
1238
+ :
1239
+ 8"6
1240
+ 4model_distilbert_transformer_layer_5_ffn_lin1_weight*D
1241
+ val=
1242
+  
1243
+ �
1244
+ �*%
1245
+ @model_path/weights/weight.bin���r�
1246
+ constC
1247
+ 2model_distilbert_transformer_layer_5_ffn_lin2_bias
1248
+  
1249
+ �*H
1250
+ name@
1251
+ 8
1252
+ 6"4
1253
+ 2model_distilbert_transformer_layer_5_ffn_lin2_bias*=
1254
+ val6
1255
+  
1256
+ �*%
1257
+ @model_path/weights/weight.bin�ȋw�
1258
+ constL
1259
+ 4model_distilbert_transformer_layer_5_ffn_lin2_weight
1260
+  
1261
+ �
1262
+ �*J
1263
+ nameB
1264
+ :
1265
+ 8"6
1266
+ 4model_distilbert_transformer_layer_5_ffn_lin2_weight*D
1267
+ val=
1268
+  
1269
+ �
1270
+ �*%
1271
+ @model_path/weights/weight.bin���w�
1272
+ constL
1273
+ ;model_distilbert_transformer_layer_5_output_layer_norm_bias
1274
+  
1275
+ �*Q
1276
+ nameI
1277
+ A
1278
+ ?"=
1279
+ ;model_distilbert_transformer_layer_5_output_layer_norm_bias*=
1280
+ val6
1281
+  
1282
+ �*%
1283
+ @model_path/weights/weight.bin���{�
1284
+ constN
1285
+ =model_distilbert_transformer_layer_5_output_layer_norm_weight
1286
+  
1287
+ �*S
1288
+ nameK
1289
+ C
1290
+ A"?
1291
+ =model_distilbert_transformer_layer_5_output_layer_norm_weight*=
1292
+ val6
1293
+  
1294
+ �*%
1295
+ @model_path/weights/weight.bin���{�
1296
+ const%
1297
+ model_qa_outputs_bias
1298
+
1299
+  
1300
+ *+
1301
+ name#
1302
+ 
1303
+ "
1304
+ model_qa_outputs_bias*%
1305
+ val
1306
+
1307
+  
1308
+ 
1309
+
1310
+
1311
+
1312
+ (���E͸�
1313
+ const.
1314
+ model_qa_outputs_weight
1315
+  
1316
+ 
1317
+ �*-
1318
+ name%
1319
+ 
1320
+ "
1321
+ model_qa_outputs_weight*C
1322
+ val<
1323
+  
1324
+ 
1325
+ �*%
1326
+ @model_path/weights/weight.bin���{M
1327
+ const
1328
+ var_6
1329
+  *
1330
+ name
1331
+ 
1332
+
1333
+ "
1334
+ op_6*
1335
+ val
1336
+  
1337
+
1338
+ 
1339
+ 
1340
+ ̼�+S
1341
+ const
1342
+ var_8
1343
+ *
1344
+ name
1345
+ 
1346
+
1347
+ "
1348
+ op_8*
1349
+ val
1350
+ 
1351
+ 
1352
+
1353
+ ���������L
1354
+ const
1355
+ var_11
1356
+ *
1357
+ name
1358
+ 
1359
+ "
1360
+ op_11*
1361
+ val
1362
+ 
1363
+ 
1364
+ g
1365
+ const
1366
+ input_embeds_axis_0
1367
+ *)
1368
+ name!
1369
+ 
1370
+ "
1371
+ input_embeds_axis_0*
1372
+ val
1373
+ 
1374
+ 
1375
+ �
1376
+ gather;
1377
+ x6
1378
+ 4
1379
+ 2model_distilbert_embeddings_word_embeddings_weight
1380
+ indices
1381
+
1382
+ input_ids
1383
+ axis
1384
+ 
1385
+ input_embeds_axis_0*
1386
+ input_embeds
1387
+  
1388
+ 
1389
+ �
1390
+ �*"
1391
+ name
1392
+ 
1393
+ "
1394
+ input_embeds�
1395
+ const3
1396
+ position_embeddings_1
1397
+  
1398
+ 
1399
+ �
1400
+ �*+
1401
+ name#
1402
+ 
1403
+ "
1404
+ position_embeddings_1*J
1405
+ valC
1406
+  
1407
+ 
1408
+ �
1409
+ �*%
1410
+ @model_path/weights/weight.bin���{�
1411
+ add
1412
+ x
1413
+ 
1414
+ input_embeds
1415
+ y
1416
+ 
1417
+ position_embeddings_1%
1418
+ input_3
1419
+  
1420
+ 
1421
+ �
1422
+ �*
1423
+ name
1424
+ 
1425
+ "
1426
+ input_3v
1427
+ const
1428
+ input_5_axes_0
1429
+
1430
+ 
1431
+ *$
1432
+ name
1433
+ 
1434
+ "
1435
+ input_5_axes_0*'
1436
+ val 
1437
+
1438
+ 
1439
+ 
1440
+ 
1441
+
1442
+ ����������
1443
+
1444
+ layer_norm
1445
+ x
1446
+
1447
+ input_3
1448
+ axes
1449
+ 
1450
+ input_5_axes_09
1451
+ gamma0
1452
+ .
1453
+ ,model_distilbert_embeddings_LayerNorm_weight6
1454
+ beta.
1455
+ ,
1456
+ *model_distilbert_embeddings_LayerNorm_bias
1457
+ epsilon
1458
+ 
1459
+ var_6%
1460
+ input_5
1461
+  
1462
+ 
1463
+ �
1464
+ �*
1465
+ name
1466
+ 
1467
+ "
1468
+ input_5�
1469
+ linear
1470
+ x
1471
+
1472
+ input_5I
1473
+ weight?
1474
+ =
1475
+ ;model_distilbert_transformer_layer_0_attention_q_lin_weightE
1476
+ bias=
1477
+ ;
1478
+ 9model_distilbert_transformer_layer_0_attention_q_lin_bias&
1479
+ linear_0
1480
+  
1481
+ 
1482
+ �
1483
+ �*
1484
+ name
1485
+ 
1486
+ "
1487
+
1488
+ linear_0h
1489
+ const
1490
+ var_68
1491
+
1492
+ 
1493
+ *
1494
+ name
1495
+ 
1496
+ "
1497
+ op_68**
1498
+ val#
1499
+
1500
+ 
1501
+ 
1502
+ 
1503
+
1504
+ reshape
1505
+ x
1506
+
1507
+
1508
+ linear_0
1509
+ shape
1510
+
1511
+ 
1512
+ var_68)
1513
+ var_69
1514
+  
1515
+ 
1516
+ �
1517
+  
1518
+ @*
1519
+ name
1520
+ 
1521
+ "
1522
+ op_69�
1523
+ linear
1524
+ x
1525
+
1526
+ input_5I
1527
+ weight?
1528
+ =
1529
+ ;model_distilbert_transformer_layer_0_attention_k_lin_weightE
1530
+ bias=
1531
+ ;
1532
+ 9model_distilbert_transformer_layer_0_attention_k_lin_bias&
1533
+ linear_1
1534
+  
1535
+ 
1536
+ �
1537
+ �*
1538
+ name
1539
+ 
1540
+ "
1541
+
1542
+ linear_1h
1543
+ const
1544
+ var_74
1545
+
1546
+ 
1547
+ *
1548
+ name
1549
+ 
1550
+ "
1551
+ op_74**
1552
+ val#
1553
+
1554
+ 
1555
+ 
1556
+ 
1557
+
1558
+ reshape
1559
+ x
1560
+
1561
+
1562
+ linear_1
1563
+ shape
1564
+
1565
+ 
1566
+ var_74)
1567
+ var_75
1568
+  
1569
+ 
1570
+ �
1571
+  
1572
+ @*
1573
+ name
1574
+ 
1575
+ "
1576
+ op_75�
1577
+ linear
1578
+ x
1579
+
1580
+ input_5I
1581
+ weight?
1582
+ =
1583
+ ;model_distilbert_transformer_layer_0_attention_v_lin_weightE
1584
+ bias=
1585
+ ;
1586
+ 9model_distilbert_transformer_layer_0_attention_v_lin_bias&
1587
+ linear_2
1588
+  
1589
+ 
1590
+ �
1591
+ �*
1592
+ name
1593
+ 
1594
+ "
1595
+
1596
+ linear_2h
1597
+ const
1598
+ var_80
1599
+
1600
+ 
1601
+ *
1602
+ name
1603
+ 
1604
+ "
1605
+ op_80**
1606
+ val#
1607
+
1608
+ 
1609
+ 
1610
+ 
1611
+
1612
+ reshape
1613
+ x
1614
+
1615
+
1616
+ linear_2
1617
+ shape
1618
+
1619
+ 
1620
+ var_80)
1621
+ var_81
1622
+  
1623
+ 
1624
+ �
1625
+  
1626
+ @*
1627
+ name
1628
+ 
1629
+ "
1630
+ op_81h
1631
+ const
1632
+
1633
+ v_1_perm_0
1634
+
1635
+ 
1636
+ *
1637
+ name
1638
+ 
1639
+ "
1640
+
1641
+ v_1_perm_0*!
1642
+ val
1643
+
1644
+ 
1645
+ 
1646
+
1647
+ 
1648
+ f
1649
+ const
1650
+ _inversed_q_3_y_0
1651
+  *'
1652
+ name
1653
+ 
1654
+ "
1655
+ _inversed_q_3_y_0*
1656
+ val
1657
+  
1658
+
1659
+ 
1660
+ 
1661
+ >�
1662
+ mul
1663
+ x
1664
+
1665
+ 
1666
+ var_69
1667
+ y
1668
+ 
1669
+ _inversed_q_3_y_00
1670
+
1671
+  
1672
+ 
1673
+ �
1674
+  
1675
+ @*#
1676
+ name
1677
+ 
1678
+ "
1679
+
1680
+ const
1681
+ scores_1_transpose_x_0
1682
+ *,
1683
+ name$
1684
+ 
1685
+ "
1686
+ scores_1_transpose_x_0*
1687
+ val
1688
+ 
1689
+ 
1690
+ m
1691
+ const
1692
+ scores_1_transpose_y_0
1693
+ *,
1694
+ name$
1695
+ 
1696
+ "
1697
+ scores_1_transpose_y_0*
1698
+ val
1699
+ 
1700
+ 
1701
+ z
1702
+ const#
1703
+ transpose_18_perm_0
1704
+
1705
+ 
1706
+ *)
1707
+ name!
1708
+ 
1709
+ "
1710
+ transpose_18_perm_0*!
1711
+ val
1712
+
1713
+ 
1714
+ 
1715
+
1716
+ 
1717
+ z
1718
+ const#
1719
+ transpose_19_perm_0
1720
+
1721
+ 
1722
+ *)
1723
+ name!
1724
+ 
1725
+ "
1726
+ transpose_19_perm_0*!
1727
+ val
1728
+
1729
+ 
1730
+ 
1731
+
1732
+ 
1733
+ �
1734
+ transpose
1735
+ x
1736
+
1737
+ 
1738
+ var_75
1739
+ perm
1740
+ 
1741
+ transpose_19_perm_0/
1742
+ transpose_51
1743
+  
1744
+ 
1745
+  
1746
+ @
1747
+ �*"
1748
+ name
1749
+ 
1750
+ "
1751
+ transpose_51�
1752
+ transpose
1753
+ x
1754
+ 
1755
+
1756
+ perm
1757
+ 
1758
+ transpose_18_perm_0/
1759
+ transpose_52
1760
+  
1761
+ 
1762
+  
1763
+ �
1764
+ @*"
1765
+ name
1766
+ 
1767
+ "
1768
+ transpose_52�
1769
+ matmul
1770
+ x
1771
+ 
1772
+ transpose_52
1773
+ y
1774
+ 
1775
+ transpose_51)
1776
+ transpose_x
1777
+ 
1778
+ scores_1_transpose_x_0)
1779
+ transpose_y
1780
+ 
1781
+ scores_1_transpose_y_0,
1782
+ scores_1
1783
+  
1784
+ 
1785
+  
1786
+ �
1787
+ �*
1788
+ name
1789
+ 
1790
+ "
1791
+
1792
+ scores_1m
1793
+ equal
1794
+ x
1795
+ 
1796
+ attention_mask
1797
+ y
1798
+
1799
+ 
1800
+ var_11
1801
+ var_87
1802
+ 
1803
+ 
1804
+ �*
1805
+ name
1806
+ 
1807
+ "
1808
+ op_87`
1809
+ const
1810
+ var_88
1811
+
1812
+ 
1813
+ *
1814
+ name
1815
+ 
1816
+ "
1817
+ op_88*"
1818
+ val
1819
+
1820
+ 
1821
+ 
1822
+ 
1823
+ �w
1824
+ reshape
1825
+ x
1826
+
1827
+ 
1828
+ var_87
1829
+ shape
1830
+
1831
+ 
1832
+ var_88)
1833
+ var_89
1834
+ 
1835
+ 
1836
+ 
1837
+ 
1838
+ �*
1839
+ name
1840
+ 
1841
+ "
1842
+ op_89o
1843
+ const
1844
+
1845
+
1846
+ 
1847
+ *#
1848
+ name
1849
+ 
1850
+ "
1851
+
1852
+ val
1853
+
1854
+ 
1855
+ 
1856
+ 
1857
+  �|
1858
+ tile
1859
+ x
1860
+
1861
+ 
1862
+ var_89
1863
+ reps
1864
+ 
1865
+
1866
+ mask_3
1867
+ 
1868
+ 
1869
+  
1870
+ �
1871
+ �*
1872
+ name
1873
+ 
1874
+
1875
+ "
1876
+ mask_3O
1877
+ const
1878
+ var_91
1879
+  *
1880
+ name
1881
+ 
1882
+ "
1883
+ op_91*
1884
+ val
1885
+  
1886
+
1887
+ 
1888
+ 
1889
+ ����
1890
+ select
1891
+ cond
1892
+
1893
+ 
1894
+ mask_3
1895
+ a
1896
+
1897
+ 
1898
+ var_91
1899
+ b
1900
+
1901
+
1902
+ scores_1+
1903
+ input_7
1904
+  
1905
+ 
1906
+  
1907
+ �
1908
+ �*
1909
+ name
1910
+ 
1911
+ "
1912
+ input_7z
1913
+ softmax
1914
+ x
1915
+
1916
+ input_7
1917
+ axis
1918
+ 
1919
+ var_8+
1920
+ input_9
1921
+  
1922
+ 
1923
+  
1924
+ �
1925
+ �*
1926
+ name
1927
+ 
1928
+ "
1929
+ input_9c
1930
+ const
1931
+ x_7_transpose_x_0
1932
+ *'
1933
+ name
1934
+ 
1935
+ "
1936
+ x_7_transpose_x_0*
1937
+ val
1938
+ 
1939
+ 
1940
+ c
1941
+ const
1942
+ x_7_transpose_y_0
1943
+ *'
1944
+ name
1945
+ 
1946
+ "
1947
+ x_7_transpose_y_0*
1948
+ val
1949
+ 
1950
+ 
1951
+ �
1952
+ transpose
1953
+ x
1954
+
1955
+ 
1956
+ var_81
1957
+ perm
1958
+
1959
+
1960
+ v_1_perm_0/
1961
+ transpose_53
1962
+  
1963
+ 
1964
+  
1965
+ �
1966
+ @*"
1967
+ name
1968
+ 
1969
+ "
1970
+ transpose_53�
1971
+ matmul
1972
+ x
1973
+
1974
+ input_9
1975
+ y
1976
+ 
1977
+ transpose_53$
1978
+ transpose_x
1979
+ 
1980
+ x_7_transpose_x_0$
1981
+ transpose_y
1982
+ 
1983
+ x_7_transpose_y_0&
1984
+ x_7
1985
+  
1986
+ 
1987
+  
1988
+ �
1989
+ @*
1990
+ name
1991
+ 
1992
+ "
1993
+ x_7m
1994
+ const
1995
+
1996
+
1997
+ 
1998
+ *"
1999
+ name
2000
+ 
2001
+ "
2002
+ op_97_perm_0*!
2003
+ val
2004
+
2005
+ 
2006
+ 
2007
+
2008
+ 
2009
+ h
2010
+ const
2011
+ var_99
2012
+
2013
+ 
2014
+ *
2015
+ name
2016
+ 
2017
+ "
2018
+ op_99**
2019
+ val#
2020
+
2021
+ 
2022
+ 
2023
+ 
2024
+
2025
+ transpose
2026
+ x
2027
+ 
2028
+ x_7
2029
+ perm
2030
+ 
2031
+
2032
+ transpose_50
2033
+  
2034
+ 
2035
+ �
2036
+  
2037
+ @*"
2038
+ name
2039
+ 
2040
+ "
2041
+ transpose_50}
2042
+ reshape
2043
+ x
2044
+ 
2045
+ transpose_50
2046
+ shape
2047
+
2048
+ 
2049
+ var_99&
2050
+ input_11
2051
+  
2052
+ 
2053
+ �
2054
+ �*
2055
+ name
2056
+ 
2057
+ "
2058
+
2059
+ input_11�
2060
+ linear
2061
+ x
2062
+
2063
+
2064
+ input_11K
2065
+ weightA
2066
+ ?
2067
+ =model_distilbert_transformer_layer_0_attention_out_lin_weightG
2068
+ bias?
2069
+ =
2070
+ ;model_distilbert_transformer_layer_0_attention_out_lin_bias&
2071
+ linear_3
2072
+  
2073
+ 
2074
+ �
2075
+ �*
2076
+ name
2077
+ 
2078
+ "
2079
+
2080
+ linear_3r
2081
+ add
2082
+ x
2083
+
2084
+
2085
+ linear_3
2086
+ y
2087
+
2088
+ input_5&
2089
+ input_13
2090
+  
2091
+ 
2092
+ �
2093
+ �*
2094
+ name
2095
+ 
2096
+ "
2097
+
2098
+ input_13x
2099
+ const
2100
+ input_15_axes_0
2101
+
2102
+ 
2103
+ *%
2104
+ name
2105
+ 
2106
+ "
2107
+ input_15_axes_0*'
2108
+ val 
2109
+
2110
+ 
2111
+ 
2112
+ 
2113
+
2114
+ ����������
2115
+
2116
+ layer_norm
2117
+ x
2118
+
2119
+
2120
+ input_13
2121
+ axes
2122
+ 
2123
+ input_15_axes_0F
2124
+ gamma=
2125
+ ;
2126
+ 9model_distilbert_transformer_layer_0_sa_layer_norm_weightC
2127
+ beta;
2128
+ 9
2129
+ 7model_distilbert_transformer_layer_0_sa_layer_norm_bias
2130
+ epsilon
2131
+ 
2132
+ var_6&
2133
+ input_15
2134
+  
2135
+ 
2136
+ �
2137
+ �*
2138
+ name
2139
+ 
2140
+ "
2141
+
2142
+ input_15�
2143
+ linear
2144
+ x
2145
+
2146
+
2147
+ input_15B
2148
+ weight8
2149
+ 6
2150
+ 4model_distilbert_transformer_layer_0_ffn_lin1_weight>
2151
+ bias6
2152
+ 4
2153
+ 2model_distilbert_transformer_layer_0_ffn_lin1_bias&
2154
+ linear_4
2155
+  
2156
+ 
2157
+ �
2158
+ �*
2159
+ name
2160
+ 
2161
+ "
2162
+
2163
+ linear_4c
2164
+ const
2165
+ input_19_mode_0
2166
+ *%
2167
+ name
2168
+ 
2169
+ "
2170
+ input_19_mode_0*
2171
+ val
2172
+ 
2173
+ "
2174
+ EXACT~
2175
+ gelu
2176
+ x
2177
+
2178
+
2179
+ linear_4
2180
+ mode
2181
+ 
2182
+ input_19_mode_0&
2183
+ input_19
2184
+  
2185
+ 
2186
+ �
2187
+ �*
2188
+ name
2189
+ 
2190
+ "
2191
+
2192
+ input_19�
2193
+ linear
2194
+ x
2195
+
2196
+
2197
+ input_19B
2198
+ weight8
2199
+ 6
2200
+ 4model_distilbert_transformer_layer_0_ffn_lin2_weight>
2201
+ bias6
2202
+ 4
2203
+ 2model_distilbert_transformer_layer_0_ffn_lin2_bias&
2204
+ linear_5
2205
+  
2206
+ 
2207
+ �
2208
+ �*
2209
+ name
2210
+ 
2211
+ "
2212
+
2213
+ linear_5s
2214
+ add
2215
+ x
2216
+
2217
+
2218
+ linear_5
2219
+ y
2220
+
2221
+
2222
+ input_15&
2223
+ input_23
2224
+  
2225
+ 
2226
+ �
2227
+ �*
2228
+ name
2229
+ 
2230
+ "
2231
+
2232
+ input_23v
2233
+ const
2234
+ query_3_axes_0
2235
+
2236
+ 
2237
+ *$
2238
+ name
2239
+ 
2240
+ "
2241
+ query_3_axes_0*'
2242
+ val 
2243
+
2244
+ 
2245
+ 
2246
+ 
2247
+
2248
+ ����������
2249
+
2250
+ layer_norm
2251
+ x
2252
+
2253
+
2254
+ input_23
2255
+ axes
2256
+ 
2257
+ query_3_axes_0J
2258
+ gammaA
2259
+ ?
2260
+ =model_distilbert_transformer_layer_0_output_layer_norm_weightG
2261
+ beta?
2262
+ =
2263
+ ;model_distilbert_transformer_layer_0_output_layer_norm_bias
2264
+ epsilon
2265
+ 
2266
+ var_6%
2267
+ query_3
2268
+  
2269
+ 
2270
+ �
2271
+ �*
2272
+ name
2273
+ 
2274
+ "
2275
+ query_3�
2276
+ linear
2277
+ x
2278
+
2279
+ query_3I
2280
+ weight?
2281
+ =
2282
+ ;model_distilbert_transformer_layer_1_attention_q_lin_weightE
2283
+ bias=
2284
+ ;
2285
+ 9model_distilbert_transformer_layer_1_attention_q_lin_bias&
2286
+ linear_6
2287
+  
2288
+ 
2289
+ �
2290
+ �*
2291
+ name
2292
+ 
2293
+ "
2294
+
2295
+ linear_6j
2296
+ const
2297
+ var_137
2298
+
2299
+ 
2300
+ *
2301
+ name
2302
+ 
2303
+
2304
+ "
2305
+ op_137**
2306
+ val#
2307
+
2308
+ 
2309
+ 
2310
+ 
2311
+
2312
+ reshape
2313
+ x
2314
+
2315
+
2316
+ linear_6
2317
+ shape
2318
+
2319
+ var_137*
2320
+ var_138
2321
+  
2322
+ 
2323
+ �
2324
+  
2325
+ @*
2326
+ name
2327
+ 
2328
+
2329
+ "
2330
+ op_138�
2331
+ linear
2332
+ x
2333
+
2334
+ query_3I
2335
+ weight?
2336
+ =
2337
+ ;model_distilbert_transformer_layer_1_attention_k_lin_weightE
2338
+ bias=
2339
+ ;
2340
+ 9model_distilbert_transformer_layer_1_attention_k_lin_bias&
2341
+ linear_7
2342
+  
2343
+ 
2344
+ �
2345
+ �*
2346
+ name
2347
+ 
2348
+ "
2349
+
2350
+ linear_7j
2351
+ const
2352
+ var_143
2353
+
2354
+ 
2355
+ *
2356
+ name
2357
+ 
2358
+
2359
+ "
2360
+ op_143**
2361
+ val#
2362
+
2363
+ 
2364
+ 
2365
+ 
2366
+
2367
+ reshape
2368
+ x
2369
+
2370
+
2371
+ linear_7
2372
+ shape
2373
+
2374
+ var_143*
2375
+ var_144
2376
+  
2377
+ 
2378
+ �
2379
+  
2380
+ @*
2381
+ name
2382
+ 
2383
+
2384
+ "
2385
+ op_144�
2386
+ linear
2387
+ x
2388
+
2389
+ query_3I
2390
+ weight?
2391
+ =
2392
+ ;model_distilbert_transformer_layer_1_attention_v_lin_weightE
2393
+ bias=
2394
+ ;
2395
+ 9model_distilbert_transformer_layer_1_attention_v_lin_bias&
2396
+ linear_8
2397
+  
2398
+ 
2399
+ �
2400
+ �*
2401
+ name
2402
+ 
2403
+ "
2404
+
2405
+ linear_8j
2406
+ const
2407
+ var_149
2408
+
2409
+ 
2410
+ *
2411
+ name
2412
+ 
2413
+
2414
+ "
2415
+ op_149**
2416
+ val#
2417
+
2418
+ 
2419
+ 
2420
+ 
2421
+
2422
+ reshape
2423
+ x
2424
+
2425
+
2426
+ linear_8
2427
+ shape
2428
+
2429
+ var_149*
2430
+ var_150
2431
+  
2432
+ 
2433
+ �
2434
+  
2435
+ @*
2436
+ name
2437
+ 
2438
+
2439
+ "
2440
+ op_150h
2441
+ const
2442
+
2443
+ v_3_perm_0
2444
+
2445
+ 
2446
+ *
2447
+ name
2448
+ 
2449
+ "
2450
+
2451
+ v_3_perm_0*!
2452
+ val
2453
+
2454
+ 
2455
+ 
2456
+
2457
+ 
2458
+ f
2459
+ const
2460
+ _inversed_q_7_y_0
2461
+  *'
2462
+ name
2463
+ 
2464
+ "
2465
+ _inversed_q_7_y_0*
2466
+ val
2467
+  
2468
+
2469
+ 
2470
+ 
2471
+ >�
2472
+ mul
2473
+ x
2474
+
2475
+ var_138
2476
+ y
2477
+ 
2478
+ _inversed_q_7_y_00
2479
+
2480
+  
2481
+ 
2482
+ �
2483
+  
2484
+ @*#
2485
+ name
2486
+ 
2487
+ "
2488
+
2489
+ const
2490
+ scores_3_transpose_x_0
2491
+ *,
2492
+ name$
2493
+ 
2494
+ "
2495
+ scores_3_transpose_x_0*
2496
+ val
2497
+ 
2498
+ 
2499
+ m
2500
+ const
2501
+ scores_3_transpose_y_0
2502
+ *,
2503
+ name$
2504
+ 
2505
+ "
2506
+ scores_3_transpose_y_0*
2507
+ val
2508
+ 
2509
+ 
2510
+ z
2511
+ const#
2512
+ transpose_20_perm_0
2513
+
2514
+ 
2515
+ *)
2516
+ name!
2517
+ 
2518
+ "
2519
+ transpose_20_perm_0*!
2520
+ val
2521
+
2522
+ 
2523
+ 
2524
+
2525
+ 
2526
+ z
2527
+ const#
2528
+ transpose_21_perm_0
2529
+
2530
+ 
2531
+ *)
2532
+ name!
2533
+ 
2534
+ "
2535
+ transpose_21_perm_0*!
2536
+ val
2537
+
2538
+ 
2539
+ 
2540
+
2541
+ 
2542
+ �
2543
+ transpose
2544
+ x
2545
+
2546
+ var_144
2547
+ perm
2548
+ 
2549
+ transpose_21_perm_0/
2550
+ transpose_47
2551
+  
2552
+ 
2553
+  
2554
+ @
2555
+ �*"
2556
+ name
2557
+ 
2558
+ "
2559
+ transpose_47�
2560
+ transpose
2561
+ x
2562
+ 
2563
+
2564
+ perm
2565
+ 
2566
+ transpose_20_perm_0/
2567
+ transpose_48
2568
+  
2569
+ 
2570
+  
2571
+ �
2572
+ @*"
2573
+ name
2574
+ 
2575
+ "
2576
+ transpose_48�
2577
+ matmul
2578
+ x
2579
+ 
2580
+ transpose_48
2581
+ y
2582
+ 
2583
+ transpose_47)
2584
+ transpose_x
2585
+ 
2586
+ scores_3_transpose_x_0)
2587
+ transpose_y
2588
+ 
2589
+ scores_3_transpose_y_0,
2590
+ scores_3
2591
+  
2592
+ 
2593
+  
2594
+ �
2595
+ �*
2596
+ name
2597
+ 
2598
+ "
2599
+
2600
+ scores_3Q
2601
+ const
2602
+ var_160
2603
+  *
2604
+ name
2605
+ 
2606
+
2607
+ "
2608
+ op_160*
2609
+ val
2610
+  
2611
+
2612
+ 
2613
+ 
2614
+ ����
2615
+ select
2616
+ cond
2617
+
2618
+ 
2619
+ mask_3
2620
+ a
2621
+
2622
+ var_160
2623
+ b
2624
+
2625
+
2626
+ scores_3,
2627
+ input_25
2628
+  
2629
+ 
2630
+  
2631
+ �
2632
+ �*
2633
+ name
2634
+ 
2635
+ "
2636
+
2637
+ input_25}
2638
+ softmax
2639
+ x
2640
+
2641
+
2642
+ input_25
2643
+ axis
2644
+ 
2645
+ var_8,
2646
+ input_27
2647
+  
2648
+ 
2649
+  
2650
+ �
2651
+ �*
2652
+ name
2653
+ 
2654
+ "
2655
+
2656
+ input_27e
2657
+ const
2658
+ x_15_transpose_x_0
2659
+ *(
2660
+ name 
2661
+ 
2662
+ "
2663
+ x_15_transpose_x_0*
2664
+ val
2665
+ 
2666
+ 
2667
+ e
2668
+ const
2669
+ x_15_transpose_y_0
2670
+ *(
2671
+ name 
2672
+ 
2673
+ "
2674
+ x_15_transpose_y_0*
2675
+ val
2676
+ 
2677
+ 
2678
+ �
2679
+ transpose
2680
+ x
2681
+
2682
+ var_150
2683
+ perm
2684
+
2685
+
2686
+ v_3_perm_0/
2687
+ transpose_49
2688
+  
2689
+ 
2690
+  
2691
+ �
2692
+ @*"
2693
+ name
2694
+ 
2695
+ "
2696
+ transpose_49�
2697
+ matmul
2698
+ x
2699
+
2700
+
2701
+ input_27
2702
+ y
2703
+ 
2704
+ transpose_49%
2705
+ transpose_x
2706
+ 
2707
+ x_15_transpose_x_0%
2708
+ transpose_y
2709
+ 
2710
+ x_15_transpose_y_0'
2711
+ x_15
2712
+  
2713
+ 
2714
+  
2715
+ �
2716
+ @*
2717
+ name
2718
+ 
2719
+
2720
+ "
2721
+ x_15o
2722
+ const
2723
+ var_166_perm_0
2724
+
2725
+ 
2726
+ *#
2727
+ name
2728
+ 
2729
+ "
2730
+
2731
+ val
2732
+
2733
+ 
2734
+ 
2735
+
2736
+ 
2737
+ j
2738
+ const
2739
+ var_168
2740
+
2741
+ 
2742
+ *
2743
+ name
2744
+ 
2745
+
2746
+ "
2747
+ op_168**
2748
+ val#
2749
+
2750
+ 
2751
+ 
2752
+ 
2753
+
2754
+ transpose
2755
+ x
2756
+ 
2757
+ x_15
2758
+ perm
2759
+ 
2760
+ var_166_perm_0/
2761
+ transpose_46
2762
+  
2763
+ 
2764
+ �
2765
+  
2766
+ @*"
2767
+ name
2768
+ 
2769
+ "
2770
+ transpose_46~
2771
+ reshape
2772
+ x
2773
+ 
2774
+ transpose_46
2775
+ shape
2776
+
2777
+ var_168&
2778
+ input_29
2779
+  
2780
+ 
2781
+ �
2782
+ �*
2783
+ name
2784
+ 
2785
+ "
2786
+
2787
+ input_29�
2788
+ linear
2789
+ x
2790
+
2791
+
2792
+ input_29K
2793
+ weightA
2794
+ ?
2795
+ =model_distilbert_transformer_layer_1_attention_out_lin_weightG
2796
+ bias?
2797
+ =
2798
+ ;model_distilbert_transformer_layer_1_attention_out_lin_bias&
2799
+ linear_9
2800
+  
2801
+ 
2802
+ �
2803
+ �*
2804
+ name
2805
+ 
2806
+ "
2807
+
2808
+ linear_9r
2809
+ add
2810
+ x
2811
+
2812
+
2813
+ linear_9
2814
+ y
2815
+
2816
+ query_3&
2817
+ input_31
2818
+  
2819
+ 
2820
+ �
2821
+ �*
2822
+ name
2823
+ 
2824
+ "
2825
+
2826
+ input_31x
2827
+ const
2828
+ input_33_axes_0
2829
+
2830
+ 
2831
+ *%
2832
+ name
2833
+ 
2834
+ "
2835
+ input_33_axes_0*'
2836
+ val 
2837
+
2838
+ 
2839
+ 
2840
+ 
2841
+
2842
+ ����������
2843
+
2844
+ layer_norm
2845
+ x
2846
+
2847
+
2848
+ input_31
2849
+ axes
2850
+ 
2851
+ input_33_axes_0F
2852
+ gamma=
2853
+ ;
2854
+ 9model_distilbert_transformer_layer_1_sa_layer_norm_weightC
2855
+ beta;
2856
+ 9
2857
+ 7model_distilbert_transformer_layer_1_sa_layer_norm_bias
2858
+ epsilon
2859
+ 
2860
+ var_6&
2861
+ input_33
2862
+  
2863
+ 
2864
+ �
2865
+ �*
2866
+ name
2867
+ 
2868
+ "
2869
+
2870
+ input_33�
2871
+ linear
2872
+ x
2873
+
2874
+
2875
+ input_33B
2876
+ weight8
2877
+ 6
2878
+ 4model_distilbert_transformer_layer_1_ffn_lin1_weight>
2879
+ bias6
2880
+ 4
2881
+ 2model_distilbert_transformer_layer_1_ffn_lin1_bias'
2882
+ linear_10
2883
+  
2884
+ 
2885
+ �
2886
+ �*
2887
+ name
2888
+ 
2889
+
2890
+ linear_10c
2891
+ const
2892
+ input_37_mode_0
2893
+ *%
2894
+ name
2895
+ 
2896
+ "
2897
+ input_37_mode_0*
2898
+ val
2899
+ 
2900
+ "
2901
+ EXACT
2902
+ gelu
2903
+ x
2904
+
2905
+ linear_10
2906
+ mode
2907
+ 
2908
+ input_37_mode_0&
2909
+ input_37
2910
+  
2911
+ 
2912
+ �
2913
+ �*
2914
+ name
2915
+ 
2916
+ "
2917
+
2918
+ input_37�
2919
+ linear
2920
+ x
2921
+
2922
+
2923
+ input_37B
2924
+ weight8
2925
+ 6
2926
+ 4model_distilbert_transformer_layer_1_ffn_lin2_weight>
2927
+ bias6
2928
+ 4
2929
+ 2model_distilbert_transformer_layer_1_ffn_lin2_bias'
2930
+ linear_11
2931
+  
2932
+ 
2933
+ �
2934
+ �*
2935
+ name
2936
+ 
2937
+
2938
+ linear_11t
2939
+ add
2940
+ x
2941
+
2942
+ linear_11
2943
+ y
2944
+
2945
+
2946
+ input_33&
2947
+ input_41
2948
+  
2949
+ 
2950
+ �
2951
+ �*
2952
+ name
2953
+ 
2954
+ "
2955
+
2956
+ input_41v
2957
+ const
2958
+ query_5_axes_0
2959
+
2960
+ 
2961
+ *$
2962
+ name
2963
+ 
2964
+ "
2965
+ query_5_axes_0*'
2966
+ val 
2967
+
2968
+ 
2969
+ 
2970
+ 
2971
+
2972
+ ����������
2973
+
2974
+ layer_norm
2975
+ x
2976
+
2977
+
2978
+ input_41
2979
+ axes
2980
+ 
2981
+ query_5_axes_0J
2982
+ gammaA
2983
+ ?
2984
+ =model_distilbert_transformer_layer_1_output_layer_norm_weightG
2985
+ beta?
2986
+ =
2987
+ ;model_distilbert_transformer_layer_1_output_layer_norm_bias
2988
+ epsilon
2989
+ 
2990
+ var_6%
2991
+ query_5
2992
+  
2993
+ 
2994
+ �
2995
+ �*
2996
+ name
2997
+ 
2998
+ "
2999
+ query_5�
3000
+ linear
3001
+ x
3002
+
3003
+ query_5I
3004
+ weight?
3005
+ =
3006
+ ;model_distilbert_transformer_layer_2_attention_q_lin_weightE
3007
+ bias=
3008
+ ;
3009
+ 9model_distilbert_transformer_layer_2_attention_q_lin_bias'
3010
+ linear_12
3011
+  
3012
+ 
3013
+ �
3014
+ �*
3015
+ name
3016
+ 
3017
+
3018
+ linear_12j
3019
+ const
3020
+ var_206
3021
+
3022
+ 
3023
+ *
3024
+ name
3025
+ 
3026
+
3027
+ "
3028
+ op_206**
3029
+ val#
3030
+
3031
+ 
3032
+ 
3033
+ 
3034
+
3035
+ reshape
3036
+ x
3037
+
3038
+ linear_12
3039
+ shape
3040
+
3041
+ var_206*
3042
+ var_207
3043
+  
3044
+ 
3045
+ �
3046
+  
3047
+ @*
3048
+ name
3049
+ 
3050
+
3051
+ "
3052
+ op_207�
3053
+ linear
3054
+ x
3055
+
3056
+ query_5I
3057
+ weight?
3058
+ =
3059
+ ;model_distilbert_transformer_layer_2_attention_k_lin_weightE
3060
+ bias=
3061
+ ;
3062
+ 9model_distilbert_transformer_layer_2_attention_k_lin_bias'
3063
+ linear_13
3064
+  
3065
+ 
3066
+ �
3067
+ �*
3068
+ name
3069
+ 
3070
+
3071
+ linear_13j
3072
+ const
3073
+ var_212
3074
+
3075
+ 
3076
+ *
3077
+ name
3078
+ 
3079
+
3080
+ "
3081
+ op_212**
3082
+ val#
3083
+
3084
+ 
3085
+ 
3086
+ 
3087
+
3088
+ reshape
3089
+ x
3090
+
3091
+ linear_13
3092
+ shape
3093
+
3094
+ var_212*
3095
+ var_213
3096
+  
3097
+ 
3098
+ �
3099
+  
3100
+ @*
3101
+ name
3102
+ 
3103
+
3104
+ "
3105
+ op_213�
3106
+ linear
3107
+ x
3108
+
3109
+ query_5I
3110
+ weight?
3111
+ =
3112
+ ;model_distilbert_transformer_layer_2_attention_v_lin_weightE
3113
+ bias=
3114
+ ;
3115
+ 9model_distilbert_transformer_layer_2_attention_v_lin_bias'
3116
+ linear_14
3117
+  
3118
+ 
3119
+ �
3120
+ �*
3121
+ name
3122
+ 
3123
+
3124
+ linear_14j
3125
+ const
3126
+ var_218
3127
+
3128
+ 
3129
+ *
3130
+ name
3131
+ 
3132
+
3133
+ "
3134
+ op_218**
3135
+ val#
3136
+
3137
+ 
3138
+ 
3139
+ 
3140
+
3141
+ reshape
3142
+ x
3143
+
3144
+ linear_14
3145
+ shape
3146
+
3147
+ var_218*
3148
+ var_219
3149
+  
3150
+ 
3151
+ �
3152
+  
3153
+ @*
3154
+ name
3155
+ 
3156
+
3157
+ "
3158
+ op_219h
3159
+ const
3160
+
3161
+ v_5_perm_0
3162
+
3163
+ 
3164
+ *
3165
+ name
3166
+ 
3167
+ "
3168
+
3169
+ v_5_perm_0*!
3170
+ val
3171
+
3172
+ 
3173
+ 
3174
+
3175
+ 
3176
+ h
3177
+ const
3178
+ _inversed_q_11_y_0
3179
+  *(
3180
+ name 
3181
+ 
3182
+ "
3183
+ _inversed_q_11_y_0*
3184
+ val
3185
+  
3186
+
3187
+ 
3188
+ 
3189
+ >�
3190
+ mul
3191
+ x
3192
+
3193
+ var_207
3194
+ y
3195
+ 
3196
+ _inversed_q_11_y_01
3197
+ _inversed_q_11
3198
+  
3199
+ 
3200
+ �
3201
+  
3202
+ @*$
3203
+ name
3204
+ 
3205
+ "
3206
+ _inversed_q_11m
3207
+ const
3208
+ scores_5_transpose_x_0
3209
+ *,
3210
+ name$
3211
+ 
3212
+ "
3213
+ scores_5_transpose_x_0*
3214
+ val
3215
+ 
3216
+ 
3217
+ m
3218
+ const
3219
+ scores_5_transpose_y_0
3220
+ *,
3221
+ name$
3222
+ 
3223
+ "
3224
+ scores_5_transpose_y_0*
3225
+ val
3226
+ 
3227
+ 
3228
+ z
3229
+ const#
3230
+ transpose_22_perm_0
3231
+
3232
+ 
3233
+ *)
3234
+ name!
3235
+ 
3236
+ "
3237
+ transpose_22_perm_0*!
3238
+ val
3239
+
3240
+ 
3241
+ 
3242
+
3243
+ 
3244
+ z
3245
+ const#
3246
+ transpose_23_perm_0
3247
+
3248
+ 
3249
+ *)
3250
+ name!
3251
+ 
3252
+ "
3253
+ transpose_23_perm_0*!
3254
+ val
3255
+
3256
+ 
3257
+ 
3258
+
3259
+ 
3260
+ �
3261
+ transpose
3262
+ x
3263
+
3264
+ var_213
3265
+ perm
3266
+ 
3267
+ transpose_23_perm_0/
3268
+ transpose_43
3269
+  
3270
+ 
3271
+  
3272
+ @
3273
+ �*"
3274
+ name
3275
+ 
3276
+ "
3277
+ transpose_43�
3278
+ transpose
3279
+ x
3280
+ 
3281
+ _inversed_q_11
3282
+ perm
3283
+ 
3284
+ transpose_22_perm_0/
3285
+ transpose_44
3286
+  
3287
+ 
3288
+  
3289
+ �
3290
+ @*"
3291
+ name
3292
+ 
3293
+ "
3294
+ transpose_44�
3295
+ matmul
3296
+ x
3297
+ 
3298
+ transpose_44
3299
+ y
3300
+ 
3301
+ transpose_43)
3302
+ transpose_x
3303
+ 
3304
+ scores_5_transpose_x_0)
3305
+ transpose_y
3306
+ 
3307
+ scores_5_transpose_y_0,
3308
+ scores_5
3309
+  
3310
+ 
3311
+  
3312
+ �
3313
+ �*
3314
+ name
3315
+ 
3316
+ "
3317
+
3318
+ scores_5Q
3319
+ const
3320
+ var_229
3321
+  *
3322
+ name
3323
+ 
3324
+
3325
+ "
3326
+ op_229*
3327
+ val
3328
+  
3329
+
3330
+ 
3331
+ 
3332
+ ����
3333
+ select
3334
+ cond
3335
+
3336
+ 
3337
+ mask_3
3338
+ a
3339
+
3340
+ var_229
3341
+ b
3342
+
3343
+
3344
+ scores_5,
3345
+ input_43
3346
+  
3347
+ 
3348
+  
3349
+ �
3350
+ �*
3351
+ name
3352
+ 
3353
+ "
3354
+
3355
+ input_43}
3356
+ softmax
3357
+ x
3358
+
3359
+
3360
+ input_43
3361
+ axis
3362
+ 
3363
+ var_8,
3364
+ input_45
3365
+  
3366
+ 
3367
+  
3368
+ �
3369
+ �*
3370
+ name
3371
+ 
3372
+ "
3373
+
3374
+ input_45e
3375
+ const
3376
+ x_23_transpose_x_0
3377
+ *(
3378
+ name 
3379
+ 
3380
+ "
3381
+ x_23_transpose_x_0*
3382
+ val
3383
+ 
3384
+ 
3385
+ e
3386
+ const
3387
+ x_23_transpose_y_0
3388
+ *(
3389
+ name 
3390
+ 
3391
+ "
3392
+ x_23_transpose_y_0*
3393
+ val
3394
+ 
3395
+ 
3396
+ �
3397
+ transpose
3398
+ x
3399
+
3400
+ var_219
3401
+ perm
3402
+
3403
+
3404
+ v_5_perm_0/
3405
+ transpose_45
3406
+  
3407
+ 
3408
+  
3409
+ �
3410
+ @*"
3411
+ name
3412
+ 
3413
+ "
3414
+ transpose_45�
3415
+ matmul
3416
+ x
3417
+
3418
+
3419
+ input_45
3420
+ y
3421
+ 
3422
+ transpose_45%
3423
+ transpose_x
3424
+ 
3425
+ x_23_transpose_x_0%
3426
+ transpose_y
3427
+ 
3428
+ x_23_transpose_y_0'
3429
+ x_23
3430
+  
3431
+ 
3432
+  
3433
+ �
3434
+ @*
3435
+ name
3436
+ 
3437
+
3438
+ "
3439
+ x_23o
3440
+ const
3441
+ var_235_perm_0
3442
+
3443
+ 
3444
+ *#
3445
+ name
3446
+ 
3447
+ "
3448
+
3449
+ val
3450
+
3451
+ 
3452
+ 
3453
+
3454
+ 
3455
+ j
3456
+ const
3457
+ var_237
3458
+
3459
+ 
3460
+ *
3461
+ name
3462
+ 
3463
+
3464
+ "
3465
+ op_237**
3466
+ val#
3467
+
3468
+ 
3469
+ 
3470
+ 
3471
+
3472
+ transpose
3473
+ x
3474
+ 
3475
+ x_23
3476
+ perm
3477
+ 
3478
+ var_235_perm_0/
3479
+ transpose_42
3480
+  
3481
+ 
3482
+ �
3483
+  
3484
+ @*"
3485
+ name
3486
+ 
3487
+ "
3488
+ transpose_42~
3489
+ reshape
3490
+ x
3491
+ 
3492
+ transpose_42
3493
+ shape
3494
+
3495
+ var_237&
3496
+ input_47
3497
+  
3498
+ 
3499
+ �
3500
+ �*
3501
+ name
3502
+ 
3503
+ "
3504
+
3505
+ input_47�
3506
+ linear
3507
+ x
3508
+
3509
+
3510
+ input_47K
3511
+ weightA
3512
+ ?
3513
+ =model_distilbert_transformer_layer_2_attention_out_lin_weightG
3514
+ bias?
3515
+ =
3516
+ ;model_distilbert_transformer_layer_2_attention_out_lin_bias'
3517
+ linear_15
3518
+  
3519
+ 
3520
+ �
3521
+ �*
3522
+ name
3523
+ 
3524
+
3525
+ linear_15s
3526
+ add
3527
+ x
3528
+
3529
+ linear_15
3530
+ y
3531
+
3532
+ query_5&
3533
+ input_49
3534
+  
3535
+ 
3536
+ �
3537
+ �*
3538
+ name
3539
+ 
3540
+ "
3541
+
3542
+ input_49x
3543
+ const
3544
+ input_51_axes_0
3545
+
3546
+ 
3547
+ *%
3548
+ name
3549
+ 
3550
+ "
3551
+ input_51_axes_0*'
3552
+ val 
3553
+
3554
+ 
3555
+ 
3556
+ 
3557
+
3558
+ ����������
3559
+
3560
+ layer_norm
3561
+ x
3562
+
3563
+
3564
+ input_49
3565
+ axes
3566
+ 
3567
+ input_51_axes_0F
3568
+ gamma=
3569
+ ;
3570
+ 9model_distilbert_transformer_layer_2_sa_layer_norm_weightC
3571
+ beta;
3572
+ 9
3573
+ 7model_distilbert_transformer_layer_2_sa_layer_norm_bias
3574
+ epsilon
3575
+ 
3576
+ var_6&
3577
+ input_51
3578
+  
3579
+ 
3580
+ �
3581
+ �*
3582
+ name
3583
+ 
3584
+ "
3585
+
3586
+ input_51�
3587
+ linear
3588
+ x
3589
+
3590
+
3591
+ input_51B
3592
+ weight8
3593
+ 6
3594
+ 4model_distilbert_transformer_layer_2_ffn_lin1_weight>
3595
+ bias6
3596
+ 4
3597
+ 2model_distilbert_transformer_layer_2_ffn_lin1_bias'
3598
+ linear_16
3599
+  
3600
+ 
3601
+ �
3602
+ �*
3603
+ name
3604
+ 
3605
+
3606
+ linear_16c
3607
+ const
3608
+ input_55_mode_0
3609
+ *%
3610
+ name
3611
+ 
3612
+ "
3613
+ input_55_mode_0*
3614
+ val
3615
+ 
3616
+ "
3617
+ EXACT
3618
+ gelu
3619
+ x
3620
+
3621
+ linear_16
3622
+ mode
3623
+ 
3624
+ input_55_mode_0&
3625
+ input_55
3626
+  
3627
+ 
3628
+ �
3629
+ �*
3630
+ name
3631
+ 
3632
+ "
3633
+
3634
+ input_55�
3635
+ linear
3636
+ x
3637
+
3638
+
3639
+ input_55B
3640
+ weight8
3641
+ 6
3642
+ 4model_distilbert_transformer_layer_2_ffn_lin2_weight>
3643
+ bias6
3644
+ 4
3645
+ 2model_distilbert_transformer_layer_2_ffn_lin2_bias'
3646
+ linear_17
3647
+  
3648
+ 
3649
+ �
3650
+ �*
3651
+ name
3652
+ 
3653
+
3654
+ linear_17t
3655
+ add
3656
+ x
3657
+
3658
+ linear_17
3659
+ y
3660
+
3661
+
3662
+ input_51&
3663
+ input_59
3664
+  
3665
+ 
3666
+ �
3667
+ �*
3668
+ name
3669
+ 
3670
+ "
3671
+
3672
+ input_59v
3673
+ const
3674
+ query_7_axes_0
3675
+
3676
+ 
3677
+ *$
3678
+ name
3679
+ 
3680
+ "
3681
+ query_7_axes_0*'
3682
+ val 
3683
+
3684
+ 
3685
+ 
3686
+ 
3687
+
3688
+ ����������
3689
+
3690
+ layer_norm
3691
+ x
3692
+
3693
+
3694
+ input_59
3695
+ axes
3696
+ 
3697
+ query_7_axes_0J
3698
+ gammaA
3699
+ ?
3700
+ =model_distilbert_transformer_layer_2_output_layer_norm_weightG
3701
+ beta?
3702
+ =
3703
+ ;model_distilbert_transformer_layer_2_output_layer_norm_bias
3704
+ epsilon
3705
+ 
3706
+ var_6%
3707
+ query_7
3708
+  
3709
+ 
3710
+ �
3711
+ �*
3712
+ name
3713
+ 
3714
+ "
3715
+ query_7�
3716
+ linear
3717
+ x
3718
+
3719
+ query_7I
3720
+ weight?
3721
+ =
3722
+ ;model_distilbert_transformer_layer_3_attention_q_lin_weightE
3723
+ bias=
3724
+ ;
3725
+ 9model_distilbert_transformer_layer_3_attention_q_lin_bias'
3726
+ linear_18
3727
+  
3728
+ 
3729
+ �
3730
+ �*
3731
+ name
3732
+ 
3733
+
3734
+ linear_18j
3735
+ const
3736
+ var_275
3737
+
3738
+ 
3739
+ *
3740
+ name
3741
+ 
3742
+
3743
+ "
3744
+ op_275**
3745
+ val#
3746
+
3747
+ 
3748
+ 
3749
+ 
3750
+
3751
+ reshape
3752
+ x
3753
+
3754
+ linear_18
3755
+ shape
3756
+
3757
+ var_275*
3758
+ var_276
3759
+  
3760
+ 
3761
+ �
3762
+  
3763
+ @*
3764
+ name
3765
+ 
3766
+
3767
+ "
3768
+ op_276�
3769
+ linear
3770
+ x
3771
+
3772
+ query_7I
3773
+ weight?
3774
+ =
3775
+ ;model_distilbert_transformer_layer_3_attention_k_lin_weightE
3776
+ bias=
3777
+ ;
3778
+ 9model_distilbert_transformer_layer_3_attention_k_lin_bias'
3779
+ linear_19
3780
+  
3781
+ 
3782
+ �
3783
+ �*
3784
+ name
3785
+ 
3786
+
3787
+ linear_19j
3788
+ const
3789
+ var_281
3790
+
3791
+ 
3792
+ *
3793
+ name
3794
+ 
3795
+
3796
+ "
3797
+ op_281**
3798
+ val#
3799
+
3800
+ 
3801
+ 
3802
+ 
3803
+
3804
+ reshape
3805
+ x
3806
+
3807
+ linear_19
3808
+ shape
3809
+
3810
+ var_281*
3811
+ var_282
3812
+  
3813
+ 
3814
+ �
3815
+  
3816
+ @*
3817
+ name
3818
+ 
3819
+
3820
+ "
3821
+ op_282�
3822
+ linear
3823
+ x
3824
+
3825
+ query_7I
3826
+ weight?
3827
+ =
3828
+ ;model_distilbert_transformer_layer_3_attention_v_lin_weightE
3829
+ bias=
3830
+ ;
3831
+ 9model_distilbert_transformer_layer_3_attention_v_lin_bias'
3832
+ linear_20
3833
+  
3834
+ 
3835
+ �
3836
+ �*
3837
+ name
3838
+ 
3839
+
3840
+ linear_20j
3841
+ const
3842
+ var_287
3843
+
3844
+ 
3845
+ *
3846
+ name
3847
+ 
3848
+
3849
+ "
3850
+ op_287**
3851
+ val#
3852
+
3853
+ 
3854
+ 
3855
+ 
3856
+
3857
+ reshape
3858
+ x
3859
+
3860
+ linear_20
3861
+ shape
3862
+
3863
+ var_287*
3864
+ var_288
3865
+  
3866
+ 
3867
+ �
3868
+  
3869
+ @*
3870
+ name
3871
+ 
3872
+
3873
+ "
3874
+ op_288h
3875
+ const
3876
+
3877
+ v_7_perm_0
3878
+
3879
+ 
3880
+ *
3881
+ name
3882
+ 
3883
+ "
3884
+
3885
+ v_7_perm_0*!
3886
+ val
3887
+
3888
+ 
3889
+ 
3890
+
3891
+ 
3892
+ h
3893
+ const
3894
+ _inversed_q_15_y_0
3895
+  *(
3896
+ name 
3897
+ 
3898
+ "
3899
+ _inversed_q_15_y_0*
3900
+ val
3901
+  
3902
+
3903
+ 
3904
+ 
3905
+ >�
3906
+ mul
3907
+ x
3908
+
3909
+ var_276
3910
+ y
3911
+ 
3912
+ _inversed_q_15_y_01
3913
+ _inversed_q_15
3914
+  
3915
+ 
3916
+ �
3917
+  
3918
+ @*$
3919
+ name
3920
+ 
3921
+ "
3922
+ _inversed_q_15m
3923
+ const
3924
+ scores_7_transpose_x_0
3925
+ *,
3926
+ name$
3927
+ 
3928
+ "
3929
+ scores_7_transpose_x_0*
3930
+ val
3931
+ 
3932
+ 
3933
+ m
3934
+ const
3935
+ scores_7_transpose_y_0
3936
+ *,
3937
+ name$
3938
+ 
3939
+ "
3940
+ scores_7_transpose_y_0*
3941
+ val
3942
+ 
3943
+ 
3944
+ z
3945
+ const#
3946
+ transpose_24_perm_0
3947
+
3948
+ 
3949
+ *)
3950
+ name!
3951
+ 
3952
+ "
3953
+ transpose_24_perm_0*!
3954
+ val
3955
+
3956
+ 
3957
+ 
3958
+
3959
+ 
3960
+ z
3961
+ const#
3962
+ transpose_25_perm_0
3963
+
3964
+ 
3965
+ *)
3966
+ name!
3967
+ 
3968
+ "
3969
+ transpose_25_perm_0*!
3970
+ val
3971
+
3972
+ 
3973
+ 
3974
+
3975
+ 
3976
+ �
3977
+ transpose
3978
+ x
3979
+
3980
+ var_282
3981
+ perm
3982
+ 
3983
+ transpose_25_perm_0/
3984
+ transpose_39
3985
+  
3986
+ 
3987
+  
3988
+ @
3989
+ �*"
3990
+ name
3991
+ 
3992
+ "
3993
+ transpose_39�
3994
+ transpose
3995
+ x
3996
+ 
3997
+ _inversed_q_15
3998
+ perm
3999
+ 
4000
+ transpose_24_perm_0/
4001
+ transpose_40
4002
+  
4003
+ 
4004
+  
4005
+ �
4006
+ @*"
4007
+ name
4008
+ 
4009
+ "
4010
+ transpose_40�
4011
+ matmul
4012
+ x
4013
+ 
4014
+ transpose_40
4015
+ y
4016
+ 
4017
+ transpose_39)
4018
+ transpose_x
4019
+ 
4020
+ scores_7_transpose_x_0)
4021
+ transpose_y
4022
+ 
4023
+ scores_7_transpose_y_0,
4024
+ scores_7
4025
+  
4026
+ 
4027
+  
4028
+ �
4029
+ �*
4030
+ name
4031
+ 
4032
+ "
4033
+
4034
+ scores_7Q
4035
+ const
4036
+ var_298
4037
+  *
4038
+ name
4039
+ 
4040
+
4041
+ "
4042
+ op_298*
4043
+ val
4044
+  
4045
+
4046
+ 
4047
+ 
4048
+ ����
4049
+ select
4050
+ cond
4051
+
4052
+ 
4053
+ mask_3
4054
+ a
4055
+
4056
+ var_298
4057
+ b
4058
+
4059
+
4060
+ scores_7,
4061
+ input_61
4062
+  
4063
+ 
4064
+  
4065
+ �
4066
+ �*
4067
+ name
4068
+ 
4069
+ "
4070
+
4071
+ input_61}
4072
+ softmax
4073
+ x
4074
+
4075
+
4076
+ input_61
4077
+ axis
4078
+ 
4079
+ var_8,
4080
+ input_63
4081
+  
4082
+ 
4083
+  
4084
+ �
4085
+ �*
4086
+ name
4087
+ 
4088
+ "
4089
+
4090
+ input_63e
4091
+ const
4092
+ x_31_transpose_x_0
4093
+ *(
4094
+ name 
4095
+ 
4096
+ "
4097
+ x_31_transpose_x_0*
4098
+ val
4099
+ 
4100
+ 
4101
+ e
4102
+ const
4103
+ x_31_transpose_y_0
4104
+ *(
4105
+ name 
4106
+ 
4107
+ "
4108
+ x_31_transpose_y_0*
4109
+ val
4110
+ 
4111
+ 
4112
+ �
4113
+ transpose
4114
+ x
4115
+
4116
+ var_288
4117
+ perm
4118
+
4119
+
4120
+ v_7_perm_0/
4121
+ transpose_41
4122
+  
4123
+ 
4124
+  
4125
+ �
4126
+ @*"
4127
+ name
4128
+ 
4129
+ "
4130
+ transpose_41�
4131
+ matmul
4132
+ x
4133
+
4134
+
4135
+ input_63
4136
+ y
4137
+ 
4138
+ transpose_41%
4139
+ transpose_x
4140
+ 
4141
+ x_31_transpose_x_0%
4142
+ transpose_y
4143
+ 
4144
+ x_31_transpose_y_0'
4145
+ x_31
4146
+  
4147
+ 
4148
+  
4149
+ �
4150
+ @*
4151
+ name
4152
+ 
4153
+
4154
+ "
4155
+ x_31o
4156
+ const
4157
+ var_304_perm_0
4158
+
4159
+ 
4160
+ *#
4161
+ name
4162
+ 
4163
+ "
4164
+
4165
+ val
4166
+
4167
+ 
4168
+ 
4169
+
4170
+ 
4171
+ j
4172
+ const
4173
+ var_306
4174
+
4175
+ 
4176
+ *
4177
+ name
4178
+ 
4179
+
4180
+ "
4181
+ op_306**
4182
+ val#
4183
+
4184
+ 
4185
+ 
4186
+ 
4187
+
4188
+ transpose
4189
+ x
4190
+ 
4191
+ x_31
4192
+ perm
4193
+ 
4194
+ var_304_perm_0/
4195
+ transpose_38
4196
+  
4197
+ 
4198
+ �
4199
+  
4200
+ @*"
4201
+ name
4202
+ 
4203
+ "
4204
+ transpose_38~
4205
+ reshape
4206
+ x
4207
+ 
4208
+ transpose_38
4209
+ shape
4210
+
4211
+ var_306&
4212
+ input_65
4213
+  
4214
+ 
4215
+ �
4216
+ �*
4217
+ name
4218
+ 
4219
+ "
4220
+
4221
+ input_65�
4222
+ linear
4223
+ x
4224
+
4225
+
4226
+ input_65K
4227
+ weightA
4228
+ ?
4229
+ =model_distilbert_transformer_layer_3_attention_out_lin_weightG
4230
+ bias?
4231
+ =
4232
+ ;model_distilbert_transformer_layer_3_attention_out_lin_bias'
4233
+ linear_21
4234
+  
4235
+ 
4236
+ �
4237
+ �*
4238
+ name
4239
+ 
4240
+
4241
+ linear_21s
4242
+ add
4243
+ x
4244
+
4245
+ linear_21
4246
+ y
4247
+
4248
+ query_7&
4249
+ input_67
4250
+  
4251
+ 
4252
+ �
4253
+ �*
4254
+ name
4255
+ 
4256
+ "
4257
+
4258
+ input_67x
4259
+ const
4260
+ input_69_axes_0
4261
+
4262
+ 
4263
+ *%
4264
+ name
4265
+ 
4266
+ "
4267
+ input_69_axes_0*'
4268
+ val 
4269
+
4270
+ 
4271
+ 
4272
+ 
4273
+
4274
+ ����������
4275
+
4276
+ layer_norm
4277
+ x
4278
+
4279
+
4280
+ input_67
4281
+ axes
4282
+ 
4283
+ input_69_axes_0F
4284
+ gamma=
4285
+ ;
4286
+ 9model_distilbert_transformer_layer_3_sa_layer_norm_weightC
4287
+ beta;
4288
+ 9
4289
+ 7model_distilbert_transformer_layer_3_sa_layer_norm_bias
4290
+ epsilon
4291
+ 
4292
+ var_6&
4293
+ input_69
4294
+  
4295
+ 
4296
+ �
4297
+ �*
4298
+ name
4299
+ 
4300
+ "
4301
+
4302
+ input_69�
4303
+ linear
4304
+ x
4305
+
4306
+
4307
+ input_69B
4308
+ weight8
4309
+ 6
4310
+ 4model_distilbert_transformer_layer_3_ffn_lin1_weight>
4311
+ bias6
4312
+ 4
4313
+ 2model_distilbert_transformer_layer_3_ffn_lin1_bias'
4314
+ linear_22
4315
+  
4316
+ 
4317
+ �
4318
+ �*
4319
+ name
4320
+ 
4321
+
4322
+ linear_22c
4323
+ const
4324
+ input_73_mode_0
4325
+ *%
4326
+ name
4327
+ 
4328
+ "
4329
+ input_73_mode_0*
4330
+ val
4331
+ 
4332
+ "
4333
+ EXACT
4334
+ gelu
4335
+ x
4336
+
4337
+ linear_22
4338
+ mode
4339
+ 
4340
+ input_73_mode_0&
4341
+ input_73
4342
+  
4343
+ 
4344
+ �
4345
+ �*
4346
+ name
4347
+ 
4348
+ "
4349
+
4350
+ input_73�
4351
+ linear
4352
+ x
4353
+
4354
+
4355
+ input_73B
4356
+ weight8
4357
+ 6
4358
+ 4model_distilbert_transformer_layer_3_ffn_lin2_weight>
4359
+ bias6
4360
+ 4
4361
+ 2model_distilbert_transformer_layer_3_ffn_lin2_bias'
4362
+ linear_23
4363
+  
4364
+ 
4365
+ �
4366
+ �*
4367
+ name
4368
+ 
4369
+
4370
+ linear_23t
4371
+ add
4372
+ x
4373
+
4374
+ linear_23
4375
+ y
4376
+
4377
+
4378
+ input_69&
4379
+ input_77
4380
+  
4381
+ 
4382
+ �
4383
+ �*
4384
+ name
4385
+ 
4386
+ "
4387
+
4388
+ input_77v
4389
+ const
4390
+ query_9_axes_0
4391
+
4392
+ 
4393
+ *$
4394
+ name
4395
+ 
4396
+ "
4397
+ query_9_axes_0*'
4398
+ val 
4399
+
4400
+ 
4401
+ 
4402
+ 
4403
+
4404
+ ����������
4405
+
4406
+ layer_norm
4407
+ x
4408
+
4409
+
4410
+ input_77
4411
+ axes
4412
+ 
4413
+ query_9_axes_0J
4414
+ gammaA
4415
+ ?
4416
+ =model_distilbert_transformer_layer_3_output_layer_norm_weightG
4417
+ beta?
4418
+ =
4419
+ ;model_distilbert_transformer_layer_3_output_layer_norm_bias
4420
+ epsilon
4421
+ 
4422
+ var_6%
4423
+ query_9
4424
+  
4425
+ 
4426
+ �
4427
+ �*
4428
+ name
4429
+ 
4430
+ "
4431
+ query_9�
4432
+ linear
4433
+ x
4434
+
4435
+ query_9I
4436
+ weight?
4437
+ =
4438
+ ;model_distilbert_transformer_layer_4_attention_q_lin_weightE
4439
+ bias=
4440
+ ;
4441
+ 9model_distilbert_transformer_layer_4_attention_q_lin_bias'
4442
+ linear_24
4443
+  
4444
+ 
4445
+ �
4446
+ �*
4447
+ name
4448
+ 
4449
+
4450
+ linear_24j
4451
+ const
4452
+ var_344
4453
+
4454
+ 
4455
+ *
4456
+ name
4457
+ 
4458
+
4459
+ "
4460
+ op_344**
4461
+ val#
4462
+
4463
+ 
4464
+ 
4465
+ 
4466
+
4467
+ reshape
4468
+ x
4469
+
4470
+ linear_24
4471
+ shape
4472
+
4473
+ var_344*
4474
+ var_345
4475
+  
4476
+ 
4477
+ �
4478
+  
4479
+ @*
4480
+ name
4481
+ 
4482
+
4483
+ "
4484
+ op_345�
4485
+ linear
4486
+ x
4487
+
4488
+ query_9I
4489
+ weight?
4490
+ =
4491
+ ;model_distilbert_transformer_layer_4_attention_k_lin_weightE
4492
+ bias=
4493
+ ;
4494
+ 9model_distilbert_transformer_layer_4_attention_k_lin_bias'
4495
+ linear_25
4496
+  
4497
+ 
4498
+ �
4499
+ �*
4500
+ name
4501
+ 
4502
+
4503
+ linear_25j
4504
+ const
4505
+ var_350
4506
+
4507
+ 
4508
+ *
4509
+ name
4510
+ 
4511
+
4512
+ "
4513
+ op_350**
4514
+ val#
4515
+
4516
+ 
4517
+ 
4518
+ 
4519
+
4520
+ reshape
4521
+ x
4522
+
4523
+ linear_25
4524
+ shape
4525
+
4526
+ var_350*
4527
+ var_351
4528
+  
4529
+ 
4530
+ �
4531
+  
4532
+ @*
4533
+ name
4534
+ 
4535
+
4536
+ "
4537
+ op_351�
4538
+ linear
4539
+ x
4540
+
4541
+ query_9I
4542
+ weight?
4543
+ =
4544
+ ;model_distilbert_transformer_layer_4_attention_v_lin_weightE
4545
+ bias=
4546
+ ;
4547
+ 9model_distilbert_transformer_layer_4_attention_v_lin_bias'
4548
+ linear_26
4549
+  
4550
+ 
4551
+ �
4552
+ �*
4553
+ name
4554
+ 
4555
+
4556
+ linear_26j
4557
+ const
4558
+ var_356
4559
+
4560
+ 
4561
+ *
4562
+ name
4563
+ 
4564
+
4565
+ "
4566
+ op_356**
4567
+ val#
4568
+
4569
+ 
4570
+ 
4571
+ 
4572
+
4573
+ reshape
4574
+ x
4575
+
4576
+ linear_26
4577
+ shape
4578
+
4579
+ var_356*
4580
+ var_357
4581
+  
4582
+ 
4583
+ �
4584
+  
4585
+ @*
4586
+ name
4587
+ 
4588
+
4589
+ "
4590
+ op_357h
4591
+ const
4592
+
4593
+ v_9_perm_0
4594
+
4595
+ 
4596
+ *
4597
+ name
4598
+ 
4599
+ "
4600
+
4601
+ v_9_perm_0*!
4602
+ val
4603
+
4604
+ 
4605
+ 
4606
+
4607
+ 
4608
+ h
4609
+ const
4610
+ _inversed_q_19_y_0
4611
+  *(
4612
+ name 
4613
+ 
4614
+ "
4615
+ _inversed_q_19_y_0*
4616
+ val
4617
+  
4618
+
4619
+ 
4620
+ 
4621
+ >�
4622
+ mul
4623
+ x
4624
+
4625
+ var_345
4626
+ y
4627
+ 
4628
+ _inversed_q_19_y_01
4629
+ _inversed_q_19
4630
+  
4631
+ 
4632
+ �
4633
+  
4634
+ @*$
4635
+ name
4636
+ 
4637
+ "
4638
+ _inversed_q_19m
4639
+ const
4640
+ scores_9_transpose_x_0
4641
+ *,
4642
+ name$
4643
+ 
4644
+ "
4645
+ scores_9_transpose_x_0*
4646
+ val
4647
+ 
4648
+ 
4649
+ m
4650
+ const
4651
+ scores_9_transpose_y_0
4652
+ *,
4653
+ name$
4654
+ 
4655
+ "
4656
+ scores_9_transpose_y_0*
4657
+ val
4658
+ 
4659
+ 
4660
+ z
4661
+ const#
4662
+ transpose_26_perm_0
4663
+
4664
+ 
4665
+ *)
4666
+ name!
4667
+ 
4668
+ "
4669
+ transpose_26_perm_0*!
4670
+ val
4671
+
4672
+ 
4673
+ 
4674
+
4675
+ 
4676
+ z
4677
+ const#
4678
+ transpose_27_perm_0
4679
+
4680
+ 
4681
+ *)
4682
+ name!
4683
+ 
4684
+ "
4685
+ transpose_27_perm_0*!
4686
+ val
4687
+
4688
+ 
4689
+ 
4690
+
4691
+ 
4692
+ �
4693
+ transpose
4694
+ x
4695
+
4696
+ var_351
4697
+ perm
4698
+ 
4699
+ transpose_27_perm_0/
4700
+ transpose_35
4701
+  
4702
+ 
4703
+  
4704
+ @
4705
+ �*"
4706
+ name
4707
+ 
4708
+ "
4709
+ transpose_35�
4710
+ transpose
4711
+ x
4712
+ 
4713
+ _inversed_q_19
4714
+ perm
4715
+ 
4716
+ transpose_26_perm_0/
4717
+ transpose_36
4718
+  
4719
+ 
4720
+  
4721
+ �
4722
+ @*"
4723
+ name
4724
+ 
4725
+ "
4726
+ transpose_36�
4727
+ matmul
4728
+ x
4729
+ 
4730
+ transpose_36
4731
+ y
4732
+ 
4733
+ transpose_35)
4734
+ transpose_x
4735
+ 
4736
+ scores_9_transpose_x_0)
4737
+ transpose_y
4738
+ 
4739
+ scores_9_transpose_y_0,
4740
+ scores_9
4741
+  
4742
+ 
4743
+  
4744
+ �
4745
+ �*
4746
+ name
4747
+ 
4748
+ "
4749
+
4750
+ scores_9Q
4751
+ const
4752
+ var_367
4753
+  *
4754
+ name
4755
+ 
4756
+
4757
+ "
4758
+ op_367*
4759
+ val
4760
+  
4761
+
4762
+ 
4763
+ 
4764
+ ����
4765
+ select
4766
+ cond
4767
+
4768
+ 
4769
+ mask_3
4770
+ a
4771
+
4772
+ var_367
4773
+ b
4774
+
4775
+
4776
+ scores_9,
4777
+ input_79
4778
+  
4779
+ 
4780
+  
4781
+ �
4782
+ �*
4783
+ name
4784
+ 
4785
+ "
4786
+
4787
+ input_79}
4788
+ softmax
4789
+ x
4790
+
4791
+
4792
+ input_79
4793
+ axis
4794
+ 
4795
+ var_8,
4796
+ input_81
4797
+  
4798
+ 
4799
+  
4800
+ �
4801
+ �*
4802
+ name
4803
+ 
4804
+ "
4805
+
4806
+ input_81e
4807
+ const
4808
+ x_39_transpose_x_0
4809
+ *(
4810
+ name 
4811
+ 
4812
+ "
4813
+ x_39_transpose_x_0*
4814
+ val
4815
+ 
4816
+ 
4817
+ e
4818
+ const
4819
+ x_39_transpose_y_0
4820
+ *(
4821
+ name 
4822
+ 
4823
+ "
4824
+ x_39_transpose_y_0*
4825
+ val
4826
+ 
4827
+ 
4828
+ �
4829
+ transpose
4830
+ x
4831
+
4832
+ var_357
4833
+ perm
4834
+
4835
+
4836
+ v_9_perm_0/
4837
+ transpose_37
4838
+  
4839
+ 
4840
+  
4841
+ �
4842
+ @*"
4843
+ name
4844
+ 
4845
+ "
4846
+ transpose_37�
4847
+ matmul
4848
+ x
4849
+
4850
+
4851
+ input_81
4852
+ y
4853
+ 
4854
+ transpose_37%
4855
+ transpose_x
4856
+ 
4857
+ x_39_transpose_x_0%
4858
+ transpose_y
4859
+ 
4860
+ x_39_transpose_y_0'
4861
+ x_39
4862
+  
4863
+ 
4864
+  
4865
+ �
4866
+ @*
4867
+ name
4868
+ 
4869
+
4870
+ "
4871
+ x_39o
4872
+ const
4873
+ var_373_perm_0
4874
+
4875
+ 
4876
+ *#
4877
+ name
4878
+ 
4879
+ "
4880
+
4881
+ val
4882
+
4883
+ 
4884
+ 
4885
+
4886
+ 
4887
+ j
4888
+ const
4889
+ var_375
4890
+
4891
+ 
4892
+ *
4893
+ name
4894
+ 
4895
+
4896
+ "
4897
+ op_375**
4898
+ val#
4899
+
4900
+ 
4901
+ 
4902
+ 
4903
+
4904
+ transpose
4905
+ x
4906
+ 
4907
+ x_39
4908
+ perm
4909
+ 
4910
+ var_373_perm_0/
4911
+ transpose_34
4912
+  
4913
+ 
4914
+ �
4915
+  
4916
+ @*"
4917
+ name
4918
+ 
4919
+ "
4920
+ transpose_34~
4921
+ reshape
4922
+ x
4923
+ 
4924
+ transpose_34
4925
+ shape
4926
+
4927
+ var_375&
4928
+ input_83
4929
+  
4930
+ 
4931
+ �
4932
+ �*
4933
+ name
4934
+ 
4935
+ "
4936
+
4937
+ input_83�
4938
+ linear
4939
+ x
4940
+
4941
+
4942
+ input_83K
4943
+ weightA
4944
+ ?
4945
+ =model_distilbert_transformer_layer_4_attention_out_lin_weightG
4946
+ bias?
4947
+ =
4948
+ ;model_distilbert_transformer_layer_4_attention_out_lin_bias'
4949
+ linear_27
4950
+  
4951
+ 
4952
+ �
4953
+ �*
4954
+ name
4955
+ 
4956
+
4957
+ linear_27s
4958
+ add
4959
+ x
4960
+
4961
+ linear_27
4962
+ y
4963
+
4964
+ query_9&
4965
+ input_85
4966
+  
4967
+ 
4968
+ �
4969
+ �*
4970
+ name
4971
+ 
4972
+ "
4973
+
4974
+ input_85x
4975
+ const
4976
+ input_87_axes_0
4977
+
4978
+ 
4979
+ *%
4980
+ name
4981
+ 
4982
+ "
4983
+ input_87_axes_0*'
4984
+ val 
4985
+
4986
+ 
4987
+ 
4988
+ 
4989
+
4990
+ ����������
4991
+
4992
+ layer_norm
4993
+ x
4994
+
4995
+
4996
+ input_85
4997
+ axes
4998
+ 
4999
+ input_87_axes_0F
5000
+ gamma=
5001
+ ;
5002
+ 9model_distilbert_transformer_layer_4_sa_layer_norm_weightC
5003
+ beta;
5004
+ 9
5005
+ 7model_distilbert_transformer_layer_4_sa_layer_norm_bias
5006
+ epsilon
5007
+ 
5008
+ var_6&
5009
+ input_87
5010
+  
5011
+ 
5012
+ �
5013
+ �*
5014
+ name
5015
+ 
5016
+ "
5017
+
5018
+ input_87�
5019
+ linear
5020
+ x
5021
+
5022
+
5023
+ input_87B
5024
+ weight8
5025
+ 6
5026
+ 4model_distilbert_transformer_layer_4_ffn_lin1_weight>
5027
+ bias6
5028
+ 4
5029
+ 2model_distilbert_transformer_layer_4_ffn_lin1_bias'
5030
+ linear_28
5031
+  
5032
+ 
5033
+ �
5034
+ �*
5035
+ name
5036
+ 
5037
+
5038
+ linear_28c
5039
+ const
5040
+ input_91_mode_0
5041
+ *%
5042
+ name
5043
+ 
5044
+ "
5045
+ input_91_mode_0*
5046
+ val
5047
+ 
5048
+ "
5049
+ EXACT
5050
+ gelu
5051
+ x
5052
+
5053
+ linear_28
5054
+ mode
5055
+ 
5056
+ input_91_mode_0&
5057
+ input_91
5058
+  
5059
+ 
5060
+ �
5061
+ �*
5062
+ name
5063
+ 
5064
+ "
5065
+
5066
+ input_91�
5067
+ linear
5068
+ x
5069
+
5070
+
5071
+ input_91B
5072
+ weight8
5073
+ 6
5074
+ 4model_distilbert_transformer_layer_4_ffn_lin2_weight>
5075
+ bias6
5076
+ 4
5077
+ 2model_distilbert_transformer_layer_4_ffn_lin2_bias'
5078
+ linear_29
5079
+  
5080
+ 
5081
+ �
5082
+ �*
5083
+ name
5084
+ 
5085
+
5086
+ linear_29t
5087
+ add
5088
+ x
5089
+
5090
+ linear_29
5091
+ y
5092
+
5093
+
5094
+ input_87&
5095
+ input_95
5096
+  
5097
+ 
5098
+ �
5099
+ �*
5100
+ name
5101
+ 
5102
+ "
5103
+
5104
+ input_95r
5105
+ const
5106
+ query_axes_0
5107
+
5108
+ 
5109
+ *"
5110
+ name
5111
+ 
5112
+ "
5113
+ query_axes_0*'
5114
+ val 
5115
+
5116
+ 
5117
+ 
5118
+ 
5119
+
5120
+ ����������
5121
+
5122
+ layer_norm
5123
+ x
5124
+
5125
+
5126
+ input_95
5127
+ axes
5128
+ 
5129
+ query_axes_0J
5130
+ gammaA
5131
+ ?
5132
+ =model_distilbert_transformer_layer_4_output_layer_norm_weightG
5133
+ beta?
5134
+ =
5135
+ ;model_distilbert_transformer_layer_4_output_layer_norm_bias
5136
+ epsilon
5137
+ 
5138
+ var_6#
5139
+ query
5140
+  
5141
+ 
5142
+ �
5143
+ �*
5144
+ name
5145
+ 
5146
+ "
5147
+ query�
5148
+ linear
5149
+ x
5150
+ 
5151
+ queryI
5152
+ weight?
5153
+ =
5154
+ ;model_distilbert_transformer_layer_5_attention_q_lin_weightE
5155
+ bias=
5156
+ ;
5157
+ 9model_distilbert_transformer_layer_5_attention_q_lin_bias'
5158
+ linear_30
5159
+  
5160
+ 
5161
+ �
5162
+ �*
5163
+ name
5164
+ 
5165
+
5166
+ linear_30j
5167
+ const
5168
+ var_413
5169
+
5170
+ 
5171
+ *
5172
+ name
5173
+ 
5174
+
5175
+ "
5176
+ op_413**
5177
+ val#
5178
+
5179
+ 
5180
+ 
5181
+ 
5182
+
5183
+ reshape
5184
+ x
5185
+
5186
+ linear_30
5187
+ shape
5188
+
5189
+ var_413*
5190
+ var_414
5191
+  
5192
+ 
5193
+ �
5194
+  
5195
+ @*
5196
+ name
5197
+ 
5198
+
5199
+ "
5200
+ op_414�
5201
+ linear
5202
+ x
5203
+ 
5204
+ queryI
5205
+ weight?
5206
+ =
5207
+ ;model_distilbert_transformer_layer_5_attention_k_lin_weightE
5208
+ bias=
5209
+ ;
5210
+ 9model_distilbert_transformer_layer_5_attention_k_lin_bias'
5211
+ linear_31
5212
+  
5213
+ 
5214
+ �
5215
+ �*
5216
+ name
5217
+ 
5218
+
5219
+ linear_31j
5220
+ const
5221
+ var_419
5222
+
5223
+ 
5224
+ *
5225
+ name
5226
+ 
5227
+
5228
+ "
5229
+ op_419**
5230
+ val#
5231
+
5232
+ 
5233
+ 
5234
+ 
5235
+
5236
+ reshape
5237
+ x
5238
+
5239
+ linear_31
5240
+ shape
5241
+
5242
+ var_419*
5243
+ var_420
5244
+  
5245
+ 
5246
+ �
5247
+  
5248
+ @*
5249
+ name
5250
+ 
5251
+
5252
+ "
5253
+ op_420�
5254
+ linear
5255
+ x
5256
+ 
5257
+ queryI
5258
+ weight?
5259
+ =
5260
+ ;model_distilbert_transformer_layer_5_attention_v_lin_weightE
5261
+ bias=
5262
+ ;
5263
+ 9model_distilbert_transformer_layer_5_attention_v_lin_bias'
5264
+ linear_32
5265
+  
5266
+ 
5267
+ �
5268
+ �*
5269
+ name
5270
+ 
5271
+
5272
+ linear_32j
5273
+ const
5274
+ var_425
5275
+
5276
+ 
5277
+ *
5278
+ name
5279
+ 
5280
+
5281
+ "
5282
+ op_425**
5283
+ val#
5284
+
5285
+ 
5286
+ 
5287
+ 
5288
+
5289
+ reshape
5290
+ x
5291
+
5292
+ linear_32
5293
+ shape
5294
+
5295
+ var_425*
5296
+ var_426
5297
+  
5298
+ 
5299
+ �
5300
+  
5301
+ @*
5302
+ name
5303
+ 
5304
+
5305
+ "
5306
+ op_426d
5307
+ const
5308
+ v_perm_0
5309
+
5310
+ 
5311
+ *
5312
+ name
5313
+ 
5314
+ "
5315
+
5316
+ v_perm_0*!
5317
+ val
5318
+
5319
+ 
5320
+ 
5321
+
5322
+ 
5323
+ b
5324
+ const
5325
+ _inversed_q_y_0
5326
+  *%
5327
+ name
5328
+ 
5329
+ "
5330
+ _inversed_q_y_0*
5331
+ val
5332
+  
5333
+
5334
+ 
5335
+ 
5336
+ >�
5337
+ mul
5338
+ x
5339
+
5340
+ var_414
5341
+ y
5342
+ 
5343
+ _inversed_q_y_0.
5344
+ _inversed_q
5345
+  
5346
+ 
5347
+ �
5348
+  
5349
+ @*!
5350
+ name
5351
+ 
5352
+ "
5353
+ _inversed_qi
5354
+ const
5355
+ scores_transpose_x_0
5356
+ **
5357
+ name"
5358
+ 
5359
+ "
5360
+ scores_transpose_x_0*
5361
+ val
5362
+ 
5363
+ 
5364
+ i
5365
+ const
5366
+ scores_transpose_y_0
5367
+ **
5368
+ name"
5369
+ 
5370
+ "
5371
+ scores_transpose_y_0*
5372
+ val
5373
+ 
5374
+ 
5375
+ z
5376
+ const#
5377
+ transpose_28_perm_0
5378
+
5379
+ 
5380
+ *)
5381
+ name!
5382
+ 
5383
+ "
5384
+ transpose_28_perm_0*!
5385
+ val
5386
+
5387
+ 
5388
+ 
5389
+
5390
+ 
5391
+ z
5392
+ const#
5393
+ transpose_29_perm_0
5394
+
5395
+ 
5396
+ *)
5397
+ name!
5398
+ 
5399
+ "
5400
+ transpose_29_perm_0*!
5401
+ val
5402
+
5403
+ 
5404
+ 
5405
+
5406
+ 
5407
+ �
5408
+ transpose
5409
+ x
5410
+
5411
+ var_420
5412
+ perm
5413
+ 
5414
+ transpose_29_perm_0/
5415
+ transpose_31
5416
+  
5417
+ 
5418
+  
5419
+ @
5420
+ �*"
5421
+ name
5422
+ 
5423
+ "
5424
+ transpose_31�
5425
+ transpose
5426
+ x
5427
+
5428
+ _inversed_q
5429
+ perm
5430
+ 
5431
+ transpose_28_perm_0/
5432
+ transpose_32
5433
+  
5434
+ 
5435
+  
5436
+ �
5437
+ @*"
5438
+ name
5439
+ 
5440
+ "
5441
+ transpose_32�
5442
+ matmul
5443
+ x
5444
+ 
5445
+ transpose_32
5446
+ y
5447
+ 
5448
+ transpose_31'
5449
+ transpose_x
5450
+ 
5451
+ scores_transpose_x_0'
5452
+ transpose_y
5453
+ 
5454
+ scores_transpose_y_0*
5455
+ scores
5456
+  
5457
+ 
5458
+  
5459
+ �
5460
+ �*
5461
+ name
5462
+ 
5463
+
5464
+ "
5465
+ scoresQ
5466
+ const
5467
+ var_436
5468
+  *
5469
+ name
5470
+ 
5471
+
5472
+ "
5473
+ op_436*
5474
+ val
5475
+  
5476
+
5477
+ 
5478
+ 
5479
+ ����
5480
+ select
5481
+ cond
5482
+
5483
+ 
5484
+ mask_3
5485
+ a
5486
+
5487
+ var_436
5488
+ b
5489
+
5490
+ 
5491
+ scores,
5492
+ input_97
5493
+  
5494
+ 
5495
+  
5496
+ �
5497
+ �*
5498
+ name
5499
+ 
5500
+ "
5501
+
5502
+ input_97}
5503
+ softmax
5504
+ x
5505
+
5506
+
5507
+ input_97
5508
+ axis
5509
+ 
5510
+ var_8,
5511
+ input_99
5512
+  
5513
+ 
5514
+  
5515
+ �
5516
+ �*
5517
+ name
5518
+ 
5519
+ "
5520
+
5521
+ input_99_
5522
+ const
5523
+ x_transpose_x_0
5524
+ *%
5525
+ name
5526
+ 
5527
+ "
5528
+ x_transpose_x_0*
5529
+ val
5530
+ 
5531
+ 
5532
+ _
5533
+ const
5534
+ x_transpose_y_0
5535
+ *%
5536
+ name
5537
+ 
5538
+ "
5539
+ x_transpose_y_0*
5540
+ val
5541
+ 
5542
+ 
5543
+ �
5544
+ transpose
5545
+ x
5546
+
5547
+ var_426
5548
+ perm
5549
+
5550
+
5551
+ v_perm_0/
5552
+ transpose_33
5553
+  
5554
+ 
5555
+  
5556
+ �
5557
+ @*"
5558
+ name
5559
+ 
5560
+ "
5561
+ transpose_33�
5562
+ matmul
5563
+ x
5564
+
5565
+
5566
+ input_99
5567
+ y
5568
+ 
5569
+ transpose_33"
5570
+ transpose_x
5571
+ 
5572
+ x_transpose_x_0"
5573
+ transpose_y
5574
+ 
5575
+ x_transpose_y_0$
5576
+ x
5577
+  
5578
+ 
5579
+  
5580
+ �
5581
+ @*
5582
+ name
5583
+ 
5584
+ "
5585
+ xo
5586
+ const
5587
+ var_442_perm_0
5588
+
5589
+ 
5590
+ *#
5591
+ name
5592
+ 
5593
+ "
5594
+
5595
+ val
5596
+
5597
+ 
5598
+ 
5599
+
5600
+ 
5601
+ j
5602
+ const
5603
+ var_444
5604
+
5605
+ 
5606
+ *
5607
+ name
5608
+ 
5609
+
5610
+ "
5611
+ op_444**
5612
+ val#
5613
+
5614
+ 
5615
+ 
5616
+ 
5617
+
5618
+ transpose
5619
+
5620
+ x
5621
+ 
5622
+ x
5623
+ perm
5624
+ 
5625
+ var_442_perm_0/
5626
+ transpose_30
5627
+  
5628
+ 
5629
+ �
5630
+  
5631
+ @*"
5632
+ name
5633
+ 
5634
+ "
5635
+ transpose_30�
5636
+ reshape
5637
+ x
5638
+ 
5639
+ transpose_30
5640
+ shape
5641
+
5642
+ var_444'
5643
+ input_101
5644
+  
5645
+ 
5646
+ �
5647
+ �*
5648
+ name
5649
+ 
5650
+
5651
+ input_101�
5652
+ linear
5653
+ x
5654
+
5655
+ input_101K
5656
+ weightA
5657
+ ?
5658
+ =model_distilbert_transformer_layer_5_attention_out_lin_weightG
5659
+ bias?
5660
+ =
5661
+ ;model_distilbert_transformer_layer_5_attention_out_lin_bias'
5662
+ linear_33
5663
+  
5664
+ 
5665
+ �
5666
+ �*
5667
+ name
5668
+ 
5669
+
5670
+ linear_33s
5671
+ add
5672
+ x
5673
+
5674
+ linear_33
5675
+ y
5676
+ 
5677
+ query'
5678
+ input_103
5679
+  
5680
+ 
5681
+ �
5682
+ �*
5683
+ name
5684
+ 
5685
+
5686
+ input_103z
5687
+ const
5688
+ input_105_axes_0
5689
+
5690
+ 
5691
+ *&
5692
+ name
5693
+ 
5694
+ "
5695
+ input_105_axes_0*'
5696
+ val 
5697
+
5698
+ 
5699
+ 
5700
+ 
5701
+
5702
+ ����������
5703
+
5704
+ layer_norm
5705
+ x
5706
+
5707
+ input_103
5708
+ axes
5709
+ 
5710
+ input_105_axes_0F
5711
+ gamma=
5712
+ ;
5713
+ 9model_distilbert_transformer_layer_5_sa_layer_norm_weightC
5714
+ beta;
5715
+ 9
5716
+ 7model_distilbert_transformer_layer_5_sa_layer_norm_bias
5717
+ epsilon
5718
+ 
5719
+ var_6'
5720
+ input_105
5721
+  
5722
+ 
5723
+ �
5724
+ �*
5725
+ name
5726
+ 
5727
+
5728
+ input_105�
5729
+ linear
5730
+ x
5731
+
5732
+ input_105B
5733
+ weight8
5734
+ 6
5735
+ 4model_distilbert_transformer_layer_5_ffn_lin1_weight>
5736
+ bias6
5737
+ 4
5738
+ 2model_distilbert_transformer_layer_5_ffn_lin1_bias'
5739
+ linear_34
5740
+  
5741
+ 
5742
+ �
5743
+ �*
5744
+ name
5745
+ 
5746
+
5747
+ linear_34e
5748
+ const
5749
+ input_109_mode_0
5750
+ *&
5751
+ name
5752
+ 
5753
+ "
5754
+ input_109_mode_0*
5755
+ val
5756
+ 
5757
+ "
5758
+ EXACT�
5759
+ gelu
5760
+ x
5761
+
5762
+ linear_34
5763
+ mode
5764
+ 
5765
+ input_109_mode_0'
5766
+ input_109
5767
+  
5768
+ 
5769
+ �
5770
+ �*
5771
+ name
5772
+ 
5773
+
5774
+ input_109�
5775
+ linear
5776
+ x
5777
+
5778
+ input_109B
5779
+ weight8
5780
+ 6
5781
+ 4model_distilbert_transformer_layer_5_ffn_lin2_weight>
5782
+ bias6
5783
+ 4
5784
+ 2model_distilbert_transformer_layer_5_ffn_lin2_bias'
5785
+ linear_35
5786
+  
5787
+ 
5788
+ �
5789
+ �*
5790
+ name
5791
+ 
5792
+
5793
+ linear_35w
5794
+ add
5795
+ x
5796
+
5797
+ linear_35
5798
+ y
5799
+
5800
+ input_105'
5801
+ input_113
5802
+  
5803
+ 
5804
+ �
5805
+ �*
5806
+ name
5807
+ 
5808
+
5809
+ input_113z
5810
+ const
5811
+ input_115_axes_0
5812
+
5813
+ 
5814
+ *&
5815
+ name
5816
+ 
5817
+ "
5818
+ input_115_axes_0*'
5819
+ val 
5820
+
5821
+ 
5822
+ 
5823
+ 
5824
+
5825
+ ����������
5826
+
5827
+ layer_norm
5828
+ x
5829
+
5830
+ input_113
5831
+ axes
5832
+ 
5833
+ input_115_axes_0J
5834
+ gammaA
5835
+ ?
5836
+ =model_distilbert_transformer_layer_5_output_layer_norm_weightG
5837
+ beta?
5838
+ =
5839
+ ;model_distilbert_transformer_layer_5_output_layer_norm_bias
5840
+ epsilon
5841
+ 
5842
+ var_6'
5843
+ input_115
5844
+  
5845
+ 
5846
+ �
5847
+ �*
5848
+ name
5849
+ 
5850
+
5851
+ input_115�
5852
+ linear
5853
+ x
5854
+
5855
+ input_115%
5856
+ weight
5857
+ 
5858
+ model_qa_outputs_weight!
5859
+ bias
5860
+ 
5861
+ model_qa_outputs_bias&
5862
+ linear_36
5863
+  
5864
+ 
5865
+ �
5866
+ *
5867
+ name
5868
+ 
5869
+
5870
+ linear_36^
5871
+ const
5872
+ tile_0
5873
+
5874
+ 
5875
+ *
5876
+ name
5877
+ 
5878
+
5879
+ "
5880
+ tile_0*
5881
+ val
5882
+
5883
+ 
5884
+ 
5885
+ 
5886
+ e
5887
+ const
5888
+ var_473_axis_0
5889
+ *#
5890
+ name
5891
+ 
5892
+ "
5893
+
5894
+ val
5895
+ 
5896
+ 
5897
+
5898
+ ����������
5899
+ split
5900
+ x
5901
+
5902
+ linear_36
5903
+ split_sizes
5904
+
5905
+ 
5906
+ tile_0
5907
+ axis
5908
+ 
5909
+ var_473_axis_0&
5910
+ var_473_0
5911
+  
5912
+ 
5913
+ �
5914
+ &
5915
+ var_473_1
5916
+  
5917
+ 
5918
+ �
5919
+ *
5920
+ name
5921
+ 
5922
+
5923
+ "
5924
+ op_473u
5925
+ const
5926
+ var_476_axes_0
5927
+
5928
+ 
5929
+ *#
5930
+ name
5931
+ 
5932
+ "
5933
+
5934
+ val 
5935
+
5936
+ 
5937
+ 
5938
+ 
5939
+
5940
+ ���������w
5941
+ squeeze
5942
+ x
5943
+
5944
+ var_473_0
5945
+ axes
5946
+ 
5947
+ var_476_axes_0
5948
+ var_476
5949
+  
5950
+ 
5951
+ �*
5952
+ name
5953
+ 
5954
+
5955
+ "
5956
+ op_476u
5957
+ const
5958
+ var_478_axes_0
5959
+
5960
+ 
5961
+ *#
5962
+ name
5963
+ 
5964
+ "
5965
+
5966
+ val 
5967
+
5968
+ 
5969
+ 
5970
+ 
5971
+
5972
+ ���������w
5973
+ squeeze
5974
+ x
5975
+
5976
+ var_473_1
5977
+ axes
5978
+ 
5979
+ var_478_axes_0
5980
+ var_478
5981
+  
5982
+ 
5983
+ �*
5984
+ name
5985
+ 
5986
+
5987
+ "
5988
+ op_478W
5989
+ const
5990
+ var_483
5991
+ *
5992
+ name
5993
+ 
5994
+
5995
+ "
5996
+ op_483*
5997
+ val
5998
+ 
5999
+ 
6000
+
6001
+ ���������s
6002
+ softmax
6003
+ x
6004
+
6005
+ var_476
6006
+ axis
6007
+
6008
+ var_483#
6009
+ start_scores
6010
+  
6011
+ 
6012
+ �*
6013
+ name
6014
+ 
6015
+
6016
+ "
6017
+ op_485W
6018
+ const
6019
+ var_486
6020
+ *
6021
+ name
6022
+ 
6023
+
6024
+ "
6025
+ op_486*
6026
+ val
6027
+ 
6028
+ 
6029
+
6030
+ ���������q
6031
+ softmax
6032
+ x
6033
+
6034
+ var_478
6035
+ axis
6036
+
6037
+ var_486!
6038
+
6039
+ end_scores
6040
+  
6041
+ 
6042
+ �*
6043
+ name
6044
+ 
6045
+
6046
+ "
6047
+ op_488"�
6048
+ buildInfo�"
6049
+ 
6050
+ 
6051
+ |"z
6052
+ 6
6053
+ !
6054
+ 
6055
+ "
6056
+ coremltools-version
6057
+ 
6058
+ "
6059
+ 7.0
6060
+ @
6061
+ )
6062
+ !
6063
+ "
6064
+ coremltools-component-torch
6065
+ 
6066
+ "
6067
+ 2.0.1
coreml/question-answering/float32_model.mlpackage/Data/com.apple.CoreML/weights/weight.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf64c1de64f11ebdf1dfe1bf2461494df25405babb3c5c02543adb26a326f70c
3
+ size 259596672
coreml/question-answering/float32_model.mlpackage/Manifest.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "fileFormatVersion": "1.0.0",
3
+ "itemInfoEntries": {
4
+ "82C25092-9F49-4A92-BD16-169B1EFF029F": {
5
+ "author": "com.apple.CoreML",
6
+ "description": "CoreML Model Specification",
7
+ "name": "model.mlmodel",
8
+ "path": "com.apple.CoreML/model.mlmodel"
9
+ },
10
+ "98D12E75-45FE-45DE-96A0-29931CC6E36B": {
11
+ "author": "com.apple.CoreML",
12
+ "description": "CoreML Model Weights",
13
+ "name": "weights",
14
+ "path": "com.apple.CoreML/weights"
15
+ }
16
+ },
17
+ "rootModelIdentifier": "82C25092-9F49-4A92-BD16-169B1EFF029F"
18
+ }