freeman commited on
Commit
8a31019
·
1 Parent(s): 6cdc0aa

Add Core ML conversion

Browse files

Core ML conversion, task=feature-extraction, precision=float32

coreml/feature-extraction/float16_model.mlpackage/Data/com.apple.CoreML/model.mlmodel ADDED
Binary file (64.8 kB). View file
 
coreml/feature-extraction/float16_model.mlpackage/Data/com.apple.CoreML/weights/weight.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69f5138ebdb99c4274d1d187fd592975b499da3f899b4cdb9f0a10cb13e85a22
3
+ size 132142400
coreml/feature-extraction/float16_model.mlpackage/Manifest.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "fileFormatVersion": "1.0.0",
3
+ "itemInfoEntries": {
4
+ "0BAF5254-2B16-4E7E-B010-34A829151ED2": {
5
+ "author": "com.apple.CoreML",
6
+ "description": "CoreML Model Weights",
7
+ "name": "weights",
8
+ "path": "com.apple.CoreML/weights"
9
+ },
10
+ "9078B76F-40A0-4B9A-A050-683A1D453CFB": {
11
+ "author": "com.apple.CoreML",
12
+ "description": "CoreML Model Specification",
13
+ "name": "model.mlmodel",
14
+ "path": "com.apple.CoreML/model.mlmodel"
15
+ }
16
+ },
17
+ "rootModelIdentifier": "9078B76F-40A0-4B9A-A050-683A1D453CFB"
18
+ }
coreml/feature-extraction/float32_model.mlpackage/Data/com.apple.CoreML/model.mlmodel ADDED
@@ -0,0 +1,5868 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ �
2
+ L
3
+ input_ids2Indices of input sequence tokens in the vocabulary *
4
+ ���
5
+ w
6
+ attention_maskXMask to avoid performing attention on padding token indices (1 = not masked, 0 = masked) *
7
+ ���Rc
8
+ last_hidden_stateFSequence of hidden-states at the output of the last layer of the model*����
9
+ ,distilbert-base-uncased (feature-extraction)�3
10
+ #com.github.apple.coremltools.source torch==2.0.1�-
11
+ $com.github.apple.coremltools.version7.0b1�8
12
+ co.huggingface.exporters.namedistilbert-base-uncased�3
13
+ co.huggingface.exporters.taskfeature-extraction�>
14
+ %co.huggingface.exporters.architectureDistilBertForMaskedLM�-
15
+ "co.huggingface.exporters.frameworkpytorch�-
16
+ "co.huggingface.exporters.precisionfloat32�#
17
+ transformers_version 4.10.0.dev0�����
18
+ main��
19
+
20
+ input_ids
21
+ 
22
+ 
23
+ �
24
+ %
25
+ attention_mask
26
+ 
27
+ 
28
+ �CoreML5��
29
+ CoreML5��last_hidden_state�
30
+ const@
31
+ 'model_embeddings_word_embeddings_weight
32
+  
33
+ ��
34
+ �*=
35
+ name5
36
+ -
37
+ +")
38
+ 'model_embeddings_word_embeddings_weight*B
39
+ val;
40
+  
41
+ ��
42
+ �*"
43
+ @model_path/weights/weight.bin@�
44
+ const0
45
+ model_embeddings_LayerNorm_bias
46
+  
47
+ �*5
48
+ name-
49
+ %
50
+ #"!
51
+ model_embeddings_LayerNorm_bias*=
52
+ val6
53
+  
54
+ �*%
55
+ @model_path/weights/weight.bin���,�
56
+ const2
57
+ !model_embeddings_LayerNorm_weight
58
+  
59
+ �*7
60
+ name/
61
+ '
62
+ %"#
63
+ !model_embeddings_LayerNorm_weight*=
64
+ val6
65
+  
66
+ �*%
67
+ @model_path/weights/weight.bin���,�
68
+ const?
69
+ .model_transformer_layer_0_attention_q_lin_bias
70
+  
71
+ �*D
72
+ name<
73
+ 4
74
+ 2"0
75
+ .model_transformer_layer_0_attention_q_lin_bias*=
76
+ val6
77
+  
78
+ �*%
79
+ @model_path/weights/weight.bin���,�
80
+ constH
81
+ 0model_transformer_layer_0_attention_q_lin_weight
82
+  
83
+ �
84
+ �*F
85
+ name>
86
+ 6
87
+ 4"2
88
+ 0model_transformer_layer_0_attention_q_lin_weight*D
89
+ val=
90
+  
91
+ �
92
+ �*%
93
+ @model_path/weights/weight.bin���,�
94
+ const?
95
+ .model_transformer_layer_0_attention_k_lin_bias
96
+  
97
+ �*D
98
+ name<
99
+ 4
100
+ 2"0
101
+ .model_transformer_layer_0_attention_k_lin_bias*=
102
+ val6
103
+  
104
+ �*%
105
+ @model_path/weights/weight.bin���-�
106
+ constH
107
+ 0model_transformer_layer_0_attention_k_lin_weight
108
+  
109
+ �
110
+ �*F
111
+ name>
112
+ 6
113
+ 4"2
114
+ 0model_transformer_layer_0_attention_k_lin_weight*D
115
+ val=
116
+  
117
+ �
118
+ �*%
119
+ @model_path/weights/weight.bin���-�
120
+ const?
121
+ .model_transformer_layer_0_attention_v_lin_bias
122
+  
123
+ �*D
124
+ name<
125
+ 4
126
+ 2"0
127
+ .model_transformer_layer_0_attention_v_lin_bias*=
128
+ val6
129
+  
130
+ �*%
131
+ @model_path/weights/weight.bin���.�
132
+ constH
133
+ 0model_transformer_layer_0_attention_v_lin_weight
134
+  
135
+ �
136
+ �*F
137
+ name>
138
+ 6
139
+ 4"2
140
+ 0model_transformer_layer_0_attention_v_lin_weight*D
141
+ val=
142
+  
143
+ �
144
+ �*%
145
+ @model_path/weights/weight.bin���.�
146
+ constA
147
+ 0model_transformer_layer_0_attention_out_lin_bias
148
+  
149
+ �*F
150
+ name>
151
+ 6
152
+ 4"2
153
+ 0model_transformer_layer_0_attention_out_lin_bias*=
154
+ val6
155
+  
156
+ �*%
157
+ @model_path/weights/weight.bin��0�
158
+ constJ
159
+ 2model_transformer_layer_0_attention_out_lin_weight
160
+  
161
+ �
162
+ �*H
163
+ name@
164
+ 8
165
+ 6"4
166
+ 2model_transformer_layer_0_attention_out_lin_weight*D
167
+ val=
168
+  
169
+ �
170
+ �*%
171
+ @model_path/weights/weight.bin���0�
172
+ const=
173
+ ,model_transformer_layer_0_sa_layer_norm_bias
174
+  
175
+ �*B
176
+ name:
177
+ 2
178
+ 0".
179
+ ,model_transformer_layer_0_sa_layer_norm_bias*=
180
+ val6
181
+  
182
+ �*%
183
+ @model_path/weights/weight.bin���1�
184
+ const?
185
+ .model_transformer_layer_0_sa_layer_norm_weight
186
+  
187
+ �*D
188
+ name<
189
+ 4
190
+ 2"0
191
+ .model_transformer_layer_0_sa_layer_norm_weight*=
192
+ val6
193
+  
194
+ �*%
195
+ @model_path/weights/weight.bin���1�
196
+ const8
197
+ 'model_transformer_layer_0_ffn_lin1_bias
198
+  
199
+ �*=
200
+ name5
201
+ -
202
+ +")
203
+ 'model_transformer_layer_0_ffn_lin1_bias*=
204
+ val6
205
+  
206
+ �*%
207
+ @model_path/weights/weight.bin���1�
208
+ constA
209
+ )model_transformer_layer_0_ffn_lin1_weight
210
+  
211
+ �
212
+ �*?
213
+ name7
214
+ /
215
+ -"+
216
+ )model_transformer_layer_0_ffn_lin1_weight*D
217
+ val=
218
+  
219
+ �
220
+ �*%
221
+ @model_path/weights/weight.bin���1�
222
+ const8
223
+ 'model_transformer_layer_0_ffn_lin2_bias
224
+  
225
+ �*=
226
+ name5
227
+ -
228
+ +")
229
+ 'model_transformer_layer_0_ffn_lin2_bias*=
230
+ val6
231
+  
232
+ �*%
233
+ @model_path/weights/weight.bin���5�
234
+ constA
235
+ )model_transformer_layer_0_ffn_lin2_weight
236
+  
237
+ �
238
+ �*?
239
+ name7
240
+ /
241
+ -"+
242
+ )model_transformer_layer_0_ffn_lin2_weight*D
243
+ val=
244
+  
245
+ �
246
+ �*%
247
+ @model_path/weights/weight.bin���5�
248
+ constA
249
+ 0model_transformer_layer_0_output_layer_norm_bias
250
+  
251
+ �*F
252
+ name>
253
+ 6
254
+ 4"2
255
+ 0model_transformer_layer_0_output_layer_norm_bias*=
256
+ val6
257
+  
258
+ �*%
259
+ @model_path/weights/weight.bin���:�
260
+ constC
261
+ 2model_transformer_layer_0_output_layer_norm_weight
262
+  
263
+ �*H
264
+ name@
265
+ 8
266
+ 6"4
267
+ 2model_transformer_layer_0_output_layer_norm_weight*=
268
+ val6
269
+  
270
+ �*%
271
+ @model_path/weights/weight.bin�ɝ:�
272
+ const?
273
+ .model_transformer_layer_1_attention_q_lin_bias
274
+  
275
+ �*D
276
+ name<
277
+ 4
278
+ 2"0
279
+ .model_transformer_layer_1_attention_q_lin_bias*=
280
+ val6
281
+  
282
+ �*%
283
+ @model_path/weights/weight.bin��:�
284
+ constH
285
+ 0model_transformer_layer_1_attention_q_lin_weight
286
+  
287
+ �
288
+ �*F
289
+ name>
290
+ 6
291
+ 4"2
292
+ 0model_transformer_layer_1_attention_q_lin_weight*D
293
+ val=
294
+  
295
+ �
296
+ �*%
297
+ @model_path/weights/weight.bin���:�
298
+ const?
299
+ .model_transformer_layer_1_attention_k_lin_bias
300
+  
301
+ �*D
302
+ name<
303
+ 4
304
+ 2"0
305
+ .model_transformer_layer_1_attention_k_lin_bias*=
306
+ val6
307
+  
308
+ �*%
309
+ @model_path/weights/weight.bin���;�
310
+ constH
311
+ 0model_transformer_layer_1_attention_k_lin_weight
312
+  
313
+ �
314
+ �*F
315
+ name>
316
+ 6
317
+ 4"2
318
+ 0model_transformer_layer_1_attention_k_lin_weight*D
319
+ val=
320
+  
321
+ �
322
+ �*%
323
+ @model_path/weights/weight.bin���;�
324
+ const?
325
+ .model_transformer_layer_1_attention_v_lin_bias
326
+  
327
+ �*D
328
+ name<
329
+ 4
330
+ 2"0
331
+ .model_transformer_layer_1_attention_v_lin_bias*=
332
+ val6
333
+  
334
+ �*%
335
+ @model_path/weights/weight.bin���<�
336
+ constH
337
+ 0model_transformer_layer_1_attention_v_lin_weight
338
+  
339
+ �
340
+ �*F
341
+ name>
342
+ 6
343
+ 4"2
344
+ 0model_transformer_layer_1_attention_v_lin_weight*D
345
+ val=
346
+  
347
+ �
348
+ �*%
349
+ @model_path/weights/weight.bin���<�
350
+ constA
351
+ 0model_transformer_layer_1_attention_out_lin_bias
352
+  
353
+ �*F
354
+ name>
355
+ 6
356
+ 4"2
357
+ 0model_transformer_layer_1_attention_out_lin_bias*=
358
+ val6
359
+  
360
+ �*%
361
+ @model_path/weights/weight.bin���=�
362
+ constJ
363
+ 2model_transformer_layer_1_attention_out_lin_weight
364
+  
365
+ �
366
+ �*H
367
+ name@
368
+ 8
369
+ 6"4
370
+ 2model_transformer_layer_1_attention_out_lin_weight*D
371
+ val=
372
+  
373
+ �
374
+ �*%
375
+ @model_path/weights/weight.bin���=�
376
+ const=
377
+ ,model_transformer_layer_1_sa_layer_norm_bias
378
+  
379
+ �*B
380
+ name:
381
+ 2
382
+ 0".
383
+ ,model_transformer_layer_1_sa_layer_norm_bias*=
384
+ val6
385
+  
386
+ �*%
387
+ @model_path/weights/weight.bin���>�
388
+ const?
389
+ .model_transformer_layer_1_sa_layer_norm_weight
390
+  
391
+ �*D
392
+ name<
393
+ 4
394
+ 2"0
395
+ .model_transformer_layer_1_sa_layer_norm_weight*=
396
+ val6
397
+  
398
+ �*%
399
+ @model_path/weights/weight.bin���>�
400
+ const8
401
+ 'model_transformer_layer_1_ffn_lin1_bias
402
+  
403
+ �*=
404
+ name5
405
+ -
406
+ +")
407
+ 'model_transformer_layer_1_ffn_lin1_bias*=
408
+ val6
409
+  
410
+ �*%
411
+ @model_path/weights/weight.bin���>�
412
+ constA
413
+ )model_transformer_layer_1_ffn_lin1_weight
414
+  
415
+ �
416
+ �*?
417
+ name7
418
+ /
419
+ -"+
420
+ )model_transformer_layer_1_ffn_lin1_weight*D
421
+ val=
422
+  
423
+ �
424
+ �*%
425
+ @model_path/weights/weight.bin���>�
426
+ const8
427
+ 'model_transformer_layer_1_ffn_lin2_bias
428
+  
429
+ �*=
430
+ name5
431
+ -
432
+ +")
433
+ 'model_transformer_layer_1_ffn_lin2_bias*=
434
+ val6
435
+  
436
+ �*%
437
+ @model_path/weights/weight.bin�؟C�
438
+ constA
439
+ )model_transformer_layer_1_ffn_lin2_weight
440
+  
441
+ �
442
+ �*?
443
+ name7
444
+ /
445
+ -"+
446
+ )model_transformer_layer_1_ffn_lin2_weight*D
447
+ val=
448
+  
449
+ �
450
+ �*%
451
+ @model_path/weights/weight.bin��C�
452
+ constA
453
+ 0model_transformer_layer_1_output_layer_norm_bias
454
+  
455
+ �*F
456
+ name>
457
+ 6
458
+ 4"2
459
+ 0model_transformer_layer_1_output_layer_norm_bias*=
460
+ val6
461
+  
462
+ �*%
463
+ @model_path/weights/weight.bin���G�
464
+ constC
465
+ 2model_transformer_layer_1_output_layer_norm_weight
466
+  
467
+ �*H
468
+ name@
469
+ 8
470
+ 6"4
471
+ 2model_transformer_layer_1_output_layer_norm_weight*=
472
+ val6
473
+  
474
+ �*%
475
+ @model_path/weights/weight.bin���G�
476
+ const?
477
+ .model_transformer_layer_2_attention_q_lin_bias
478
+  
479
+ �*D
480
+ name<
481
+ 4
482
+ 2"0
483
+ .model_transformer_layer_2_attention_q_lin_bias*=
484
+ val6
485
+  
486
+ �*%
487
+ @model_path/weights/weight.bin���G�
488
+ constH
489
+ 0model_transformer_layer_2_attention_q_lin_weight
490
+  
491
+ �
492
+ �*F
493
+ name>
494
+ 6
495
+ 4"2
496
+ 0model_transformer_layer_2_attention_q_lin_weight*D
497
+ val=
498
+  
499
+ �
500
+ �*%
501
+ @model_path/weights/weight.bin���G�
502
+ const?
503
+ .model_transformer_layer_2_attention_k_lin_bias
504
+  
505
+ �*D
506
+ name<
507
+ 4
508
+ 2"0
509
+ .model_transformer_layer_2_attention_k_lin_bias*=
510
+ val6
511
+  
512
+ �*%
513
+ @model_path/weights/weight.bin���H�
514
+ constH
515
+ 0model_transformer_layer_2_attention_k_lin_weight
516
+  
517
+ �
518
+ �*F
519
+ name>
520
+ 6
521
+ 4"2
522
+ 0model_transformer_layer_2_attention_k_lin_weight*D
523
+ val=
524
+  
525
+ �
526
+ �*%
527
+ @model_path/weights/weight.bin���H�
528
+ const?
529
+ .model_transformer_layer_2_attention_v_lin_bias
530
+  
531
+ �*D
532
+ name<
533
+ 4
534
+ 2"0
535
+ .model_transformer_layer_2_attention_v_lin_bias*=
536
+ val6
537
+  
538
+ �*%
539
+ @model_path/weights/weight.bin�ԀJ�
540
+ constH
541
+ 0model_transformer_layer_2_attention_v_lin_weight
542
+  
543
+ �
544
+ �*F
545
+ name>
546
+ 6
547
+ 4"2
548
+ 0model_transformer_layer_2_attention_v_lin_weight*D
549
+ val=
550
+  
551
+ �
552
+ �*%
553
+ @model_path/weights/weight.bin��J�
554
+ constA
555
+ 0model_transformer_layer_2_attention_out_lin_bias
556
+  
557
+ �*F
558
+ name>
559
+ 6
560
+ 4"2
561
+ 0model_transformer_layer_2_attention_out_lin_bias*=
562
+ val6
563
+  
564
+ �*%
565
+ @model_path/weights/weight.bin��K�
566
+ constJ
567
+ 2model_transformer_layer_2_attention_out_lin_weight
568
+  
569
+ �
570
+ �*H
571
+ name@
572
+ 8
573
+ 6"4
574
+ 2model_transformer_layer_2_attention_out_lin_weight*D
575
+ val=
576
+  
577
+ �
578
+ �*%
579
+ @model_path/weights/weight.bin���K�
580
+ const=
581
+ ,model_transformer_layer_2_sa_layer_norm_bias
582
+  
583
+ �*B
584
+ name:
585
+ 2
586
+ 0".
587
+ ,model_transformer_layer_2_sa_layer_norm_bias*=
588
+ val6
589
+  
590
+ �*%
591
+ @model_path/weights/weight.bin���L�
592
+ const?
593
+ .model_transformer_layer_2_sa_layer_norm_weight
594
+  
595
+ �*D
596
+ name<
597
+ 4
598
+ 2"0
599
+ .model_transformer_layer_2_sa_layer_norm_weight*=
600
+ val6
601
+  
602
+ �*%
603
+ @model_path/weights/weight.bin���L�
604
+ const8
605
+ 'model_transformer_layer_2_ffn_lin1_bias
606
+  
607
+ �*=
608
+ name5
609
+ -
610
+ +")
611
+ 'model_transformer_layer_2_ffn_lin1_bias*=
612
+ val6
613
+  
614
+ �*%
615
+ @model_path/weights/weight.bin���L�
616
+ constA
617
+ )model_transformer_layer_2_ffn_lin1_weight
618
+  
619
+ �
620
+ �*?
621
+ name7
622
+ /
623
+ -"+
624
+ )model_transformer_layer_2_ffn_lin1_weight*D
625
+ val=
626
+  
627
+ �
628
+ �*%
629
+ @model_path/weights/weight.bin���L�
630
+ const8
631
+ 'model_transformer_layer_2_ffn_lin2_bias
632
+  
633
+ �*=
634
+ name5
635
+ -
636
+ +")
637
+ 'model_transformer_layer_2_ffn_lin2_bias*=
638
+ val6
639
+  
640
+ �*%
641
+ @model_path/weights/weight.bin���P�
642
+ constA
643
+ )model_transformer_layer_2_ffn_lin2_weight
644
+  
645
+ �
646
+ �*?
647
+ name7
648
+ /
649
+ -"+
650
+ )model_transformer_layer_2_ffn_lin2_weight*D
651
+ val=
652
+  
653
+ �
654
+ �*%
655
+ @model_path/weights/weight.bin���P�
656
+ constA
657
+ 0model_transformer_layer_2_output_layer_norm_bias
658
+  
659
+ �*F
660
+ name>
661
+ 6
662
+ 4"2
663
+ 0model_transformer_layer_2_output_layer_norm_bias*=
664
+ val6
665
+  
666
+ �*%
667
+ @model_path/weights/weight.bin���U�
668
+ constC
669
+ 2model_transformer_layer_2_output_layer_norm_weight
670
+  
671
+ �*H
672
+ name@
673
+ 8
674
+ 6"4
675
+ 2model_transformer_layer_2_output_layer_norm_weight*=
676
+ val6
677
+  
678
+ �*%
679
+ @model_path/weights/weight.bin�ɢU�
680
+ const?
681
+ .model_transformer_layer_3_attention_q_lin_bias
682
+  
683
+ �*D
684
+ name<
685
+ 4
686
+ 2"0
687
+ .model_transformer_layer_3_attention_q_lin_bias*=
688
+ val6
689
+  
690
+ �*%
691
+ @model_path/weights/weight.bin��U�
692
+ constH
693
+ 0model_transformer_layer_3_attention_q_lin_weight
694
+  
695
+ �
696
+ �*F
697
+ name>
698
+ 6
699
+ 4"2
700
+ 0model_transformer_layer_3_attention_q_lin_weight*D
701
+ val=
702
+  
703
+ �
704
+ �*%
705
+ @model_path/weights/weight.bin���U�
706
+ const?
707
+ .model_transformer_layer_3_attention_k_lin_bias
708
+  
709
+ �*D
710
+ name<
711
+ 4
712
+ 2"0
713
+ .model_transformer_layer_3_attention_k_lin_bias*=
714
+ val6
715
+  
716
+ �*%
717
+ @model_path/weights/weight.bin���V�
718
+ constH
719
+ 0model_transformer_layer_3_attention_k_lin_weight
720
+  
721
+ �
722
+ �*F
723
+ name>
724
+ 6
725
+ 4"2
726
+ 0model_transformer_layer_3_attention_k_lin_weight*D
727
+ val=
728
+  
729
+ �
730
+ �*%
731
+ @model_path/weights/weight.bin���V�
732
+ const?
733
+ .model_transformer_layer_3_attention_v_lin_bias
734
+  
735
+ �*D
736
+ name<
737
+ 4
738
+ 2"0
739
+ .model_transformer_layer_3_attention_v_lin_bias*=
740
+ val6
741
+  
742
+ �*%
743
+ @model_path/weights/weight.bin���W�
744
+ constH
745
+ 0model_transformer_layer_3_attention_v_lin_weight
746
+  
747
+ �
748
+ �*F
749
+ name>
750
+ 6
751
+ 4"2
752
+ 0model_transformer_layer_3_attention_v_lin_weight*D
753
+ val=
754
+  
755
+ �
756
+ �*%
757
+ @model_path/weights/weight.bin���W�
758
+ constA
759
+ 0model_transformer_layer_3_attention_out_lin_bias
760
+  
761
+ �*F
762
+ name>
763
+ 6
764
+ 4"2
765
+ 0model_transformer_layer_3_attention_out_lin_bias*=
766
+ val6
767
+  
768
+ �*%
769
+ @model_path/weights/weight.bin���X�
770
+ constJ
771
+ 2model_transformer_layer_3_attention_out_lin_weight
772
+  
773
+ �
774
+ �*H
775
+ name@
776
+ 8
777
+ 6"4
778
+ 2model_transformer_layer_3_attention_out_lin_weight*D
779
+ val=
780
+  
781
+ �
782
+ �*%
783
+ @model_path/weights/weight.bin���X�
784
+ const=
785
+ ,model_transformer_layer_3_sa_layer_norm_bias
786
+  
787
+ �*B
788
+ name:
789
+ 2
790
+ 0".
791
+ ,model_transformer_layer_3_sa_layer_norm_bias*=
792
+ val6
793
+  
794
+ �*%
795
+ @model_path/weights/weight.bin���Y�
796
+ const?
797
+ .model_transformer_layer_3_sa_layer_norm_weight
798
+  
799
+ �*D
800
+ name<
801
+ 4
802
+ 2"0
803
+ .model_transformer_layer_3_sa_layer_norm_weight*=
804
+ val6
805
+  
806
+ �*%
807
+ @model_path/weights/weight.bin���Y�
808
+ const8
809
+ 'model_transformer_layer_3_ffn_lin1_bias
810
+  
811
+ �*=
812
+ name5
813
+ -
814
+ +")
815
+ 'model_transformer_layer_3_ffn_lin1_bias*=
816
+ val6
817
+  
818
+ �*%
819
+ @model_path/weights/weight.bin���Y�
820
+ constA
821
+ )model_transformer_layer_3_ffn_lin1_weight
822
+  
823
+ �
824
+ �*?
825
+ name7
826
+ /
827
+ -"+
828
+ )model_transformer_layer_3_ffn_lin1_weight*D
829
+ val=
830
+  
831
+ �
832
+ �*%
833
+ @model_path/weights/weight.bin���Y�
834
+ const8
835
+ 'model_transformer_layer_3_ffn_lin2_bias
836
+  
837
+ �*=
838
+ name5
839
+ -
840
+ +")
841
+ 'model_transformer_layer_3_ffn_lin2_bias*=
842
+ val6
843
+  
844
+ �*%
845
+ @model_path/weights/weight.bin�ؤ^�
846
+ constA
847
+ )model_transformer_layer_3_ffn_lin2_weight
848
+  
849
+ �
850
+ �*?
851
+ name7
852
+ /
853
+ -"+
854
+ )model_transformer_layer_3_ffn_lin2_weight*D
855
+ val=
856
+  
857
+ �
858
+ �*%
859
+ @model_path/weights/weight.bin��^�
860
+ constA
861
+ 0model_transformer_layer_3_output_layer_norm_bias
862
+  
863
+ �*F
864
+ name>
865
+ 6
866
+ 4"2
867
+ 0model_transformer_layer_3_output_layer_norm_bias*=
868
+ val6
869
+  
870
+ �*%
871
+ @model_path/weights/weight.bin���b�
872
+ constC
873
+ 2model_transformer_layer_3_output_layer_norm_weight
874
+  
875
+ �*H
876
+ name@
877
+ 8
878
+ 6"4
879
+ 2model_transformer_layer_3_output_layer_norm_weight*=
880
+ val6
881
+  
882
+ �*%
883
+ @model_path/weights/weight.bin���b�
884
+ const?
885
+ .model_transformer_layer_4_attention_q_lin_bias
886
+  
887
+ �*D
888
+ name<
889
+ 4
890
+ 2"0
891
+ .model_transformer_layer_4_attention_q_lin_bias*=
892
+ val6
893
+  
894
+ �*%
895
+ @model_path/weights/weight.bin���b�
896
+ constH
897
+ 0model_transformer_layer_4_attention_q_lin_weight
898
+  
899
+ �
900
+ �*F
901
+ name>
902
+ 6
903
+ 4"2
904
+ 0model_transformer_layer_4_attention_q_lin_weight*D
905
+ val=
906
+  
907
+ �
908
+ �*%
909
+ @model_path/weights/weight.bin���b�
910
+ const?
911
+ .model_transformer_layer_4_attention_k_lin_bias
912
+  
913
+ �*D
914
+ name<
915
+ 4
916
+ 2"0
917
+ .model_transformer_layer_4_attention_k_lin_bias*=
918
+ val6
919
+  
920
+ �*%
921
+ @model_path/weights/weight.bin���c�
922
+ constH
923
+ 0model_transformer_layer_4_attention_k_lin_weight
924
+  
925
+ �
926
+ �*F
927
+ name>
928
+ 6
929
+ 4"2
930
+ 0model_transformer_layer_4_attention_k_lin_weight*D
931
+ val=
932
+  
933
+ �
934
+ �*%
935
+ @model_path/weights/weight.bin���c�
936
+ const?
937
+ .model_transformer_layer_4_attention_v_lin_bias
938
+  
939
+ �*D
940
+ name<
941
+ 4
942
+ 2"0
943
+ .model_transformer_layer_4_attention_v_lin_bias*=
944
+ val6
945
+  
946
+ �*%
947
+ @model_path/weights/weight.bin�ԅe�
948
+ constH
949
+ 0model_transformer_layer_4_attention_v_lin_weight
950
+  
951
+ �
952
+ �*F
953
+ name>
954
+ 6
955
+ 4"2
956
+ 0model_transformer_layer_4_attention_v_lin_weight*D
957
+ val=
958
+  
959
+ �
960
+ �*%
961
+ @model_path/weights/weight.bin��e�
962
+ constA
963
+ 0model_transformer_layer_4_attention_out_lin_bias
964
+  
965
+ �*F
966
+ name>
967
+ 6
968
+ 4"2
969
+ 0model_transformer_layer_4_attention_out_lin_bias*=
970
+ val6
971
+  
972
+ �*%
973
+ @model_path/weights/weight.bin��f�
974
+ constJ
975
+ 2model_transformer_layer_4_attention_out_lin_weight
976
+  
977
+ �
978
+ �*H
979
+ name@
980
+ 8
981
+ 6"4
982
+ 2model_transformer_layer_4_attention_out_lin_weight*D
983
+ val=
984
+  
985
+ �
986
+ �*%
987
+ @model_path/weights/weight.bin���f�
988
+ const=
989
+ ,model_transformer_layer_4_sa_layer_norm_bias
990
+  
991
+ �*B
992
+ name:
993
+ 2
994
+ 0".
995
+ ,model_transformer_layer_4_sa_layer_norm_bias*=
996
+ val6
997
+  
998
+ �*%
999
+ @model_path/weights/weight.bin���g�
1000
+ const?
1001
+ .model_transformer_layer_4_sa_layer_norm_weight
1002
+  
1003
+ �*D
1004
+ name<
1005
+ 4
1006
+ 2"0
1007
+ .model_transformer_layer_4_sa_layer_norm_weight*=
1008
+ val6
1009
+  
1010
+ �*%
1011
+ @model_path/weights/weight.bin���g�
1012
+ const8
1013
+ 'model_transformer_layer_4_ffn_lin1_bias
1014
+  
1015
+ �*=
1016
+ name5
1017
+ -
1018
+ +")
1019
+ 'model_transformer_layer_4_ffn_lin1_bias*=
1020
+ val6
1021
+  
1022
+ �*%
1023
+ @model_path/weights/weight.bin���g�
1024
+ constA
1025
+ )model_transformer_layer_4_ffn_lin1_weight
1026
+  
1027
+ �
1028
+ �*?
1029
+ name7
1030
+ /
1031
+ -"+
1032
+ )model_transformer_layer_4_ffn_lin1_weight*D
1033
+ val=
1034
+  
1035
+ �
1036
+ �*%
1037
+ @model_path/weights/weight.bin���g�
1038
+ const8
1039
+ 'model_transformer_layer_4_ffn_lin2_bias
1040
+  
1041
+ �*=
1042
+ name5
1043
+ -
1044
+ +")
1045
+ 'model_transformer_layer_4_ffn_lin2_bias*=
1046
+ val6
1047
+  
1048
+ �*%
1049
+ @model_path/weights/weight.bin���k�
1050
+ constA
1051
+ )model_transformer_layer_4_ffn_lin2_weight
1052
+  
1053
+ �
1054
+ �*?
1055
+ name7
1056
+ /
1057
+ -"+
1058
+ )model_transformer_layer_4_ffn_lin2_weight*D
1059
+ val=
1060
+  
1061
+ �
1062
+ �*%
1063
+ @model_path/weights/weight.bin���k�
1064
+ constA
1065
+ 0model_transformer_layer_4_output_layer_norm_bias
1066
+  
1067
+ �*F
1068
+ name>
1069
+ 6
1070
+ 4"2
1071
+ 0model_transformer_layer_4_output_layer_norm_bias*=
1072
+ val6
1073
+  
1074
+ �*%
1075
+ @model_path/weights/weight.bin���p�
1076
+ constC
1077
+ 2model_transformer_layer_4_output_layer_norm_weight
1078
+  
1079
+ �*H
1080
+ name@
1081
+ 8
1082
+ 6"4
1083
+ 2model_transformer_layer_4_output_layer_norm_weight*=
1084
+ val6
1085
+  
1086
+ �*%
1087
+ @model_path/weights/weight.bin�ɧp�
1088
+ const?
1089
+ .model_transformer_layer_5_attention_q_lin_bias
1090
+  
1091
+ �*D
1092
+ name<
1093
+ 4
1094
+ 2"0
1095
+ .model_transformer_layer_5_attention_q_lin_bias*=
1096
+ val6
1097
+  
1098
+ �*%
1099
+ @model_path/weights/weight.bin��p�
1100
+ constH
1101
+ 0model_transformer_layer_5_attention_q_lin_weight
1102
+  
1103
+ �
1104
+ �*F
1105
+ name>
1106
+ 6
1107
+ 4"2
1108
+ 0model_transformer_layer_5_attention_q_lin_weight*D
1109
+ val=
1110
+  
1111
+ �
1112
+ �*%
1113
+ @model_path/weights/weight.bin���p�
1114
+ const?
1115
+ .model_transformer_layer_5_attention_k_lin_bias
1116
+  
1117
+ �*D
1118
+ name<
1119
+ 4
1120
+ 2"0
1121
+ .model_transformer_layer_5_attention_k_lin_bias*=
1122
+ val6
1123
+  
1124
+ �*%
1125
+ @model_path/weights/weight.bin���q�
1126
+ constH
1127
+ 0model_transformer_layer_5_attention_k_lin_weight
1128
+  
1129
+ �
1130
+ �*F
1131
+ name>
1132
+ 6
1133
+ 4"2
1134
+ 0model_transformer_layer_5_attention_k_lin_weight*D
1135
+ val=
1136
+  
1137
+ �
1138
+ �*%
1139
+ @model_path/weights/weight.bin���q�
1140
+ const?
1141
+ .model_transformer_layer_5_attention_v_lin_bias
1142
+  
1143
+ �*D
1144
+ name<
1145
+ 4
1146
+ 2"0
1147
+ .model_transformer_layer_5_attention_v_lin_bias*=
1148
+ val6
1149
+  
1150
+ �*%
1151
+ @model_path/weights/weight.bin���r�
1152
+ constH
1153
+ 0model_transformer_layer_5_attention_v_lin_weight
1154
+  
1155
+ �
1156
+ �*F
1157
+ name>
1158
+ 6
1159
+ 4"2
1160
+ 0model_transformer_layer_5_attention_v_lin_weight*D
1161
+ val=
1162
+  
1163
+ �
1164
+ �*%
1165
+ @model_path/weights/weight.bin���r�
1166
+ constA
1167
+ 0model_transformer_layer_5_attention_out_lin_bias
1168
+  
1169
+ �*F
1170
+ name>
1171
+ 6
1172
+ 4"2
1173
+ 0model_transformer_layer_5_attention_out_lin_bias*=
1174
+ val6
1175
+  
1176
+ �*%
1177
+ @model_path/weights/weight.bin���s�
1178
+ constJ
1179
+ 2model_transformer_layer_5_attention_out_lin_weight
1180
+  
1181
+ �
1182
+ �*H
1183
+ name@
1184
+ 8
1185
+ 6"4
1186
+ 2model_transformer_layer_5_attention_out_lin_weight*D
1187
+ val=
1188
+  
1189
+ �
1190
+ �*%
1191
+ @model_path/weights/weight.bin���s�
1192
+ const=
1193
+ ,model_transformer_layer_5_sa_layer_norm_bias
1194
+  
1195
+ �*B
1196
+ name:
1197
+ 2
1198
+ 0".
1199
+ ,model_transformer_layer_5_sa_layer_norm_bias*=
1200
+ val6
1201
+  
1202
+ �*%
1203
+ @model_path/weights/weight.bin���t�
1204
+ const?
1205
+ .model_transformer_layer_5_sa_layer_norm_weight
1206
+  
1207
+ �*D
1208
+ name<
1209
+ 4
1210
+ 2"0
1211
+ .model_transformer_layer_5_sa_layer_norm_weight*=
1212
+ val6
1213
+  
1214
+ �*%
1215
+ @model_path/weights/weight.bin���t�
1216
+ const8
1217
+ 'model_transformer_layer_5_ffn_lin1_bias
1218
+  
1219
+ �*=
1220
+ name5
1221
+ -
1222
+ +")
1223
+ 'model_transformer_layer_5_ffn_lin1_bias*=
1224
+ val6
1225
+  
1226
+ �*%
1227
+ @model_path/weights/weight.bin���t�
1228
+ constA
1229
+ )model_transformer_layer_5_ffn_lin1_weight
1230
+  
1231
+ �
1232
+ �*?
1233
+ name7
1234
+ /
1235
+ -"+
1236
+ )model_transformer_layer_5_ffn_lin1_weight*D
1237
+ val=
1238
+  
1239
+ �
1240
+ �*%
1241
+ @model_path/weights/weight.bin���t�
1242
+ const8
1243
+ 'model_transformer_layer_5_ffn_lin2_bias
1244
+  
1245
+ �*=
1246
+ name5
1247
+ -
1248
+ +")
1249
+ 'model_transformer_layer_5_ffn_lin2_bias*=
1250
+ val6
1251
+  
1252
+ �*%
1253
+ @model_path/weights/weight.bin�ةy�
1254
+ constA
1255
+ )model_transformer_layer_5_ffn_lin2_weight
1256
+  
1257
+ �
1258
+ �*?
1259
+ name7
1260
+ /
1261
+ -"+
1262
+ )model_transformer_layer_5_ffn_lin2_weight*D
1263
+ val=
1264
+  
1265
+ �
1266
+ �*%
1267
+ @model_path/weights/weight.bin��y�
1268
+ constA
1269
+ 0model_transformer_layer_5_output_layer_norm_bias
1270
+  
1271
+ �*F
1272
+ name>
1273
+ 6
1274
+ 4"2
1275
+ 0model_transformer_layer_5_output_layer_norm_bias*=
1276
+ val6
1277
+  
1278
+ �*%
1279
+ @model_path/weights/weight.bin���}�
1280
+ constC
1281
+ 2model_transformer_layer_5_output_layer_norm_weight
1282
+  
1283
+ �*H
1284
+ name@
1285
+ 8
1286
+ 6"4
1287
+ 2model_transformer_layer_5_output_layer_norm_weight*=
1288
+ val6
1289
+  
1290
+ �*%
1291
+ @model_path/weights/weight.bin���}L
1292
+ const
1293
+ var_14
1294
+ *
1295
+ name
1296
+ 
1297
+ "
1298
+ op_14*
1299
+ val
1300
+ 
1301
+ 
1302
+ U
1303
+ const
1304
+ var_17
1305
+ *
1306
+ name
1307
+ 
1308
+ "
1309
+ op_17*
1310
+ val
1311
+ 
1312
+ 
1313
+
1314
+ ���������O
1315
+ const
1316
+ var_19
1317
+  *
1318
+ name
1319
+ 
1320
+ "
1321
+ op_19*
1322
+ val
1323
+  
1324
+
1325
+ 
1326
+ 
1327
+ ̼�+g
1328
+ const
1329
+ input_embeds_axis_0
1330
+ *)
1331
+ name!
1332
+ 
1333
+ "
1334
+ input_embeds_axis_0*
1335
+ val
1336
+ 
1337
+ 
1338
+ �
1339
+ gather0
1340
+ x+
1341
+ )
1342
+ 'model_embeddings_word_embeddings_weight
1343
+ indices
1344
+
1345
+ input_ids
1346
+ axis
1347
+ 
1348
+ input_embeds_axis_0*
1349
+ input_embeds
1350
+  
1351
+ 
1352
+ �
1353
+ �*"
1354
+ name
1355
+ 
1356
+ "
1357
+ input_embeds�
1358
+ const3
1359
+ position_embeddings_1
1360
+  
1361
+ 
1362
+ �
1363
+ �*+
1364
+ name#
1365
+ 
1366
+ "
1367
+ position_embeddings_1*J
1368
+ valC
1369
+  
1370
+ 
1371
+ �
1372
+ �*%
1373
+ @model_path/weights/weight.bin���}�
1374
+ add
1375
+ x
1376
+ 
1377
+ input_embeds
1378
+ y
1379
+ 
1380
+ position_embeddings_1%
1381
+ input_3
1382
+  
1383
+ 
1384
+ �
1385
+ �*
1386
+ name
1387
+ 
1388
+ "
1389
+ input_3v
1390
+ const
1391
+ input_5_axes_0
1392
+
1393
+ 
1394
+ *$
1395
+ name
1396
+ 
1397
+ "
1398
+ input_5_axes_0*'
1399
+ val 
1400
+
1401
+ 
1402
+ 
1403
+ 
1404
+
1405
+ ����������
1406
+
1407
+ layer_norm
1408
+ x
1409
+
1410
+ input_3
1411
+ axes
1412
+ 
1413
+ input_5_axes_0.
1414
+ gamma%
1415
+ #
1416
+ !model_embeddings_LayerNorm_weight+
1417
+ beta#
1418
+ !
1419
+ model_embeddings_LayerNorm_bias
1420
+ epsilon
1421
+
1422
+ 
1423
+ var_19%
1424
+ input_5
1425
+  
1426
+ 
1427
+ �
1428
+ �*
1429
+ name
1430
+ 
1431
+ "
1432
+ input_5�
1433
+ linear
1434
+ x
1435
+
1436
+ input_5>
1437
+ weight4
1438
+ 2
1439
+ 0model_transformer_layer_0_attention_q_lin_weight:
1440
+ bias2
1441
+ 0
1442
+ .model_transformer_layer_0_attention_q_lin_bias!
1443
+ x_1
1444
+  
1445
+ 
1446
+ �
1447
+ �*
1448
+ name
1449
+ 
1450
+ "
1451
+ x_1h
1452
+ const
1453
+ var_66
1454
+
1455
+ 
1456
+ *
1457
+ name
1458
+ 
1459
+ "
1460
+ op_66**
1461
+ val#
1462
+
1463
+ 
1464
+ 
1465
+ 
1466
+
1467
+ reshape
1468
+ x
1469
+ 
1470
+ x_1
1471
+ shape
1472
+
1473
+ 
1474
+ var_66)
1475
+ var_67
1476
+  
1477
+ 
1478
+ �
1479
+  
1480
+ @*
1481
+ name
1482
+ 
1483
+ "
1484
+ op_67�
1485
+ linear
1486
+ x
1487
+
1488
+ input_5>
1489
+ weight4
1490
+ 2
1491
+ 0model_transformer_layer_0_attention_k_lin_weight:
1492
+ bias2
1493
+ 0
1494
+ .model_transformer_layer_0_attention_k_lin_bias!
1495
+ x_3
1496
+  
1497
+ 
1498
+ �
1499
+ �*
1500
+ name
1501
+ 
1502
+ "
1503
+ x_3h
1504
+ const
1505
+ var_72
1506
+
1507
+ 
1508
+ *
1509
+ name
1510
+ 
1511
+ "
1512
+ op_72**
1513
+ val#
1514
+
1515
+ 
1516
+ 
1517
+ 
1518
+
1519
+ reshape
1520
+ x
1521
+ 
1522
+ x_3
1523
+ shape
1524
+
1525
+ 
1526
+ var_72)
1527
+ var_73
1528
+  
1529
+ 
1530
+ �
1531
+  
1532
+ @*
1533
+ name
1534
+ 
1535
+ "
1536
+ op_73�
1537
+ linear
1538
+ x
1539
+
1540
+ input_5>
1541
+ weight4
1542
+ 2
1543
+ 0model_transformer_layer_0_attention_v_lin_weight:
1544
+ bias2
1545
+ 0
1546
+ .model_transformer_layer_0_attention_v_lin_bias!
1547
+ x_5
1548
+  
1549
+ 
1550
+ �
1551
+ �*
1552
+ name
1553
+ 
1554
+ "
1555
+ x_5h
1556
+ const
1557
+ var_78
1558
+
1559
+ 
1560
+ *
1561
+ name
1562
+ 
1563
+ "
1564
+ op_78**
1565
+ val#
1566
+
1567
+ 
1568
+ 
1569
+ 
1570
+
1571
+ reshape
1572
+ x
1573
+ 
1574
+ x_5
1575
+ shape
1576
+
1577
+ 
1578
+ var_78)
1579
+ var_79
1580
+  
1581
+ 
1582
+ �
1583
+  
1584
+ @*
1585
+ name
1586
+ 
1587
+ "
1588
+ op_79h
1589
+ const
1590
+
1591
+ v_1_perm_0
1592
+
1593
+ 
1594
+ *
1595
+ name
1596
+ 
1597
+ "
1598
+
1599
+ v_1_perm_0*!
1600
+ val
1601
+
1602
+ 
1603
+ 
1604
+
1605
+ 
1606
+ f
1607
+ const
1608
+ _inversed_q_3_y_0
1609
+  *'
1610
+ name
1611
+ 
1612
+ "
1613
+ _inversed_q_3_y_0*
1614
+ val
1615
+  
1616
+
1617
+ 
1618
+ 
1619
+ >�
1620
+ mul
1621
+ x
1622
+
1623
+ 
1624
+ var_67
1625
+ y
1626
+ 
1627
+ _inversed_q_3_y_00
1628
+
1629
+  
1630
+ 
1631
+ �
1632
+  
1633
+ @*#
1634
+ name
1635
+ 
1636
+ "
1637
+
1638
+ const
1639
+ scores_1_transpose_x_0
1640
+ *,
1641
+ name$
1642
+ 
1643
+ "
1644
+ scores_1_transpose_x_0*
1645
+ val
1646
+ 
1647
+ 
1648
+ m
1649
+ const
1650
+ scores_1_transpose_y_0
1651
+ *,
1652
+ name$
1653
+ 
1654
+ "
1655
+ scores_1_transpose_y_0*
1656
+ val
1657
+ 
1658
+ 
1659
+ z
1660
+ const#
1661
+ transpose_18_perm_0
1662
+
1663
+ 
1664
+ *)
1665
+ name!
1666
+ 
1667
+ "
1668
+ transpose_18_perm_0*!
1669
+ val
1670
+
1671
+ 
1672
+ 
1673
+
1674
+ 
1675
+ z
1676
+ const#
1677
+ transpose_19_perm_0
1678
+
1679
+ 
1680
+ *)
1681
+ name!
1682
+ 
1683
+ "
1684
+ transpose_19_perm_0*!
1685
+ val
1686
+
1687
+ 
1688
+ 
1689
+
1690
+ 
1691
+ �
1692
+ transpose
1693
+ x
1694
+
1695
+ 
1696
+ var_73
1697
+ perm
1698
+ 
1699
+ transpose_19_perm_0/
1700
+ transpose_51
1701
+  
1702
+ 
1703
+  
1704
+ @
1705
+ �*"
1706
+ name
1707
+ 
1708
+ "
1709
+ transpose_51�
1710
+ transpose
1711
+ x
1712
+ 
1713
+
1714
+ perm
1715
+ 
1716
+ transpose_18_perm_0/
1717
+ transpose_52
1718
+  
1719
+ 
1720
+  
1721
+ �
1722
+ @*"
1723
+ name
1724
+ 
1725
+ "
1726
+ transpose_52�
1727
+ matmul
1728
+ x
1729
+ 
1730
+ transpose_52
1731
+ y
1732
+ 
1733
+ transpose_51)
1734
+ transpose_x
1735
+ 
1736
+ scores_1_transpose_x_0)
1737
+ transpose_y
1738
+ 
1739
+ scores_1_transpose_y_0,
1740
+ scores_1
1741
+  
1742
+ 
1743
+  
1744
+ �
1745
+ �*
1746
+ name
1747
+ 
1748
+ "
1749
+
1750
+ scores_1m
1751
+ equal
1752
+ x
1753
+ 
1754
+ attention_mask
1755
+ y
1756
+
1757
+ 
1758
+ var_14
1759
+ var_85
1760
+ 
1761
+ 
1762
+ �*
1763
+ name
1764
+ 
1765
+ "
1766
+ op_85`
1767
+ const
1768
+ var_86
1769
+
1770
+ 
1771
+ *
1772
+ name
1773
+ 
1774
+ "
1775
+ op_86*"
1776
+ val
1777
+
1778
+ 
1779
+ 
1780
+ 
1781
+ �w
1782
+ reshape
1783
+ x
1784
+
1785
+ 
1786
+ var_85
1787
+ shape
1788
+
1789
+ 
1790
+ var_86)
1791
+ var_87
1792
+ 
1793
+ 
1794
+ 
1795
+ 
1796
+ �*
1797
+ name
1798
+ 
1799
+ "
1800
+ op_87o
1801
+ const
1802
+
1803
+
1804
+ 
1805
+ *#
1806
+ name
1807
+ 
1808
+ "
1809
+
1810
+ val
1811
+
1812
+ 
1813
+ 
1814
+ 
1815
+  �|
1816
+ tile
1817
+ x
1818
+
1819
+ 
1820
+ var_87
1821
+ reps
1822
+ 
1823
+
1824
+ mask_3
1825
+ 
1826
+ 
1827
+  
1828
+ �
1829
+ �*
1830
+ name
1831
+ 
1832
+
1833
+ "
1834
+ mask_3O
1835
+ const
1836
+ var_89
1837
+  *
1838
+ name
1839
+ 
1840
+ "
1841
+ op_89*
1842
+ val
1843
+  
1844
+
1845
+ 
1846
+ 
1847
+ ����
1848
+ select
1849
+ cond
1850
+
1851
+ 
1852
+ mask_3
1853
+ a
1854
+
1855
+ 
1856
+ var_89
1857
+ b
1858
+
1859
+
1860
+ scores_1+
1861
+ input_7
1862
+  
1863
+ 
1864
+  
1865
+ �
1866
+ �*
1867
+ name
1868
+ 
1869
+ "
1870
+ input_7{
1871
+ softmax
1872
+ x
1873
+
1874
+ input_7
1875
+ axis
1876
+
1877
+ 
1878
+ var_17+
1879
+ input_9
1880
+  
1881
+ 
1882
+  
1883
+ �
1884
+ �*
1885
+ name
1886
+ 
1887
+ "
1888
+ input_9c
1889
+ const
1890
+ x_7_transpose_x_0
1891
+ *'
1892
+ name
1893
+ 
1894
+ "
1895
+ x_7_transpose_x_0*
1896
+ val
1897
+ 
1898
+ 
1899
+ c
1900
+ const
1901
+ x_7_transpose_y_0
1902
+ *'
1903
+ name
1904
+ 
1905
+ "
1906
+ x_7_transpose_y_0*
1907
+ val
1908
+ 
1909
+ 
1910
+ �
1911
+ transpose
1912
+ x
1913
+
1914
+ 
1915
+ var_79
1916
+ perm
1917
+
1918
+
1919
+ v_1_perm_0/
1920
+ transpose_53
1921
+  
1922
+ 
1923
+  
1924
+ �
1925
+ @*"
1926
+ name
1927
+ 
1928
+ "
1929
+ transpose_53�
1930
+ matmul
1931
+ x
1932
+
1933
+ input_9
1934
+ y
1935
+ 
1936
+ transpose_53$
1937
+ transpose_x
1938
+ 
1939
+ x_7_transpose_x_0$
1940
+ transpose_y
1941
+ 
1942
+ x_7_transpose_y_0&
1943
+ x_7
1944
+  
1945
+ 
1946
+  
1947
+ �
1948
+ @*
1949
+ name
1950
+ 
1951
+ "
1952
+ x_7m
1953
+ const
1954
+
1955
+
1956
+ 
1957
+ *"
1958
+ name
1959
+ 
1960
+ "
1961
+ op_95_perm_0*!
1962
+ val
1963
+
1964
+ 
1965
+ 
1966
+
1967
+ 
1968
+ h
1969
+ const
1970
+ var_97
1971
+
1972
+ 
1973
+ *
1974
+ name
1975
+ 
1976
+ "
1977
+ op_97**
1978
+ val#
1979
+
1980
+ 
1981
+ 
1982
+ 
1983
+
1984
+ transpose
1985
+ x
1986
+ 
1987
+ x_7
1988
+ perm
1989
+ 
1990
+
1991
+ transpose_50
1992
+  
1993
+ 
1994
+ �
1995
+  
1996
+ @*"
1997
+ name
1998
+ 
1999
+ "
2000
+ transpose_50}
2001
+ reshape
2002
+ x
2003
+ 
2004
+ transpose_50
2005
+ shape
2006
+
2007
+ 
2008
+ var_97&
2009
+ input_11
2010
+  
2011
+ 
2012
+ �
2013
+ �*
2014
+ name
2015
+ 
2016
+ "
2017
+
2018
+ input_11�
2019
+ linear
2020
+ x
2021
+
2022
+
2023
+ input_11@
2024
+ weight6
2025
+ 4
2026
+ 2model_transformer_layer_0_attention_out_lin_weight<
2027
+ bias4
2028
+ 2
2029
+ 0model_transformer_layer_0_attention_out_lin_bias)
2030
+ sa_output_1
2031
+  
2032
+ 
2033
+ �
2034
+ �*!
2035
+ name
2036
+ 
2037
+ "
2038
+ sa_output_1u
2039
+ add
2040
+ x
2041
+
2042
+ sa_output_1
2043
+ y
2044
+
2045
+ input_5&
2046
+ input_13
2047
+  
2048
+ 
2049
+ �
2050
+ �*
2051
+ name
2052
+ 
2053
+ "
2054
+
2055
+ input_13x
2056
+ const
2057
+ input_15_axes_0
2058
+
2059
+ 
2060
+ *%
2061
+ name
2062
+ 
2063
+ "
2064
+ input_15_axes_0*'
2065
+ val 
2066
+
2067
+ 
2068
+ 
2069
+ 
2070
+
2071
+ ����������
2072
+
2073
+ layer_norm
2074
+ x
2075
+
2076
+
2077
+ input_13
2078
+ axes
2079
+ 
2080
+ input_15_axes_0;
2081
+ gamma2
2082
+ 0
2083
+ .model_transformer_layer_0_sa_layer_norm_weight8
2084
+ beta0
2085
+ .
2086
+ ,model_transformer_layer_0_sa_layer_norm_bias
2087
+ epsilon
2088
+
2089
+ 
2090
+ var_19&
2091
+ input_15
2092
+  
2093
+ 
2094
+ �
2095
+ �*
2096
+ name
2097
+ 
2098
+ "
2099
+
2100
+ input_15�
2101
+ linear
2102
+ x
2103
+
2104
+
2105
+ input_157
2106
+ weight-
2107
+ +
2108
+ )model_transformer_layer_0_ffn_lin1_weight3
2109
+ bias+
2110
+ )
2111
+ 'model_transformer_layer_0_ffn_lin1_bias&
2112
+ input_17
2113
+  
2114
+ 
2115
+ �
2116
+ �*
2117
+ name
2118
+ 
2119
+ "
2120
+
2121
+ input_17c
2122
+ const
2123
+ input_19_mode_0
2124
+ *%
2125
+ name
2126
+ 
2127
+ "
2128
+ input_19_mode_0*
2129
+ val
2130
+ 
2131
+ "
2132
+ EXACT~
2133
+ gelu
2134
+ x
2135
+
2136
+
2137
+ input_17
2138
+ mode
2139
+ 
2140
+ input_19_mode_0&
2141
+ input_19
2142
+  
2143
+ 
2144
+ �
2145
+ �*
2146
+ name
2147
+ 
2148
+ "
2149
+
2150
+ input_19�
2151
+ linear
2152
+ x
2153
+
2154
+
2155
+ input_197
2156
+ weight-
2157
+ +
2158
+ )model_transformer_layer_0_ffn_lin2_weight3
2159
+ bias+
2160
+ )
2161
+ 'model_transformer_layer_0_ffn_lin2_bias&
2162
+ input_21
2163
+  
2164
+ 
2165
+ �
2166
+ �*
2167
+ name
2168
+ 
2169
+ "
2170
+
2171
+ input_21s
2172
+ add
2173
+ x
2174
+
2175
+
2176
+ input_21
2177
+ y
2178
+
2179
+
2180
+ input_15&
2181
+ input_23
2182
+  
2183
+ 
2184
+ �
2185
+ �*
2186
+ name
2187
+ 
2188
+ "
2189
+
2190
+ input_23v
2191
+ const
2192
+ query_3_axes_0
2193
+
2194
+ 
2195
+ *$
2196
+ name
2197
+ 
2198
+ "
2199
+ query_3_axes_0*'
2200
+ val 
2201
+
2202
+ 
2203
+ 
2204
+ 
2205
+
2206
+ ����������
2207
+
2208
+ layer_norm
2209
+ x
2210
+
2211
+
2212
+ input_23
2213
+ axes
2214
+ 
2215
+ query_3_axes_0?
2216
+ gamma6
2217
+ 4
2218
+ 2model_transformer_layer_0_output_layer_norm_weight<
2219
+ beta4
2220
+ 2
2221
+ 0model_transformer_layer_0_output_layer_norm_bias
2222
+ epsilon
2223
+
2224
+ 
2225
+ var_19%
2226
+ query_3
2227
+  
2228
+ 
2229
+ �
2230
+ �*
2231
+ name
2232
+ 
2233
+ "
2234
+ query_3�
2235
+ linear
2236
+ x
2237
+
2238
+ query_3>
2239
+ weight4
2240
+ 2
2241
+ 0model_transformer_layer_1_attention_q_lin_weight:
2242
+ bias2
2243
+ 0
2244
+ .model_transformer_layer_1_attention_q_lin_bias!
2245
+ x_9
2246
+  
2247
+ 
2248
+ �
2249
+ �*
2250
+ name
2251
+ 
2252
+ "
2253
+ x_9j
2254
+ const
2255
+ var_135
2256
+
2257
+ 
2258
+ *
2259
+ name
2260
+ 
2261
+
2262
+ "
2263
+ op_135**
2264
+ val#
2265
+
2266
+ 
2267
+ 
2268
+ 
2269
+
2270
+ reshape
2271
+ x
2272
+ 
2273
+ x_9
2274
+ shape
2275
+
2276
+ var_135*
2277
+ var_136
2278
+  
2279
+ 
2280
+ �
2281
+  
2282
+ @*
2283
+ name
2284
+ 
2285
+
2286
+ "
2287
+ op_136�
2288
+ linear
2289
+ x
2290
+
2291
+ query_3>
2292
+ weight4
2293
+ 2
2294
+ 0model_transformer_layer_1_attention_k_lin_weight:
2295
+ bias2
2296
+ 0
2297
+ .model_transformer_layer_1_attention_k_lin_bias"
2298
+ x_11
2299
+  
2300
+ 
2301
+ �
2302
+ �*
2303
+ name
2304
+ 
2305
+
2306
+ "
2307
+ x_11j
2308
+ const
2309
+ var_141
2310
+
2311
+ 
2312
+ *
2313
+ name
2314
+ 
2315
+
2316
+ "
2317
+ op_141**
2318
+ val#
2319
+
2320
+ 
2321
+ 
2322
+ 
2323
+
2324
+ reshape
2325
+ x
2326
+ 
2327
+ x_11
2328
+ shape
2329
+
2330
+ var_141*
2331
+ var_142
2332
+  
2333
+ 
2334
+ �
2335
+  
2336
+ @*
2337
+ name
2338
+ 
2339
+
2340
+ "
2341
+ op_142�
2342
+ linear
2343
+ x
2344
+
2345
+ query_3>
2346
+ weight4
2347
+ 2
2348
+ 0model_transformer_layer_1_attention_v_lin_weight:
2349
+ bias2
2350
+ 0
2351
+ .model_transformer_layer_1_attention_v_lin_bias"
2352
+ x_13
2353
+  
2354
+ 
2355
+ �
2356
+ �*
2357
+ name
2358
+ 
2359
+
2360
+ "
2361
+ x_13j
2362
+ const
2363
+ var_147
2364
+
2365
+ 
2366
+ *
2367
+ name
2368
+ 
2369
+
2370
+ "
2371
+ op_147**
2372
+ val#
2373
+
2374
+ 
2375
+ 
2376
+ 
2377
+
2378
+ reshape
2379
+ x
2380
+ 
2381
+ x_13
2382
+ shape
2383
+
2384
+ var_147*
2385
+ var_148
2386
+  
2387
+ 
2388
+ �
2389
+  
2390
+ @*
2391
+ name
2392
+ 
2393
+
2394
+ "
2395
+ op_148h
2396
+ const
2397
+
2398
+ v_3_perm_0
2399
+
2400
+ 
2401
+ *
2402
+ name
2403
+ 
2404
+ "
2405
+
2406
+ v_3_perm_0*!
2407
+ val
2408
+
2409
+ 
2410
+ 
2411
+
2412
+ 
2413
+ f
2414
+ const
2415
+ _inversed_q_7_y_0
2416
+  *'
2417
+ name
2418
+ 
2419
+ "
2420
+ _inversed_q_7_y_0*
2421
+ val
2422
+  
2423
+
2424
+ 
2425
+ 
2426
+ >�
2427
+ mul
2428
+ x
2429
+
2430
+ var_136
2431
+ y
2432
+ 
2433
+ _inversed_q_7_y_00
2434
+
2435
+  
2436
+ 
2437
+ �
2438
+  
2439
+ @*#
2440
+ name
2441
+ 
2442
+ "
2443
+
2444
+ const
2445
+ scores_3_transpose_x_0
2446
+ *,
2447
+ name$
2448
+ 
2449
+ "
2450
+ scores_3_transpose_x_0*
2451
+ val
2452
+ 
2453
+ 
2454
+ m
2455
+ const
2456
+ scores_3_transpose_y_0
2457
+ *,
2458
+ name$
2459
+ 
2460
+ "
2461
+ scores_3_transpose_y_0*
2462
+ val
2463
+ 
2464
+ 
2465
+ z
2466
+ const#
2467
+ transpose_20_perm_0
2468
+
2469
+ 
2470
+ *)
2471
+ name!
2472
+ 
2473
+ "
2474
+ transpose_20_perm_0*!
2475
+ val
2476
+
2477
+ 
2478
+ 
2479
+
2480
+ 
2481
+ z
2482
+ const#
2483
+ transpose_21_perm_0
2484
+
2485
+ 
2486
+ *)
2487
+ name!
2488
+ 
2489
+ "
2490
+ transpose_21_perm_0*!
2491
+ val
2492
+
2493
+ 
2494
+ 
2495
+
2496
+ 
2497
+ �
2498
+ transpose
2499
+ x
2500
+
2501
+ var_142
2502
+ perm
2503
+ 
2504
+ transpose_21_perm_0/
2505
+ transpose_47
2506
+  
2507
+ 
2508
+  
2509
+ @
2510
+ �*"
2511
+ name
2512
+ 
2513
+ "
2514
+ transpose_47�
2515
+ transpose
2516
+ x
2517
+ 
2518
+
2519
+ perm
2520
+ 
2521
+ transpose_20_perm_0/
2522
+ transpose_48
2523
+  
2524
+ 
2525
+  
2526
+ �
2527
+ @*"
2528
+ name
2529
+ 
2530
+ "
2531
+ transpose_48�
2532
+ matmul
2533
+ x
2534
+ 
2535
+ transpose_48
2536
+ y
2537
+ 
2538
+ transpose_47)
2539
+ transpose_x
2540
+ 
2541
+ scores_3_transpose_x_0)
2542
+ transpose_y
2543
+ 
2544
+ scores_3_transpose_y_0,
2545
+ scores_3
2546
+  
2547
+ 
2548
+  
2549
+ �
2550
+ �*
2551
+ name
2552
+ 
2553
+ "
2554
+
2555
+ scores_3Q
2556
+ const
2557
+ var_158
2558
+  *
2559
+ name
2560
+ 
2561
+
2562
+ "
2563
+ op_158*
2564
+ val
2565
+  
2566
+
2567
+ 
2568
+ 
2569
+ ����
2570
+ select
2571
+ cond
2572
+
2573
+ 
2574
+ mask_3
2575
+ a
2576
+
2577
+ var_158
2578
+ b
2579
+
2580
+
2581
+ scores_3,
2582
+ input_25
2583
+  
2584
+ 
2585
+  
2586
+ �
2587
+ �*
2588
+ name
2589
+ 
2590
+ "
2591
+
2592
+ input_25~
2593
+ softmax
2594
+ x
2595
+
2596
+
2597
+ input_25
2598
+ axis
2599
+
2600
+ 
2601
+ var_17,
2602
+ input_27
2603
+  
2604
+ 
2605
+  
2606
+ �
2607
+ �*
2608
+ name
2609
+ 
2610
+ "
2611
+
2612
+ input_27e
2613
+ const
2614
+ x_15_transpose_x_0
2615
+ *(
2616
+ name 
2617
+ 
2618
+ "
2619
+ x_15_transpose_x_0*
2620
+ val
2621
+ 
2622
+ 
2623
+ e
2624
+ const
2625
+ x_15_transpose_y_0
2626
+ *(
2627
+ name 
2628
+ 
2629
+ "
2630
+ x_15_transpose_y_0*
2631
+ val
2632
+ 
2633
+ 
2634
+ �
2635
+ transpose
2636
+ x
2637
+
2638
+ var_148
2639
+ perm
2640
+
2641
+
2642
+ v_3_perm_0/
2643
+ transpose_49
2644
+  
2645
+ 
2646
+  
2647
+ �
2648
+ @*"
2649
+ name
2650
+ 
2651
+ "
2652
+ transpose_49�
2653
+ matmul
2654
+ x
2655
+
2656
+
2657
+ input_27
2658
+ y
2659
+ 
2660
+ transpose_49%
2661
+ transpose_x
2662
+ 
2663
+ x_15_transpose_x_0%
2664
+ transpose_y
2665
+ 
2666
+ x_15_transpose_y_0'
2667
+ x_15
2668
+  
2669
+ 
2670
+  
2671
+ �
2672
+ @*
2673
+ name
2674
+ 
2675
+
2676
+ "
2677
+ x_15o
2678
+ const
2679
+ var_164_perm_0
2680
+
2681
+ 
2682
+ *#
2683
+ name
2684
+ 
2685
+ "
2686
+
2687
+ val
2688
+
2689
+ 
2690
+ 
2691
+
2692
+ 
2693
+ j
2694
+ const
2695
+ var_166
2696
+
2697
+ 
2698
+ *
2699
+ name
2700
+ 
2701
+
2702
+ "
2703
+ op_166**
2704
+ val#
2705
+
2706
+ 
2707
+ 
2708
+ 
2709
+
2710
+ transpose
2711
+ x
2712
+ 
2713
+ x_15
2714
+ perm
2715
+ 
2716
+ var_164_perm_0/
2717
+ transpose_46
2718
+  
2719
+ 
2720
+ �
2721
+  
2722
+ @*"
2723
+ name
2724
+ 
2725
+ "
2726
+ transpose_46~
2727
+ reshape
2728
+ x
2729
+ 
2730
+ transpose_46
2731
+ shape
2732
+
2733
+ var_166&
2734
+ input_29
2735
+  
2736
+ 
2737
+ �
2738
+ �*
2739
+ name
2740
+ 
2741
+ "
2742
+
2743
+ input_29�
2744
+ linear
2745
+ x
2746
+
2747
+
2748
+ input_29@
2749
+ weight6
2750
+ 4
2751
+ 2model_transformer_layer_1_attention_out_lin_weight<
2752
+ bias4
2753
+ 2
2754
+ 0model_transformer_layer_1_attention_out_lin_bias)
2755
+ sa_output_3
2756
+  
2757
+ 
2758
+ �
2759
+ �*!
2760
+ name
2761
+ 
2762
+ "
2763
+ sa_output_3u
2764
+ add
2765
+ x
2766
+
2767
+ sa_output_3
2768
+ y
2769
+
2770
+ query_3&
2771
+ input_31
2772
+  
2773
+ 
2774
+ �
2775
+ �*
2776
+ name
2777
+ 
2778
+ "
2779
+
2780
+ input_31x
2781
+ const
2782
+ input_33_axes_0
2783
+
2784
+ 
2785
+ *%
2786
+ name
2787
+ 
2788
+ "
2789
+ input_33_axes_0*'
2790
+ val 
2791
+
2792
+ 
2793
+ 
2794
+ 
2795
+
2796
+ ����������
2797
+
2798
+ layer_norm
2799
+ x
2800
+
2801
+
2802
+ input_31
2803
+ axes
2804
+ 
2805
+ input_33_axes_0;
2806
+ gamma2
2807
+ 0
2808
+ .model_transformer_layer_1_sa_layer_norm_weight8
2809
+ beta0
2810
+ .
2811
+ ,model_transformer_layer_1_sa_layer_norm_bias
2812
+ epsilon
2813
+
2814
+ 
2815
+ var_19&
2816
+ input_33
2817
+  
2818
+ 
2819
+ �
2820
+ �*
2821
+ name
2822
+ 
2823
+ "
2824
+
2825
+ input_33�
2826
+ linear
2827
+ x
2828
+
2829
+
2830
+ input_337
2831
+ weight-
2832
+ +
2833
+ )model_transformer_layer_1_ffn_lin1_weight3
2834
+ bias+
2835
+ )
2836
+ 'model_transformer_layer_1_ffn_lin1_bias&
2837
+ input_35
2838
+  
2839
+ 
2840
+ �
2841
+ �*
2842
+ name
2843
+ 
2844
+ "
2845
+
2846
+ input_35c
2847
+ const
2848
+ input_37_mode_0
2849
+ *%
2850
+ name
2851
+ 
2852
+ "
2853
+ input_37_mode_0*
2854
+ val
2855
+ 
2856
+ "
2857
+ EXACT~
2858
+ gelu
2859
+ x
2860
+
2861
+
2862
+ input_35
2863
+ mode
2864
+ 
2865
+ input_37_mode_0&
2866
+ input_37
2867
+  
2868
+ 
2869
+ �
2870
+ �*
2871
+ name
2872
+ 
2873
+ "
2874
+
2875
+ input_37�
2876
+ linear
2877
+ x
2878
+
2879
+
2880
+ input_377
2881
+ weight-
2882
+ +
2883
+ )model_transformer_layer_1_ffn_lin2_weight3
2884
+ bias+
2885
+ )
2886
+ 'model_transformer_layer_1_ffn_lin2_bias&
2887
+ input_39
2888
+  
2889
+ 
2890
+ �
2891
+ �*
2892
+ name
2893
+ 
2894
+ "
2895
+
2896
+ input_39s
2897
+ add
2898
+ x
2899
+
2900
+
2901
+ input_39
2902
+ y
2903
+
2904
+
2905
+ input_33&
2906
+ input_41
2907
+  
2908
+ 
2909
+ �
2910
+ �*
2911
+ name
2912
+ 
2913
+ "
2914
+
2915
+ input_41v
2916
+ const
2917
+ query_5_axes_0
2918
+
2919
+ 
2920
+ *$
2921
+ name
2922
+ 
2923
+ "
2924
+ query_5_axes_0*'
2925
+ val 
2926
+
2927
+ 
2928
+ 
2929
+ 
2930
+
2931
+ ����������
2932
+
2933
+ layer_norm
2934
+ x
2935
+
2936
+
2937
+ input_41
2938
+ axes
2939
+ 
2940
+ query_5_axes_0?
2941
+ gamma6
2942
+ 4
2943
+ 2model_transformer_layer_1_output_layer_norm_weight<
2944
+ beta4
2945
+ 2
2946
+ 0model_transformer_layer_1_output_layer_norm_bias
2947
+ epsilon
2948
+
2949
+ 
2950
+ var_19%
2951
+ query_5
2952
+  
2953
+ 
2954
+ �
2955
+ �*
2956
+ name
2957
+ 
2958
+ "
2959
+ query_5�
2960
+ linear
2961
+ x
2962
+
2963
+ query_5>
2964
+ weight4
2965
+ 2
2966
+ 0model_transformer_layer_2_attention_q_lin_weight:
2967
+ bias2
2968
+ 0
2969
+ .model_transformer_layer_2_attention_q_lin_bias"
2970
+ x_17
2971
+  
2972
+ 
2973
+ �
2974
+ �*
2975
+ name
2976
+ 
2977
+
2978
+ "
2979
+ x_17j
2980
+ const
2981
+ var_204
2982
+
2983
+ 
2984
+ *
2985
+ name
2986
+ 
2987
+
2988
+ "
2989
+ op_204**
2990
+ val#
2991
+
2992
+ 
2993
+ 
2994
+ 
2995
+
2996
+ reshape
2997
+ x
2998
+ 
2999
+ x_17
3000
+ shape
3001
+
3002
+ var_204*
3003
+ var_205
3004
+  
3005
+ 
3006
+ �
3007
+  
3008
+ @*
3009
+ name
3010
+ 
3011
+
3012
+ "
3013
+ op_205�
3014
+ linear
3015
+ x
3016
+
3017
+ query_5>
3018
+ weight4
3019
+ 2
3020
+ 0model_transformer_layer_2_attention_k_lin_weight:
3021
+ bias2
3022
+ 0
3023
+ .model_transformer_layer_2_attention_k_lin_bias"
3024
+ x_19
3025
+  
3026
+ 
3027
+ �
3028
+ �*
3029
+ name
3030
+ 
3031
+
3032
+ "
3033
+ x_19j
3034
+ const
3035
+ var_210
3036
+
3037
+ 
3038
+ *
3039
+ name
3040
+ 
3041
+
3042
+ "
3043
+ op_210**
3044
+ val#
3045
+
3046
+ 
3047
+ 
3048
+ 
3049
+
3050
+ reshape
3051
+ x
3052
+ 
3053
+ x_19
3054
+ shape
3055
+
3056
+ var_210*
3057
+ var_211
3058
+  
3059
+ 
3060
+ �
3061
+  
3062
+ @*
3063
+ name
3064
+ 
3065
+
3066
+ "
3067
+ op_211�
3068
+ linear
3069
+ x
3070
+
3071
+ query_5>
3072
+ weight4
3073
+ 2
3074
+ 0model_transformer_layer_2_attention_v_lin_weight:
3075
+ bias2
3076
+ 0
3077
+ .model_transformer_layer_2_attention_v_lin_bias"
3078
+ x_21
3079
+  
3080
+ 
3081
+ �
3082
+ �*
3083
+ name
3084
+ 
3085
+
3086
+ "
3087
+ x_21j
3088
+ const
3089
+ var_216
3090
+
3091
+ 
3092
+ *
3093
+ name
3094
+ 
3095
+
3096
+ "
3097
+ op_216**
3098
+ val#
3099
+
3100
+ 
3101
+ 
3102
+ 
3103
+
3104
+ reshape
3105
+ x
3106
+ 
3107
+ x_21
3108
+ shape
3109
+
3110
+ var_216*
3111
+ var_217
3112
+  
3113
+ 
3114
+ �
3115
+  
3116
+ @*
3117
+ name
3118
+ 
3119
+
3120
+ "
3121
+ op_217h
3122
+ const
3123
+
3124
+ v_5_perm_0
3125
+
3126
+ 
3127
+ *
3128
+ name
3129
+ 
3130
+ "
3131
+
3132
+ v_5_perm_0*!
3133
+ val
3134
+
3135
+ 
3136
+ 
3137
+
3138
+ 
3139
+ h
3140
+ const
3141
+ _inversed_q_11_y_0
3142
+  *(
3143
+ name 
3144
+ 
3145
+ "
3146
+ _inversed_q_11_y_0*
3147
+ val
3148
+  
3149
+
3150
+ 
3151
+ 
3152
+ >�
3153
+ mul
3154
+ x
3155
+
3156
+ var_205
3157
+ y
3158
+ 
3159
+ _inversed_q_11_y_01
3160
+ _inversed_q_11
3161
+  
3162
+ 
3163
+ �
3164
+  
3165
+ @*$
3166
+ name
3167
+ 
3168
+ "
3169
+ _inversed_q_11m
3170
+ const
3171
+ scores_5_transpose_x_0
3172
+ *,
3173
+ name$
3174
+ 
3175
+ "
3176
+ scores_5_transpose_x_0*
3177
+ val
3178
+ 
3179
+ 
3180
+ m
3181
+ const
3182
+ scores_5_transpose_y_0
3183
+ *,
3184
+ name$
3185
+ 
3186
+ "
3187
+ scores_5_transpose_y_0*
3188
+ val
3189
+ 
3190
+ 
3191
+ z
3192
+ const#
3193
+ transpose_22_perm_0
3194
+
3195
+ 
3196
+ *)
3197
+ name!
3198
+ 
3199
+ "
3200
+ transpose_22_perm_0*!
3201
+ val
3202
+
3203
+ 
3204
+ 
3205
+
3206
+ 
3207
+ z
3208
+ const#
3209
+ transpose_23_perm_0
3210
+
3211
+ 
3212
+ *)
3213
+ name!
3214
+ 
3215
+ "
3216
+ transpose_23_perm_0*!
3217
+ val
3218
+
3219
+ 
3220
+ 
3221
+
3222
+ 
3223
+ �
3224
+ transpose
3225
+ x
3226
+
3227
+ var_211
3228
+ perm
3229
+ 
3230
+ transpose_23_perm_0/
3231
+ transpose_43
3232
+  
3233
+ 
3234
+  
3235
+ @
3236
+ �*"
3237
+ name
3238
+ 
3239
+ "
3240
+ transpose_43�
3241
+ transpose
3242
+ x
3243
+ 
3244
+ _inversed_q_11
3245
+ perm
3246
+ 
3247
+ transpose_22_perm_0/
3248
+ transpose_44
3249
+  
3250
+ 
3251
+  
3252
+ �
3253
+ @*"
3254
+ name
3255
+ 
3256
+ "
3257
+ transpose_44�
3258
+ matmul
3259
+ x
3260
+ 
3261
+ transpose_44
3262
+ y
3263
+ 
3264
+ transpose_43)
3265
+ transpose_x
3266
+ 
3267
+ scores_5_transpose_x_0)
3268
+ transpose_y
3269
+ 
3270
+ scores_5_transpose_y_0,
3271
+ scores_5
3272
+  
3273
+ 
3274
+  
3275
+ �
3276
+ �*
3277
+ name
3278
+ 
3279
+ "
3280
+
3281
+ scores_5Q
3282
+ const
3283
+ var_227
3284
+  *
3285
+ name
3286
+ 
3287
+
3288
+ "
3289
+ op_227*
3290
+ val
3291
+  
3292
+
3293
+ 
3294
+ 
3295
+ ����
3296
+ select
3297
+ cond
3298
+
3299
+ 
3300
+ mask_3
3301
+ a
3302
+
3303
+ var_227
3304
+ b
3305
+
3306
+
3307
+ scores_5,
3308
+ input_43
3309
+  
3310
+ 
3311
+  
3312
+ �
3313
+ �*
3314
+ name
3315
+ 
3316
+ "
3317
+
3318
+ input_43~
3319
+ softmax
3320
+ x
3321
+
3322
+
3323
+ input_43
3324
+ axis
3325
+
3326
+ 
3327
+ var_17,
3328
+ input_45
3329
+  
3330
+ 
3331
+  
3332
+ �
3333
+ �*
3334
+ name
3335
+ 
3336
+ "
3337
+
3338
+ input_45e
3339
+ const
3340
+ x_23_transpose_x_0
3341
+ *(
3342
+ name 
3343
+ 
3344
+ "
3345
+ x_23_transpose_x_0*
3346
+ val
3347
+ 
3348
+ 
3349
+ e
3350
+ const
3351
+ x_23_transpose_y_0
3352
+ *(
3353
+ name 
3354
+ 
3355
+ "
3356
+ x_23_transpose_y_0*
3357
+ val
3358
+ 
3359
+ 
3360
+ �
3361
+ transpose
3362
+ x
3363
+
3364
+ var_217
3365
+ perm
3366
+
3367
+
3368
+ v_5_perm_0/
3369
+ transpose_45
3370
+  
3371
+ 
3372
+  
3373
+ �
3374
+ @*"
3375
+ name
3376
+ 
3377
+ "
3378
+ transpose_45�
3379
+ matmul
3380
+ x
3381
+
3382
+
3383
+ input_45
3384
+ y
3385
+ 
3386
+ transpose_45%
3387
+ transpose_x
3388
+ 
3389
+ x_23_transpose_x_0%
3390
+ transpose_y
3391
+ 
3392
+ x_23_transpose_y_0'
3393
+ x_23
3394
+  
3395
+ 
3396
+  
3397
+ �
3398
+ @*
3399
+ name
3400
+ 
3401
+
3402
+ "
3403
+ x_23o
3404
+ const
3405
+ var_233_perm_0
3406
+
3407
+ 
3408
+ *#
3409
+ name
3410
+ 
3411
+ "
3412
+
3413
+ val
3414
+
3415
+ 
3416
+ 
3417
+
3418
+ 
3419
+ j
3420
+ const
3421
+ var_235
3422
+
3423
+ 
3424
+ *
3425
+ name
3426
+ 
3427
+
3428
+ "
3429
+ op_235**
3430
+ val#
3431
+
3432
+ 
3433
+ 
3434
+ 
3435
+
3436
+ transpose
3437
+ x
3438
+ 
3439
+ x_23
3440
+ perm
3441
+ 
3442
+ var_233_perm_0/
3443
+ transpose_42
3444
+  
3445
+ 
3446
+ �
3447
+  
3448
+ @*"
3449
+ name
3450
+ 
3451
+ "
3452
+ transpose_42~
3453
+ reshape
3454
+ x
3455
+ 
3456
+ transpose_42
3457
+ shape
3458
+
3459
+ var_235&
3460
+ input_47
3461
+  
3462
+ 
3463
+ �
3464
+ �*
3465
+ name
3466
+ 
3467
+ "
3468
+
3469
+ input_47�
3470
+ linear
3471
+ x
3472
+
3473
+
3474
+ input_47@
3475
+ weight6
3476
+ 4
3477
+ 2model_transformer_layer_2_attention_out_lin_weight<
3478
+ bias4
3479
+ 2
3480
+ 0model_transformer_layer_2_attention_out_lin_bias)
3481
+ sa_output_5
3482
+  
3483
+ 
3484
+ �
3485
+ �*!
3486
+ name
3487
+ 
3488
+ "
3489
+ sa_output_5u
3490
+ add
3491
+ x
3492
+
3493
+ sa_output_5
3494
+ y
3495
+
3496
+ query_5&
3497
+ input_49
3498
+  
3499
+ 
3500
+ �
3501
+ �*
3502
+ name
3503
+ 
3504
+ "
3505
+
3506
+ input_49x
3507
+ const
3508
+ input_51_axes_0
3509
+
3510
+ 
3511
+ *%
3512
+ name
3513
+ 
3514
+ "
3515
+ input_51_axes_0*'
3516
+ val 
3517
+
3518
+ 
3519
+ 
3520
+ 
3521
+
3522
+ ����������
3523
+
3524
+ layer_norm
3525
+ x
3526
+
3527
+
3528
+ input_49
3529
+ axes
3530
+ 
3531
+ input_51_axes_0;
3532
+ gamma2
3533
+ 0
3534
+ .model_transformer_layer_2_sa_layer_norm_weight8
3535
+ beta0
3536
+ .
3537
+ ,model_transformer_layer_2_sa_layer_norm_bias
3538
+ epsilon
3539
+
3540
+ 
3541
+ var_19&
3542
+ input_51
3543
+  
3544
+ 
3545
+ �
3546
+ �*
3547
+ name
3548
+ 
3549
+ "
3550
+
3551
+ input_51�
3552
+ linear
3553
+ x
3554
+
3555
+
3556
+ input_517
3557
+ weight-
3558
+ +
3559
+ )model_transformer_layer_2_ffn_lin1_weight3
3560
+ bias+
3561
+ )
3562
+ 'model_transformer_layer_2_ffn_lin1_bias&
3563
+ input_53
3564
+  
3565
+ 
3566
+ �
3567
+ �*
3568
+ name
3569
+ 
3570
+ "
3571
+
3572
+ input_53c
3573
+ const
3574
+ input_55_mode_0
3575
+ *%
3576
+ name
3577
+ 
3578
+ "
3579
+ input_55_mode_0*
3580
+ val
3581
+ 
3582
+ "
3583
+ EXACT~
3584
+ gelu
3585
+ x
3586
+
3587
+
3588
+ input_53
3589
+ mode
3590
+ 
3591
+ input_55_mode_0&
3592
+ input_55
3593
+  
3594
+ 
3595
+ �
3596
+ �*
3597
+ name
3598
+ 
3599
+ "
3600
+
3601
+ input_55�
3602
+ linear
3603
+ x
3604
+
3605
+
3606
+ input_557
3607
+ weight-
3608
+ +
3609
+ )model_transformer_layer_2_ffn_lin2_weight3
3610
+ bias+
3611
+ )
3612
+ 'model_transformer_layer_2_ffn_lin2_bias&
3613
+ input_57
3614
+  
3615
+ 
3616
+ �
3617
+ �*
3618
+ name
3619
+ 
3620
+ "
3621
+
3622
+ input_57s
3623
+ add
3624
+ x
3625
+
3626
+
3627
+ input_57
3628
+ y
3629
+
3630
+
3631
+ input_51&
3632
+ input_59
3633
+  
3634
+ 
3635
+ �
3636
+ �*
3637
+ name
3638
+ 
3639
+ "
3640
+
3641
+ input_59v
3642
+ const
3643
+ query_7_axes_0
3644
+
3645
+ 
3646
+ *$
3647
+ name
3648
+ 
3649
+ "
3650
+ query_7_axes_0*'
3651
+ val 
3652
+
3653
+ 
3654
+ 
3655
+ 
3656
+
3657
+ ����������
3658
+
3659
+ layer_norm
3660
+ x
3661
+
3662
+
3663
+ input_59
3664
+ axes
3665
+ 
3666
+ query_7_axes_0?
3667
+ gamma6
3668
+ 4
3669
+ 2model_transformer_layer_2_output_layer_norm_weight<
3670
+ beta4
3671
+ 2
3672
+ 0model_transformer_layer_2_output_layer_norm_bias
3673
+ epsilon
3674
+
3675
+ 
3676
+ var_19%
3677
+ query_7
3678
+  
3679
+ 
3680
+ �
3681
+ �*
3682
+ name
3683
+ 
3684
+ "
3685
+ query_7�
3686
+ linear
3687
+ x
3688
+
3689
+ query_7>
3690
+ weight4
3691
+ 2
3692
+ 0model_transformer_layer_3_attention_q_lin_weight:
3693
+ bias2
3694
+ 0
3695
+ .model_transformer_layer_3_attention_q_lin_bias"
3696
+ x_25
3697
+  
3698
+ 
3699
+ �
3700
+ �*
3701
+ name
3702
+ 
3703
+
3704
+ "
3705
+ x_25j
3706
+ const
3707
+ var_273
3708
+
3709
+ 
3710
+ *
3711
+ name
3712
+ 
3713
+
3714
+ "
3715
+ op_273**
3716
+ val#
3717
+
3718
+ 
3719
+ 
3720
+ 
3721
+
3722
+ reshape
3723
+ x
3724
+ 
3725
+ x_25
3726
+ shape
3727
+
3728
+ var_273*
3729
+ var_274
3730
+  
3731
+ 
3732
+ �
3733
+  
3734
+ @*
3735
+ name
3736
+ 
3737
+
3738
+ "
3739
+ op_274�
3740
+ linear
3741
+ x
3742
+
3743
+ query_7>
3744
+ weight4
3745
+ 2
3746
+ 0model_transformer_layer_3_attention_k_lin_weight:
3747
+ bias2
3748
+ 0
3749
+ .model_transformer_layer_3_attention_k_lin_bias"
3750
+ x_27
3751
+  
3752
+ 
3753
+ �
3754
+ �*
3755
+ name
3756
+ 
3757
+
3758
+ "
3759
+ x_27j
3760
+ const
3761
+ var_279
3762
+
3763
+ 
3764
+ *
3765
+ name
3766
+ 
3767
+
3768
+ "
3769
+ op_279**
3770
+ val#
3771
+
3772
+ 
3773
+ 
3774
+ 
3775
+
3776
+ reshape
3777
+ x
3778
+ 
3779
+ x_27
3780
+ shape
3781
+
3782
+ var_279*
3783
+ var_280
3784
+  
3785
+ 
3786
+ �
3787
+  
3788
+ @*
3789
+ name
3790
+ 
3791
+
3792
+ "
3793
+ op_280�
3794
+ linear
3795
+ x
3796
+
3797
+ query_7>
3798
+ weight4
3799
+ 2
3800
+ 0model_transformer_layer_3_attention_v_lin_weight:
3801
+ bias2
3802
+ 0
3803
+ .model_transformer_layer_3_attention_v_lin_bias"
3804
+ x_29
3805
+  
3806
+ 
3807
+ �
3808
+ �*
3809
+ name
3810
+ 
3811
+
3812
+ "
3813
+ x_29j
3814
+ const
3815
+ var_285
3816
+
3817
+ 
3818
+ *
3819
+ name
3820
+ 
3821
+
3822
+ "
3823
+ op_285**
3824
+ val#
3825
+
3826
+ 
3827
+ 
3828
+ 
3829
+
3830
+ reshape
3831
+ x
3832
+ 
3833
+ x_29
3834
+ shape
3835
+
3836
+ var_285*
3837
+ var_286
3838
+  
3839
+ 
3840
+ �
3841
+  
3842
+ @*
3843
+ name
3844
+ 
3845
+
3846
+ "
3847
+ op_286h
3848
+ const
3849
+
3850
+ v_7_perm_0
3851
+
3852
+ 
3853
+ *
3854
+ name
3855
+ 
3856
+ "
3857
+
3858
+ v_7_perm_0*!
3859
+ val
3860
+
3861
+ 
3862
+ 
3863
+
3864
+ 
3865
+ h
3866
+ const
3867
+ _inversed_q_15_y_0
3868
+  *(
3869
+ name 
3870
+ 
3871
+ "
3872
+ _inversed_q_15_y_0*
3873
+ val
3874
+  
3875
+
3876
+ 
3877
+ 
3878
+ >�
3879
+ mul
3880
+ x
3881
+
3882
+ var_274
3883
+ y
3884
+ 
3885
+ _inversed_q_15_y_01
3886
+ _inversed_q_15
3887
+  
3888
+ 
3889
+ �
3890
+  
3891
+ @*$
3892
+ name
3893
+ 
3894
+ "
3895
+ _inversed_q_15m
3896
+ const
3897
+ scores_7_transpose_x_0
3898
+ *,
3899
+ name$
3900
+ 
3901
+ "
3902
+ scores_7_transpose_x_0*
3903
+ val
3904
+ 
3905
+ 
3906
+ m
3907
+ const
3908
+ scores_7_transpose_y_0
3909
+ *,
3910
+ name$
3911
+ 
3912
+ "
3913
+ scores_7_transpose_y_0*
3914
+ val
3915
+ 
3916
+ 
3917
+ z
3918
+ const#
3919
+ transpose_24_perm_0
3920
+
3921
+ 
3922
+ *)
3923
+ name!
3924
+ 
3925
+ "
3926
+ transpose_24_perm_0*!
3927
+ val
3928
+
3929
+ 
3930
+ 
3931
+
3932
+ 
3933
+ z
3934
+ const#
3935
+ transpose_25_perm_0
3936
+
3937
+ 
3938
+ *)
3939
+ name!
3940
+ 
3941
+ "
3942
+ transpose_25_perm_0*!
3943
+ val
3944
+
3945
+ 
3946
+ 
3947
+
3948
+ 
3949
+ �
3950
+ transpose
3951
+ x
3952
+
3953
+ var_280
3954
+ perm
3955
+ 
3956
+ transpose_25_perm_0/
3957
+ transpose_39
3958
+  
3959
+ 
3960
+  
3961
+ @
3962
+ �*"
3963
+ name
3964
+ 
3965
+ "
3966
+ transpose_39�
3967
+ transpose
3968
+ x
3969
+ 
3970
+ _inversed_q_15
3971
+ perm
3972
+ 
3973
+ transpose_24_perm_0/
3974
+ transpose_40
3975
+  
3976
+ 
3977
+  
3978
+ �
3979
+ @*"
3980
+ name
3981
+ 
3982
+ "
3983
+ transpose_40�
3984
+ matmul
3985
+ x
3986
+ 
3987
+ transpose_40
3988
+ y
3989
+ 
3990
+ transpose_39)
3991
+ transpose_x
3992
+ 
3993
+ scores_7_transpose_x_0)
3994
+ transpose_y
3995
+ 
3996
+ scores_7_transpose_y_0,
3997
+ scores_7
3998
+  
3999
+ 
4000
+  
4001
+ �
4002
+ �*
4003
+ name
4004
+ 
4005
+ "
4006
+
4007
+ scores_7Q
4008
+ const
4009
+ var_296
4010
+  *
4011
+ name
4012
+ 
4013
+
4014
+ "
4015
+ op_296*
4016
+ val
4017
+  
4018
+
4019
+ 
4020
+ 
4021
+ ����
4022
+ select
4023
+ cond
4024
+
4025
+ 
4026
+ mask_3
4027
+ a
4028
+
4029
+ var_296
4030
+ b
4031
+
4032
+
4033
+ scores_7,
4034
+ input_61
4035
+  
4036
+ 
4037
+  
4038
+ �
4039
+ �*
4040
+ name
4041
+ 
4042
+ "
4043
+
4044
+ input_61~
4045
+ softmax
4046
+ x
4047
+
4048
+
4049
+ input_61
4050
+ axis
4051
+
4052
+ 
4053
+ var_17,
4054
+ input_63
4055
+  
4056
+ 
4057
+  
4058
+ �
4059
+ �*
4060
+ name
4061
+ 
4062
+ "
4063
+
4064
+ input_63e
4065
+ const
4066
+ x_31_transpose_x_0
4067
+ *(
4068
+ name 
4069
+ 
4070
+ "
4071
+ x_31_transpose_x_0*
4072
+ val
4073
+ 
4074
+ 
4075
+ e
4076
+ const
4077
+ x_31_transpose_y_0
4078
+ *(
4079
+ name 
4080
+ 
4081
+ "
4082
+ x_31_transpose_y_0*
4083
+ val
4084
+ 
4085
+ 
4086
+ �
4087
+ transpose
4088
+ x
4089
+
4090
+ var_286
4091
+ perm
4092
+
4093
+
4094
+ v_7_perm_0/
4095
+ transpose_41
4096
+  
4097
+ 
4098
+  
4099
+ �
4100
+ @*"
4101
+ name
4102
+ 
4103
+ "
4104
+ transpose_41�
4105
+ matmul
4106
+ x
4107
+
4108
+
4109
+ input_63
4110
+ y
4111
+ 
4112
+ transpose_41%
4113
+ transpose_x
4114
+ 
4115
+ x_31_transpose_x_0%
4116
+ transpose_y
4117
+ 
4118
+ x_31_transpose_y_0'
4119
+ x_31
4120
+  
4121
+ 
4122
+  
4123
+ �
4124
+ @*
4125
+ name
4126
+ 
4127
+
4128
+ "
4129
+ x_31o
4130
+ const
4131
+ var_302_perm_0
4132
+
4133
+ 
4134
+ *#
4135
+ name
4136
+ 
4137
+ "
4138
+
4139
+ val
4140
+
4141
+ 
4142
+ 
4143
+
4144
+ 
4145
+ j
4146
+ const
4147
+ var_304
4148
+
4149
+ 
4150
+ *
4151
+ name
4152
+ 
4153
+
4154
+ "
4155
+ op_304**
4156
+ val#
4157
+
4158
+ 
4159
+ 
4160
+ 
4161
+
4162
+ transpose
4163
+ x
4164
+ 
4165
+ x_31
4166
+ perm
4167
+ 
4168
+ var_302_perm_0/
4169
+ transpose_38
4170
+  
4171
+ 
4172
+ �
4173
+  
4174
+ @*"
4175
+ name
4176
+ 
4177
+ "
4178
+ transpose_38~
4179
+ reshape
4180
+ x
4181
+ 
4182
+ transpose_38
4183
+ shape
4184
+
4185
+ var_304&
4186
+ input_65
4187
+  
4188
+ 
4189
+ �
4190
+ �*
4191
+ name
4192
+ 
4193
+ "
4194
+
4195
+ input_65�
4196
+ linear
4197
+ x
4198
+
4199
+
4200
+ input_65@
4201
+ weight6
4202
+ 4
4203
+ 2model_transformer_layer_3_attention_out_lin_weight<
4204
+ bias4
4205
+ 2
4206
+ 0model_transformer_layer_3_attention_out_lin_bias)
4207
+ sa_output_7
4208
+  
4209
+ 
4210
+ �
4211
+ �*!
4212
+ name
4213
+ 
4214
+ "
4215
+ sa_output_7u
4216
+ add
4217
+ x
4218
+
4219
+ sa_output_7
4220
+ y
4221
+
4222
+ query_7&
4223
+ input_67
4224
+  
4225
+ 
4226
+ �
4227
+ �*
4228
+ name
4229
+ 
4230
+ "
4231
+
4232
+ input_67x
4233
+ const
4234
+ input_69_axes_0
4235
+
4236
+ 
4237
+ *%
4238
+ name
4239
+ 
4240
+ "
4241
+ input_69_axes_0*'
4242
+ val 
4243
+
4244
+ 
4245
+ 
4246
+ 
4247
+
4248
+ ����������
4249
+
4250
+ layer_norm
4251
+ x
4252
+
4253
+
4254
+ input_67
4255
+ axes
4256
+ 
4257
+ input_69_axes_0;
4258
+ gamma2
4259
+ 0
4260
+ .model_transformer_layer_3_sa_layer_norm_weight8
4261
+ beta0
4262
+ .
4263
+ ,model_transformer_layer_3_sa_layer_norm_bias
4264
+ epsilon
4265
+
4266
+ 
4267
+ var_19&
4268
+ input_69
4269
+  
4270
+ 
4271
+ �
4272
+ �*
4273
+ name
4274
+ 
4275
+ "
4276
+
4277
+ input_69�
4278
+ linear
4279
+ x
4280
+
4281
+
4282
+ input_697
4283
+ weight-
4284
+ +
4285
+ )model_transformer_layer_3_ffn_lin1_weight3
4286
+ bias+
4287
+ )
4288
+ 'model_transformer_layer_3_ffn_lin1_bias&
4289
+ input_71
4290
+  
4291
+ 
4292
+ �
4293
+ �*
4294
+ name
4295
+ 
4296
+ "
4297
+
4298
+ input_71c
4299
+ const
4300
+ input_73_mode_0
4301
+ *%
4302
+ name
4303
+ 
4304
+ "
4305
+ input_73_mode_0*
4306
+ val
4307
+ 
4308
+ "
4309
+ EXACT~
4310
+ gelu
4311
+ x
4312
+
4313
+
4314
+ input_71
4315
+ mode
4316
+ 
4317
+ input_73_mode_0&
4318
+ input_73
4319
+  
4320
+ 
4321
+ �
4322
+ �*
4323
+ name
4324
+ 
4325
+ "
4326
+
4327
+ input_73�
4328
+ linear
4329
+ x
4330
+
4331
+
4332
+ input_737
4333
+ weight-
4334
+ +
4335
+ )model_transformer_layer_3_ffn_lin2_weight3
4336
+ bias+
4337
+ )
4338
+ 'model_transformer_layer_3_ffn_lin2_bias&
4339
+ input_75
4340
+  
4341
+ 
4342
+ �
4343
+ �*
4344
+ name
4345
+ 
4346
+ "
4347
+
4348
+ input_75s
4349
+ add
4350
+ x
4351
+
4352
+
4353
+ input_75
4354
+ y
4355
+
4356
+
4357
+ input_69&
4358
+ input_77
4359
+  
4360
+ 
4361
+ �
4362
+ �*
4363
+ name
4364
+ 
4365
+ "
4366
+
4367
+ input_77v
4368
+ const
4369
+ query_9_axes_0
4370
+
4371
+ 
4372
+ *$
4373
+ name
4374
+ 
4375
+ "
4376
+ query_9_axes_0*'
4377
+ val 
4378
+
4379
+ 
4380
+ 
4381
+ 
4382
+
4383
+ ����������
4384
+
4385
+ layer_norm
4386
+ x
4387
+
4388
+
4389
+ input_77
4390
+ axes
4391
+ 
4392
+ query_9_axes_0?
4393
+ gamma6
4394
+ 4
4395
+ 2model_transformer_layer_3_output_layer_norm_weight<
4396
+ beta4
4397
+ 2
4398
+ 0model_transformer_layer_3_output_layer_norm_bias
4399
+ epsilon
4400
+
4401
+ 
4402
+ var_19%
4403
+ query_9
4404
+  
4405
+ 
4406
+ �
4407
+ �*
4408
+ name
4409
+ 
4410
+ "
4411
+ query_9�
4412
+ linear
4413
+ x
4414
+
4415
+ query_9>
4416
+ weight4
4417
+ 2
4418
+ 0model_transformer_layer_4_attention_q_lin_weight:
4419
+ bias2
4420
+ 0
4421
+ .model_transformer_layer_4_attention_q_lin_bias"
4422
+ x_33
4423
+  
4424
+ 
4425
+ �
4426
+ �*
4427
+ name
4428
+ 
4429
+
4430
+ "
4431
+ x_33j
4432
+ const
4433
+ var_342
4434
+
4435
+ 
4436
+ *
4437
+ name
4438
+ 
4439
+
4440
+ "
4441
+ op_342**
4442
+ val#
4443
+
4444
+ 
4445
+ 
4446
+ 
4447
+
4448
+ reshape
4449
+ x
4450
+ 
4451
+ x_33
4452
+ shape
4453
+
4454
+ var_342*
4455
+ var_343
4456
+  
4457
+ 
4458
+ �
4459
+  
4460
+ @*
4461
+ name
4462
+ 
4463
+
4464
+ "
4465
+ op_343�
4466
+ linear
4467
+ x
4468
+
4469
+ query_9>
4470
+ weight4
4471
+ 2
4472
+ 0model_transformer_layer_4_attention_k_lin_weight:
4473
+ bias2
4474
+ 0
4475
+ .model_transformer_layer_4_attention_k_lin_bias"
4476
+ x_35
4477
+  
4478
+ 
4479
+ �
4480
+ �*
4481
+ name
4482
+ 
4483
+
4484
+ "
4485
+ x_35j
4486
+ const
4487
+ var_348
4488
+
4489
+ 
4490
+ *
4491
+ name
4492
+ 
4493
+
4494
+ "
4495
+ op_348**
4496
+ val#
4497
+
4498
+ 
4499
+ 
4500
+ 
4501
+
4502
+ reshape
4503
+ x
4504
+ 
4505
+ x_35
4506
+ shape
4507
+
4508
+ var_348*
4509
+ var_349
4510
+  
4511
+ 
4512
+ �
4513
+  
4514
+ @*
4515
+ name
4516
+ 
4517
+
4518
+ "
4519
+ op_349�
4520
+ linear
4521
+ x
4522
+
4523
+ query_9>
4524
+ weight4
4525
+ 2
4526
+ 0model_transformer_layer_4_attention_v_lin_weight:
4527
+ bias2
4528
+ 0
4529
+ .model_transformer_layer_4_attention_v_lin_bias"
4530
+ x_37
4531
+  
4532
+ 
4533
+ �
4534
+ �*
4535
+ name
4536
+ 
4537
+
4538
+ "
4539
+ x_37j
4540
+ const
4541
+ var_354
4542
+
4543
+ 
4544
+ *
4545
+ name
4546
+ 
4547
+
4548
+ "
4549
+ op_354**
4550
+ val#
4551
+
4552
+ 
4553
+ 
4554
+ 
4555
+
4556
+ reshape
4557
+ x
4558
+ 
4559
+ x_37
4560
+ shape
4561
+
4562
+ var_354*
4563
+ var_355
4564
+  
4565
+ 
4566
+ �
4567
+  
4568
+ @*
4569
+ name
4570
+ 
4571
+
4572
+ "
4573
+ op_355h
4574
+ const
4575
+
4576
+ v_9_perm_0
4577
+
4578
+ 
4579
+ *
4580
+ name
4581
+ 
4582
+ "
4583
+
4584
+ v_9_perm_0*!
4585
+ val
4586
+
4587
+ 
4588
+ 
4589
+
4590
+ 
4591
+ h
4592
+ const
4593
+ _inversed_q_19_y_0
4594
+  *(
4595
+ name 
4596
+ 
4597
+ "
4598
+ _inversed_q_19_y_0*
4599
+ val
4600
+  
4601
+
4602
+ 
4603
+ 
4604
+ >�
4605
+ mul
4606
+ x
4607
+
4608
+ var_343
4609
+ y
4610
+ 
4611
+ _inversed_q_19_y_01
4612
+ _inversed_q_19
4613
+  
4614
+ 
4615
+ �
4616
+  
4617
+ @*$
4618
+ name
4619
+ 
4620
+ "
4621
+ _inversed_q_19m
4622
+ const
4623
+ scores_9_transpose_x_0
4624
+ *,
4625
+ name$
4626
+ 
4627
+ "
4628
+ scores_9_transpose_x_0*
4629
+ val
4630
+ 
4631
+ 
4632
+ m
4633
+ const
4634
+ scores_9_transpose_y_0
4635
+ *,
4636
+ name$
4637
+ 
4638
+ "
4639
+ scores_9_transpose_y_0*
4640
+ val
4641
+ 
4642
+ 
4643
+ z
4644
+ const#
4645
+ transpose_26_perm_0
4646
+
4647
+ 
4648
+ *)
4649
+ name!
4650
+ 
4651
+ "
4652
+ transpose_26_perm_0*!
4653
+ val
4654
+
4655
+ 
4656
+ 
4657
+
4658
+ 
4659
+ z
4660
+ const#
4661
+ transpose_27_perm_0
4662
+
4663
+ 
4664
+ *)
4665
+ name!
4666
+ 
4667
+ "
4668
+ transpose_27_perm_0*!
4669
+ val
4670
+
4671
+ 
4672
+ 
4673
+
4674
+ 
4675
+ �
4676
+ transpose
4677
+ x
4678
+
4679
+ var_349
4680
+ perm
4681
+ 
4682
+ transpose_27_perm_0/
4683
+ transpose_35
4684
+  
4685
+ 
4686
+  
4687
+ @
4688
+ �*"
4689
+ name
4690
+ 
4691
+ "
4692
+ transpose_35�
4693
+ transpose
4694
+ x
4695
+ 
4696
+ _inversed_q_19
4697
+ perm
4698
+ 
4699
+ transpose_26_perm_0/
4700
+ transpose_36
4701
+  
4702
+ 
4703
+  
4704
+ �
4705
+ @*"
4706
+ name
4707
+ 
4708
+ "
4709
+ transpose_36�
4710
+ matmul
4711
+ x
4712
+ 
4713
+ transpose_36
4714
+ y
4715
+ 
4716
+ transpose_35)
4717
+ transpose_x
4718
+ 
4719
+ scores_9_transpose_x_0)
4720
+ transpose_y
4721
+ 
4722
+ scores_9_transpose_y_0,
4723
+ scores_9
4724
+  
4725
+ 
4726
+  
4727
+ �
4728
+ �*
4729
+ name
4730
+ 
4731
+ "
4732
+
4733
+ scores_9Q
4734
+ const
4735
+ var_365
4736
+  *
4737
+ name
4738
+ 
4739
+
4740
+ "
4741
+ op_365*
4742
+ val
4743
+  
4744
+
4745
+ 
4746
+ 
4747
+ ����
4748
+ select
4749
+ cond
4750
+
4751
+ 
4752
+ mask_3
4753
+ a
4754
+
4755
+ var_365
4756
+ b
4757
+
4758
+
4759
+ scores_9,
4760
+ input_79
4761
+  
4762
+ 
4763
+  
4764
+ �
4765
+ �*
4766
+ name
4767
+ 
4768
+ "
4769
+
4770
+ input_79~
4771
+ softmax
4772
+ x
4773
+
4774
+
4775
+ input_79
4776
+ axis
4777
+
4778
+ 
4779
+ var_17,
4780
+ input_81
4781
+  
4782
+ 
4783
+  
4784
+ �
4785
+ �*
4786
+ name
4787
+ 
4788
+ "
4789
+
4790
+ input_81e
4791
+ const
4792
+ x_39_transpose_x_0
4793
+ *(
4794
+ name 
4795
+ 
4796
+ "
4797
+ x_39_transpose_x_0*
4798
+ val
4799
+ 
4800
+ 
4801
+ e
4802
+ const
4803
+ x_39_transpose_y_0
4804
+ *(
4805
+ name 
4806
+ 
4807
+ "
4808
+ x_39_transpose_y_0*
4809
+ val
4810
+ 
4811
+ 
4812
+ �
4813
+ transpose
4814
+ x
4815
+
4816
+ var_355
4817
+ perm
4818
+
4819
+
4820
+ v_9_perm_0/
4821
+ transpose_37
4822
+  
4823
+ 
4824
+  
4825
+ �
4826
+ @*"
4827
+ name
4828
+ 
4829
+ "
4830
+ transpose_37�
4831
+ matmul
4832
+ x
4833
+
4834
+
4835
+ input_81
4836
+ y
4837
+ 
4838
+ transpose_37%
4839
+ transpose_x
4840
+ 
4841
+ x_39_transpose_x_0%
4842
+ transpose_y
4843
+ 
4844
+ x_39_transpose_y_0'
4845
+ x_39
4846
+  
4847
+ 
4848
+  
4849
+ �
4850
+ @*
4851
+ name
4852
+ 
4853
+
4854
+ "
4855
+ x_39o
4856
+ const
4857
+ var_371_perm_0
4858
+
4859
+ 
4860
+ *#
4861
+ name
4862
+ 
4863
+ "
4864
+
4865
+ val
4866
+
4867
+ 
4868
+ 
4869
+
4870
+ 
4871
+ j
4872
+ const
4873
+ var_373
4874
+
4875
+ 
4876
+ *
4877
+ name
4878
+ 
4879
+
4880
+ "
4881
+ op_373**
4882
+ val#
4883
+
4884
+ 
4885
+ 
4886
+ 
4887
+
4888
+ transpose
4889
+ x
4890
+ 
4891
+ x_39
4892
+ perm
4893
+ 
4894
+ var_371_perm_0/
4895
+ transpose_34
4896
+  
4897
+ 
4898
+ �
4899
+  
4900
+ @*"
4901
+ name
4902
+ 
4903
+ "
4904
+ transpose_34~
4905
+ reshape
4906
+ x
4907
+ 
4908
+ transpose_34
4909
+ shape
4910
+
4911
+ var_373&
4912
+ input_83
4913
+  
4914
+ 
4915
+ �
4916
+ �*
4917
+ name
4918
+ 
4919
+ "
4920
+
4921
+ input_83�
4922
+ linear
4923
+ x
4924
+
4925
+
4926
+ input_83@
4927
+ weight6
4928
+ 4
4929
+ 2model_transformer_layer_4_attention_out_lin_weight<
4930
+ bias4
4931
+ 2
4932
+ 0model_transformer_layer_4_attention_out_lin_bias)
4933
+ sa_output_9
4934
+  
4935
+ 
4936
+ �
4937
+ �*!
4938
+ name
4939
+ 
4940
+ "
4941
+ sa_output_9u
4942
+ add
4943
+ x
4944
+
4945
+ sa_output_9
4946
+ y
4947
+
4948
+ query_9&
4949
+ input_85
4950
+  
4951
+ 
4952
+ �
4953
+ �*
4954
+ name
4955
+ 
4956
+ "
4957
+
4958
+ input_85x
4959
+ const
4960
+ input_87_axes_0
4961
+
4962
+ 
4963
+ *%
4964
+ name
4965
+ 
4966
+ "
4967
+ input_87_axes_0*'
4968
+ val 
4969
+
4970
+ 
4971
+ 
4972
+ 
4973
+
4974
+ ����������
4975
+
4976
+ layer_norm
4977
+ x
4978
+
4979
+
4980
+ input_85
4981
+ axes
4982
+ 
4983
+ input_87_axes_0;
4984
+ gamma2
4985
+ 0
4986
+ .model_transformer_layer_4_sa_layer_norm_weight8
4987
+ beta0
4988
+ .
4989
+ ,model_transformer_layer_4_sa_layer_norm_bias
4990
+ epsilon
4991
+
4992
+ 
4993
+ var_19&
4994
+ input_87
4995
+  
4996
+ 
4997
+ �
4998
+ �*
4999
+ name
5000
+ 
5001
+ "
5002
+
5003
+ input_87�
5004
+ linear
5005
+ x
5006
+
5007
+
5008
+ input_877
5009
+ weight-
5010
+ +
5011
+ )model_transformer_layer_4_ffn_lin1_weight3
5012
+ bias+
5013
+ )
5014
+ 'model_transformer_layer_4_ffn_lin1_bias&
5015
+ input_89
5016
+  
5017
+ 
5018
+ �
5019
+ �*
5020
+ name
5021
+ 
5022
+ "
5023
+
5024
+ input_89c
5025
+ const
5026
+ input_91_mode_0
5027
+ *%
5028
+ name
5029
+ 
5030
+ "
5031
+ input_91_mode_0*
5032
+ val
5033
+ 
5034
+ "
5035
+ EXACT~
5036
+ gelu
5037
+ x
5038
+
5039
+
5040
+ input_89
5041
+ mode
5042
+ 
5043
+ input_91_mode_0&
5044
+ input_91
5045
+  
5046
+ 
5047
+ �
5048
+ �*
5049
+ name
5050
+ 
5051
+ "
5052
+
5053
+ input_91�
5054
+ linear
5055
+ x
5056
+
5057
+
5058
+ input_917
5059
+ weight-
5060
+ +
5061
+ )model_transformer_layer_4_ffn_lin2_weight3
5062
+ bias+
5063
+ )
5064
+ 'model_transformer_layer_4_ffn_lin2_bias&
5065
+ input_93
5066
+  
5067
+ 
5068
+ �
5069
+ �*
5070
+ name
5071
+ 
5072
+ "
5073
+
5074
+ input_93s
5075
+ add
5076
+ x
5077
+
5078
+
5079
+ input_93
5080
+ y
5081
+
5082
+
5083
+ input_87&
5084
+ input_95
5085
+  
5086
+ 
5087
+ �
5088
+ �*
5089
+ name
5090
+ 
5091
+ "
5092
+
5093
+ input_95r
5094
+ const
5095
+ query_axes_0
5096
+
5097
+ 
5098
+ *"
5099
+ name
5100
+ 
5101
+ "
5102
+ query_axes_0*'
5103
+ val 
5104
+
5105
+ 
5106
+ 
5107
+ 
5108
+
5109
+ ����������
5110
+
5111
+ layer_norm
5112
+ x
5113
+
5114
+
5115
+ input_95
5116
+ axes
5117
+ 
5118
+ query_axes_0?
5119
+ gamma6
5120
+ 4
5121
+ 2model_transformer_layer_4_output_layer_norm_weight<
5122
+ beta4
5123
+ 2
5124
+ 0model_transformer_layer_4_output_layer_norm_bias
5125
+ epsilon
5126
+
5127
+ 
5128
+ var_19#
5129
+ query
5130
+  
5131
+ 
5132
+ �
5133
+ �*
5134
+ name
5135
+ 
5136
+ "
5137
+ query�
5138
+ linear
5139
+ x
5140
+ 
5141
+ query>
5142
+ weight4
5143
+ 2
5144
+ 0model_transformer_layer_5_attention_q_lin_weight:
5145
+ bias2
5146
+ 0
5147
+ .model_transformer_layer_5_attention_q_lin_bias"
5148
+ x_41
5149
+  
5150
+ 
5151
+ �
5152
+ �*
5153
+ name
5154
+ 
5155
+
5156
+ "
5157
+ x_41j
5158
+ const
5159
+ var_411
5160
+
5161
+ 
5162
+ *
5163
+ name
5164
+ 
5165
+
5166
+ "
5167
+ op_411**
5168
+ val#
5169
+
5170
+ 
5171
+ 
5172
+ 
5173
+
5174
+ reshape
5175
+ x
5176
+ 
5177
+ x_41
5178
+ shape
5179
+
5180
+ var_411*
5181
+ var_412
5182
+  
5183
+ 
5184
+ �
5185
+  
5186
+ @*
5187
+ name
5188
+ 
5189
+
5190
+ "
5191
+ op_412�
5192
+ linear
5193
+ x
5194
+ 
5195
+ query>
5196
+ weight4
5197
+ 2
5198
+ 0model_transformer_layer_5_attention_k_lin_weight:
5199
+ bias2
5200
+ 0
5201
+ .model_transformer_layer_5_attention_k_lin_bias"
5202
+ x_43
5203
+  
5204
+ 
5205
+ �
5206
+ �*
5207
+ name
5208
+ 
5209
+
5210
+ "
5211
+ x_43j
5212
+ const
5213
+ var_417
5214
+
5215
+ 
5216
+ *
5217
+ name
5218
+ 
5219
+
5220
+ "
5221
+ op_417**
5222
+ val#
5223
+
5224
+ 
5225
+ 
5226
+ 
5227
+
5228
+ reshape
5229
+ x
5230
+ 
5231
+ x_43
5232
+ shape
5233
+
5234
+ var_417*
5235
+ var_418
5236
+  
5237
+ 
5238
+ �
5239
+  
5240
+ @*
5241
+ name
5242
+ 
5243
+
5244
+ "
5245
+ op_418�
5246
+ linear
5247
+ x
5248
+ 
5249
+ query>
5250
+ weight4
5251
+ 2
5252
+ 0model_transformer_layer_5_attention_v_lin_weight:
5253
+ bias2
5254
+ 0
5255
+ .model_transformer_layer_5_attention_v_lin_bias"
5256
+ x_45
5257
+  
5258
+ 
5259
+ �
5260
+ �*
5261
+ name
5262
+ 
5263
+
5264
+ "
5265
+ x_45j
5266
+ const
5267
+ var_423
5268
+
5269
+ 
5270
+ *
5271
+ name
5272
+ 
5273
+
5274
+ "
5275
+ op_423**
5276
+ val#
5277
+
5278
+ 
5279
+ 
5280
+ 
5281
+
5282
+ reshape
5283
+ x
5284
+ 
5285
+ x_45
5286
+ shape
5287
+
5288
+ var_423*
5289
+ var_424
5290
+  
5291
+ 
5292
+ �
5293
+  
5294
+ @*
5295
+ name
5296
+ 
5297
+
5298
+ "
5299
+ op_424d
5300
+ const
5301
+ v_perm_0
5302
+
5303
+ 
5304
+ *
5305
+ name
5306
+ 
5307
+ "
5308
+
5309
+ v_perm_0*!
5310
+ val
5311
+
5312
+ 
5313
+ 
5314
+
5315
+ 
5316
+ b
5317
+ const
5318
+ _inversed_q_y_0
5319
+  *%
5320
+ name
5321
+ 
5322
+ "
5323
+ _inversed_q_y_0*
5324
+ val
5325
+  
5326
+
5327
+ 
5328
+ 
5329
+ >�
5330
+ mul
5331
+ x
5332
+
5333
+ var_412
5334
+ y
5335
+ 
5336
+ _inversed_q_y_0.
5337
+ _inversed_q
5338
+  
5339
+ 
5340
+ �
5341
+  
5342
+ @*!
5343
+ name
5344
+ 
5345
+ "
5346
+ _inversed_qi
5347
+ const
5348
+ scores_transpose_x_0
5349
+ **
5350
+ name"
5351
+ 
5352
+ "
5353
+ scores_transpose_x_0*
5354
+ val
5355
+ 
5356
+ 
5357
+ i
5358
+ const
5359
+ scores_transpose_y_0
5360
+ **
5361
+ name"
5362
+ 
5363
+ "
5364
+ scores_transpose_y_0*
5365
+ val
5366
+ 
5367
+ 
5368
+ z
5369
+ const#
5370
+ transpose_28_perm_0
5371
+
5372
+ 
5373
+ *)
5374
+ name!
5375
+ 
5376
+ "
5377
+ transpose_28_perm_0*!
5378
+ val
5379
+
5380
+ 
5381
+ 
5382
+
5383
+ 
5384
+ z
5385
+ const#
5386
+ transpose_29_perm_0
5387
+
5388
+ 
5389
+ *)
5390
+ name!
5391
+ 
5392
+ "
5393
+ transpose_29_perm_0*!
5394
+ val
5395
+
5396
+ 
5397
+ 
5398
+
5399
+ 
5400
+ �
5401
+ transpose
5402
+ x
5403
+
5404
+ var_418
5405
+ perm
5406
+ 
5407
+ transpose_29_perm_0/
5408
+ transpose_31
5409
+  
5410
+ 
5411
+  
5412
+ @
5413
+ �*"
5414
+ name
5415
+ 
5416
+ "
5417
+ transpose_31�
5418
+ transpose
5419
+ x
5420
+
5421
+ _inversed_q
5422
+ perm
5423
+ 
5424
+ transpose_28_perm_0/
5425
+ transpose_32
5426
+  
5427
+ 
5428
+  
5429
+ �
5430
+ @*"
5431
+ name
5432
+ 
5433
+ "
5434
+ transpose_32�
5435
+ matmul
5436
+ x
5437
+ 
5438
+ transpose_32
5439
+ y
5440
+ 
5441
+ transpose_31'
5442
+ transpose_x
5443
+ 
5444
+ scores_transpose_x_0'
5445
+ transpose_y
5446
+ 
5447
+ scores_transpose_y_0*
5448
+ scores
5449
+  
5450
+ 
5451
+  
5452
+ �
5453
+ �*
5454
+ name
5455
+ 
5456
+
5457
+ "
5458
+ scoresQ
5459
+ const
5460
+ var_434
5461
+  *
5462
+ name
5463
+ 
5464
+
5465
+ "
5466
+ op_434*
5467
+ val
5468
+  
5469
+
5470
+ 
5471
+ 
5472
+ ����
5473
+ select
5474
+ cond
5475
+
5476
+ 
5477
+ mask_3
5478
+ a
5479
+
5480
+ var_434
5481
+ b
5482
+
5483
+ 
5484
+ scores,
5485
+ input_97
5486
+  
5487
+ 
5488
+  
5489
+ �
5490
+ �*
5491
+ name
5492
+ 
5493
+ "
5494
+
5495
+ input_97~
5496
+ softmax
5497
+ x
5498
+
5499
+
5500
+ input_97
5501
+ axis
5502
+
5503
+ 
5504
+ var_17,
5505
+ input_99
5506
+  
5507
+ 
5508
+  
5509
+ �
5510
+ �*
5511
+ name
5512
+ 
5513
+ "
5514
+
5515
+ input_99_
5516
+ const
5517
+ x_transpose_x_0
5518
+ *%
5519
+ name
5520
+ 
5521
+ "
5522
+ x_transpose_x_0*
5523
+ val
5524
+ 
5525
+ 
5526
+ _
5527
+ const
5528
+ x_transpose_y_0
5529
+ *%
5530
+ name
5531
+ 
5532
+ "
5533
+ x_transpose_y_0*
5534
+ val
5535
+ 
5536
+ 
5537
+ �
5538
+ transpose
5539
+ x
5540
+
5541
+ var_424
5542
+ perm
5543
+
5544
+
5545
+ v_perm_0/
5546
+ transpose_33
5547
+  
5548
+ 
5549
+  
5550
+ �
5551
+ @*"
5552
+ name
5553
+ 
5554
+ "
5555
+ transpose_33�
5556
+ matmul
5557
+ x
5558
+
5559
+
5560
+ input_99
5561
+ y
5562
+ 
5563
+ transpose_33"
5564
+ transpose_x
5565
+ 
5566
+ x_transpose_x_0"
5567
+ transpose_y
5568
+ 
5569
+ x_transpose_y_0$
5570
+ x
5571
+  
5572
+ 
5573
+  
5574
+ �
5575
+ @*
5576
+ name
5577
+ 
5578
+ "
5579
+ xo
5580
+ const
5581
+ var_440_perm_0
5582
+
5583
+ 
5584
+ *#
5585
+ name
5586
+ 
5587
+ "
5588
+
5589
+ val
5590
+
5591
+ 
5592
+ 
5593
+
5594
+ 
5595
+ j
5596
+ const
5597
+ var_442
5598
+
5599
+ 
5600
+ *
5601
+ name
5602
+ 
5603
+
5604
+ "
5605
+ op_442**
5606
+ val#
5607
+
5608
+ 
5609
+ 
5610
+ 
5611
+
5612
+ transpose
5613
+
5614
+ x
5615
+ 
5616
+ x
5617
+ perm
5618
+ 
5619
+ var_440_perm_0/
5620
+ transpose_30
5621
+  
5622
+ 
5623
+ �
5624
+  
5625
+ @*"
5626
+ name
5627
+ 
5628
+ "
5629
+ transpose_30�
5630
+ reshape
5631
+ x
5632
+ 
5633
+ transpose_30
5634
+ shape
5635
+
5636
+ var_442'
5637
+ input_101
5638
+  
5639
+ 
5640
+ �
5641
+ �*
5642
+ name
5643
+ 
5644
+
5645
+ input_101�
5646
+ linear
5647
+ x
5648
+
5649
+ input_101@
5650
+ weight6
5651
+ 4
5652
+ 2model_transformer_layer_5_attention_out_lin_weight<
5653
+ bias4
5654
+ 2
5655
+ 0model_transformer_layer_5_attention_out_lin_bias'
5656
+ sa_output
5657
+  
5658
+ 
5659
+ �
5660
+ �*
5661
+ name
5662
+ 
5663
+
5664
+ sa_outputs
5665
+ add
5666
+ x
5667
+
5668
+ sa_output
5669
+ y
5670
+ 
5671
+ query'
5672
+ input_103
5673
+  
5674
+ 
5675
+ �
5676
+ �*
5677
+ name
5678
+ 
5679
+
5680
+ input_103z
5681
+ const
5682
+ input_105_axes_0
5683
+
5684
+ 
5685
+ *&
5686
+ name
5687
+ 
5688
+ "
5689
+ input_105_axes_0*'
5690
+ val 
5691
+
5692
+ 
5693
+ 
5694
+ 
5695
+
5696
+ ����������
5697
+
5698
+ layer_norm
5699
+ x
5700
+
5701
+ input_103
5702
+ axes
5703
+ 
5704
+ input_105_axes_0;
5705
+ gamma2
5706
+ 0
5707
+ .model_transformer_layer_5_sa_layer_norm_weight8
5708
+ beta0
5709
+ .
5710
+ ,model_transformer_layer_5_sa_layer_norm_bias
5711
+ epsilon
5712
+
5713
+ 
5714
+ var_19'
5715
+ input_105
5716
+  
5717
+ 
5718
+ �
5719
+ �*
5720
+ name
5721
+ 
5722
+
5723
+ input_105�
5724
+ linear
5725
+ x
5726
+
5727
+ input_1057
5728
+ weight-
5729
+ +
5730
+ )model_transformer_layer_5_ffn_lin1_weight3
5731
+ bias+
5732
+ )
5733
+ 'model_transformer_layer_5_ffn_lin1_bias'
5734
+ input_107
5735
+  
5736
+ 
5737
+ �
5738
+ �*
5739
+ name
5740
+ 
5741
+
5742
+ input_107e
5743
+ const
5744
+ input_109_mode_0
5745
+ *&
5746
+ name
5747
+ 
5748
+ "
5749
+ input_109_mode_0*
5750
+ val
5751
+ 
5752
+ "
5753
+ EXACT�
5754
+ gelu
5755
+ x
5756
+
5757
+ input_107
5758
+ mode
5759
+ 
5760
+ input_109_mode_0'
5761
+ input_109
5762
+  
5763
+ 
5764
+ �
5765
+ �*
5766
+ name
5767
+ 
5768
+
5769
+ input_109�
5770
+ linear
5771
+ x
5772
+
5773
+ input_1097
5774
+ weight-
5775
+ +
5776
+ )model_transformer_layer_5_ffn_lin2_weight3
5777
+ bias+
5778
+ )
5779
+ 'model_transformer_layer_5_ffn_lin2_bias'
5780
+ input_111
5781
+  
5782
+ 
5783
+ �
5784
+ �*
5785
+ name
5786
+ 
5787
+
5788
+ input_111o
5789
+ add
5790
+ x
5791
+
5792
+ input_111
5793
+ y
5794
+
5795
+ input_105#
5796
+ input
5797
+  
5798
+ 
5799
+ �
5800
+ �*
5801
+ name
5802
+ 
5803
+ "
5804
+ inputu
5805
+ const
5806
+ var_466_axes_0
5807
+
5808
+ 
5809
+ *#
5810
+ name
5811
+ 
5812
+ "
5813
+
5814
+ val 
5815
+
5816
+ 
5817
+ 
5818
+ 
5819
+
5820
+ ����������
5821
+
5822
+ layer_norm
5823
+ x
5824
+ 
5825
+ input
5826
+ axes
5827
+ 
5828
+ var_466_axes_0?
5829
+ gamma6
5830
+ 4
5831
+ 2model_transformer_layer_5_output_layer_norm_weight<
5832
+ beta4
5833
+ 2
5834
+ 0model_transformer_layer_5_output_layer_norm_bias
5835
+ epsilon
5836
+
5837
+ 
5838
+ var_19/
5839
+ last_hidden_state
5840
+  
5841
+ 
5842
+ �
5843
+ �*
5844
+ name
5845
+ 
5846
+
5847
+ "
5848
+ op_466"�
5849
+ buildInfo�"
5850
+ 
5851
+ 
5852
+ ~"|
5853
+ 8
5854
+ !
5855
+ 
5856
+ "
5857
+ coremltools-version
5858
+ 
5859
+ "
5860
+ 7.0b1
5861
+ @
5862
+ )
5863
+ !
5864
+ "
5865
+ coremltools-component-torch
5866
+ 
5867
+ "
5868
+ 2.0.1
coreml/feature-extraction/float32_model.mlpackage/Data/com.apple.CoreML/weights/weight.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03cdae2a47478e2d3276cbd98f9e68f884a5c542f870b56f4323b2239f6a4c16
3
+ size 264278336
coreml/feature-extraction/float32_model.mlpackage/Manifest.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "fileFormatVersion": "1.0.0",
3
+ "itemInfoEntries": {
4
+ "2F1D9872-397C-43DB-BB63-D6C4BDF0ED4A": {
5
+ "author": "com.apple.CoreML",
6
+ "description": "CoreML Model Specification",
7
+ "name": "model.mlmodel",
8
+ "path": "com.apple.CoreML/model.mlmodel"
9
+ },
10
+ "8872CE18-CE66-47A8-A0C0-D86C7E867BBA": {
11
+ "author": "com.apple.CoreML",
12
+ "description": "CoreML Model Weights",
13
+ "name": "weights",
14
+ "path": "com.apple.CoreML/weights"
15
+ }
16
+ },
17
+ "rootModelIdentifier": "2F1D9872-397C-43DB-BB63-D6C4BDF0ED4A"
18
+ }