File size: 108,004 Bytes
deef873
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
7767517
1424 1762
SherpaMetaData           sherpa_meta_data1        0 0 0=2 1=32 2=4 3=7 -23316=5,2,2,2,2,2 -23317=5,256,256,256,256,256 -23318=5,192,192,192,192,192 -23319=5,1,2,4,8,2 -23320=5,31,31,31,31,31
Input                    in0                      0 1 in0
Input                    in1                      0 1 in1
Split                    splitncnn_0              1 2 in1 2 3
Input                    in2                      0 1 in2
Split                    splitncnn_1              1 2 in2 5 6
Input                    in3                      0 1 in3
Split                    splitncnn_2              1 2 in3 8 9
Input                    in4                      0 1 in4
Split                    splitncnn_3              1 2 in4 11 12
Input                    in5                      0 1 in5
Split                    splitncnn_4              1 2 in5 14 15
Input                    in6                      0 1 in6
Split                    splitncnn_5              1 2 in6 17 18
Input                    in7                      0 1 in7
Split                    splitncnn_6              1 2 in7 20 21
Input                    in8                      0 1 in8
Split                    splitncnn_7              1 2 in8 23 24
Input                    in9                      0 1 in9
Split                    splitncnn_8              1 2 in9 26 27
Input                    in10                     0 1 in10
Split                    splitncnn_9              1 2 in10 29 30
Input                    in11                     0 1 in11
Split                    splitncnn_10             1 2 in11 32 33
Input                    in12                     0 1 in12
Split                    splitncnn_11             1 2 in12 35 36
Input                    in13                     0 1 in13
Split                    splitncnn_12             1 2 in13 38 39
Input                    in14                     0 1 in14
Split                    splitncnn_13             1 2 in14 41 42
Input                    in15                     0 1 in15
Split                    splitncnn_14             1 2 in15 44 45
Input                    in16                     0 1 in16
Split                    splitncnn_15             1 2 in16 47 48
Input                    in17                     0 1 in17
Split                    splitncnn_16             1 2 in17 50 51
Input                    in18                     0 1 in18
Split                    splitncnn_17             1 2 in18 53 54
Input                    in19                     0 1 in19
Split                    splitncnn_18             1 2 in19 56 57
Input                    in20                     0 1 in20
Split                    splitncnn_19             1 2 in20 59 60
Input                    in21                     0 1 in21
Split                    splitncnn_20             1 2 in21 62 63
Input                    in22                     0 1 in22
Split                    splitncnn_21             1 2 in22 65 66
Input                    in23                     0 1 in23
Split                    splitncnn_22             1 2 in23 68 69
Input                    in24                     0 1 in24
Split                    splitncnn_23             1 2 in24 71 72
Input                    in25                     0 1 in25
Split                    splitncnn_24             1 2 in25 74 75
Input                    in26                     0 1 in26
Split                    splitncnn_25             1 2 in26 77 78
Input                    in27                     0 1 in27
Split                    splitncnn_26             1 2 in27 80 81
Input                    in28                     0 1 in28
Split                    splitncnn_27             1 2 in28 83 84
Input                    in29                     0 1 in29
Split                    splitncnn_28             1 2 in29 86 87
Input                    in30                     0 1 in30
Split                    splitncnn_29             1 2 in30 89 90
Input                    in31                     0 1 in31
Split                    splitncnn_30             1 2 in31 92 93
Input                    in32                     0 1 in32
Split                    splitncnn_31             1 2 in32 95 96
Input                    in33                     0 1 in33
Split                    splitncnn_32             1 2 in33 98 99
Input                    in34                     0 1 in34
Split                    splitncnn_33             1 2 in34 101 102
Input                    in35                     0 1 in35
Split                    splitncnn_34             1 2 in35 104 105
MemoryData               encoders.4.encoder.layers.1 0 1 106 0=1
MemoryData               encoders.4.encoder.layers.0 0 1 107 0=1
MemoryData               encoders.4.encoder.encoder_pos 0 1 108 0=256 1=47 2=1
Split                    splitncnn_35             1 2 108 109 110
MemoryData               encoders.3.encoder.layers.1 0 1 111 0=1
MemoryData               encoders.3.encoder.layers.0 0 1 112 0=1
MemoryData               encoders.3.encoder.encoder_pos 0 1 113 0=256 1=11 2=1
Split                    splitncnn_36             1 2 113 114 115
MemoryData               encoders.2.encoder.layers.1 0 1 116 0=1
MemoryData               encoders.2.encoder.layers.0 0 1 117 0=1
MemoryData               encoders.2.encoder.encoder_pos 0 1 118 0=256 1=23 2=1
Split                    splitncnn_37             1 2 118 119 120
MemoryData               encoders.1.encoder.layers.1 0 1 121 0=1
MemoryData               encoders.1.encoder.layers.0 0 1 122 0=1
MemoryData               encoders.1.encoder.encoder_pos 0 1 123 0=256 1=47 2=1
Split                    splitncnn_38             1 2 123 124 125
MemoryData               encoders.0.layers.1      0 1 126 0=1
MemoryData               encoders.0.layers.0      0 1 127 0=1
MemoryData               encoders.0.encoder_pos   0 1 128 0=256 1=95 2=1
Split                    splitncnn_39             1 2 128 129 130
ExpandDims               unsqueeze_501            1 1 in0 131 -23303=1,0
Convolution              conv_128                 1 1 131 132 0=8 1=3 11=3 12=1 13=1 14=0 2=1 3=1 4=1 5=1 6=72
Split                    splitncnn_40             1 2 132 133 134
BinaryOp                 sub_0                    1 1 133 135 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_20               1 1 135 136
BinaryOp                 mul_1                    2 1 134 136 137 0=2
Convolution              conv_129                 1 1 137 138 0=32 1=3 11=3 12=1 13=2 14=0 2=1 3=2 4=0 5=1 6=2304
Split                    splitncnn_41             1 2 138 139 140
BinaryOp                 sub_2                    1 1 139 141 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_21               1 1 141 142
BinaryOp                 mul_3                    2 1 140 142 143 0=2
Convolution              conv_130                 1 1 143 144 0=128 1=3 11=3 12=1 13=1 14=0 2=1 3=2 4=0 5=1 6=36864
Split                    splitncnn_42             1 2 144 145 146
BinaryOp                 sub_4                    1 1 145 147 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_22               1 1 147 148
BinaryOp                 mul_5                    2 1 146 148 149 0=2
Crop                     crop_592                 1 1 78 150 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  encoders.0.state_select_list.0_ncnnreshape0 1 1 150 151 0=0 1=0
Crop                     crop_593                 1 1 93 152 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  pnnx_unique_10_ncnnreshape0 1 1 152 153 0=0 1=0
Permute                  permute_448              1 1 149 154 0=2
Reshape                  reshape_252              1 1 154 155 0=2432 1=-1
InnerProduct             linear_131               1 1 155 156 0=256 1=1 2=622592
Split                    splitncnn_43             1 4 156 157 158 159 160
InnerProduct             linear_132               1 1 160 161 0=768 1=1 2=196608
Split                    splitncnn_44             1 2 161 162 163
BinaryOp                 sub_6                    1 1 162 164 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_23               1 1 164 165
BinaryOp                 mul_7                    2 1 163 165 166 0=2
InnerProduct             linear_133               1 1 166 167 0=256 1=1 2=196608
BinaryOp                 add_8                    2 1 157 167 168 0=0
Split                    splitncnn_45             1 2 168 169 170
Crop                     select_0                 1 1 18 171 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_1                 1 1 3 172 -23310=1,1 -23311=1,0 -23309=1,0
PoolingModuleNoProj      pooling_modul_no_proj_502 3 3 170 172 171 173 174 175
InnerProduct             linear_134               1 1 173 176 0=256 1=0 2=65536
BinaryOp                 add_9                    2 1 169 176 177 0=0
Split                    splitncnn_46             1 2 177 178 179
Crop                     select_2                 1 1 33 180 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_3                 1 1 48 181 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_135               1 1 179 182 0=496 1=1 2=126976
Slice                    tensor_split_0           1 4 182 183 184 185 186 -23300=4,192,192,96,-233 1=1
Concat                   cat_0                    2 1 181 185 187 0=0
Split                    splitncnn_47             1 2 187 188 189
Reshape                  reshape_253              1 1 188 190 0=24 1=4 2=80
Reshape                  reshape_254              1 1 183 191 0=48 1=4 2=16
Reshape                  reshape_255              1 1 186 192 0=4 1=4 2=16
Concat                   cat_1                    2 1 180 184 193 0=0
Split                    splitncnn_48             1 2 193 194 195
Reshape                  reshape_256              1 1 194 196 0=48 1=4 2=80
InnerProduct             linear_136               1 1 130 197 0=16 1=0 2=4096
Reshape                  reshape_257              1 1 197 198 0=4 1=4 2=95
Permute                  permute_516              1 1 198 199 0=3
Permute                  permute_514              1 1 192 200 0=2
MatMul                   matmul_418               2 1 200 199 201
Permute                  permute_515              1 1 196 202 0=3
Permute                  permute_513              1 1 191 203 0=2
MatMul                   matmul_419               2 1 203 202 204
TensorAsStrided          tensor_as_strided_612    1 1 201 205 -23300=3,4,16,80 -23301=3,1520,94,1 2=15
BinaryOp                 add_10                   2 1 204 205 206 0=0
Reshape                  view_388                 1 1 206 207 0=80 1=16 2=4
Softmax                  softmax_73               1 1 207 208 0=-1 1=1
Split                    splitncnn_49             1 2 208 209 210
Permute                  permute_512              1 1 190 211 0=2
MatMul                   bmm_398                  2 1 210 211 212
Permute                  permute_517              1 1 212 213 0=2
Reshape                  reshape_258              1 1 213 214 0=96 1=16
InnerProduct             linear_137               1 1 214 215 0=256 1=1 2=24576
BinaryOp                 add_11                   2 1 178 215 216 0=0
Split                    splitncnn_50             1 2 216 217 218
Permute                  permute_450              1 1 218 219 0=1
Convolution1D            conv1d_88                1 1 219 220 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_0                    1 1 220 221 0=0
Concat                   cat_2                    2 1 151 221 222 0=1
Split                    splitncnn_51             1 2 222 223 224
ConvolutionDepthWise1D   convdw1d_631             1 1 224 225 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_52             1 2 225 226 227
BinaryOp                 sub_12                   1 1 226 228 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_24               1 1 228 229
BinaryOp                 mul_13                   2 1 227 229 230 0=2
Convolution1D            conv1d_89                1 1 230 231 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_451              1 1 231 232 0=1
BinaryOp                 add_14                   2 1 217 232 233 0=0
Split                    splitncnn_53             1 2 233 234 235
InnerProduct             linear_138               1 1 235 236 0=768 1=1 2=196608
Split                    splitncnn_54             1 2 236 237 238
BinaryOp                 sub_15                   1 1 237 239 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_25               1 1 239 240
BinaryOp                 mul_16                   2 1 238 240 241 0=2
InnerProduct             linear_139               1 1 241 242 0=256 1=1 2=196608
BinaryOp                 add_17                   2 1 234 242 243 0=0
Split                    splitncnn_55             1 2 243 244 245
Crop                     select_4                 1 1 63 246 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_140               1 1 245 247 0=96 1=0 2=24576
Concat                   cat_3                    2 1 246 247 248 0=0
Split                    splitncnn_56             1 2 248 249 250
Reshape                  reshape_259              1 1 249 251 0=24 1=4 2=80
Permute                  permute_518              1 1 251 252 0=2
MatMul                   bmm_399                  2 1 209 252 253
Permute                  permute_519              1 1 253 254 0=2
Reshape                  reshape_260              1 1 254 255 0=96 1=16
InnerProduct             linear_141               1 1 255 256 0=256 1=1 2=24576
BinaryOp                 add_18                   2 1 244 256 257 0=0
Split                    splitncnn_57             1 2 257 258 259
Permute                  permute_452              1 1 259 260 0=1
Convolution1D            conv1d_90                1 1 260 261 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_1                    1 1 261 262 0=0
Concat                   cat_4                    2 1 153 262 263 0=1
Split                    splitncnn_58             1 2 263 264 265
ConvolutionDepthWise1D   convdw1d_632             1 1 265 266 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_59             1 2 266 267 268
BinaryOp                 sub_19                   1 1 267 269 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_26               1 1 269 270
BinaryOp                 mul_20                   2 1 268 270 271 0=2
Convolution1D            conv1d_91                1 1 271 272 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_453              1 1 272 273 0=1
BinaryOp                 add_21                   2 1 258 273 274 0=0
Split                    splitncnn_60             1 2 274 275 276
InnerProduct             linear_142               1 1 276 277 0=768 1=1 2=196608
Split                    splitncnn_61             1 2 277 278 279
BinaryOp                 sub_22                   1 1 278 280 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_27               1 1 280 281
BinaryOp                 mul_23                   2 1 279 281 282 0=2
InnerProduct             linear_143               1 1 282 283 0=256 1=1 2=196608
BinaryOp                 add_24                   2 1 275 283 284 0=0
Split                    splitncnn_62             1 3 284 285 286 287
BinaryOp                 mul_25                   2 1 285 286 288 0=2
Reduction                mean_438                 1 1 288 289 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_26                   1 1 289 290 0=0 1=1 2=6.432362e+00
BinaryOp                 pow_27                   1 1 290 291 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_28                   2 1 287 291 292 0=2
BinaryOp                 sub_29                   2 1 292 158 293 0=1
BinaryOp                 mul_30                   2 1 293 127 294 0=2
BinaryOp                 add_31                   2 1 159 294 295 0=0
Split                    splitncnn_63             1 4 295 296 297 298 299
Crop                     crop_594                 1 1 77 300 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  encoders.0.state_select_list.1_ncnnreshape0 1 1 300 301 0=0 1=0
Crop                     crop_595                 1 1 92 302 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  pnnx_unique_17_ncnnreshape0 1 1 302 303 0=0 1=0
InnerProduct             linear_144               1 1 299 304 0=768 1=1 2=196608
Split                    splitncnn_64             1 2 304 305 306
BinaryOp                 sub_32                   1 1 305 307 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_28               1 1 307 308
BinaryOp                 mul_33                   2 1 306 308 309 0=2
InnerProduct             linear_145               1 1 309 310 0=256 1=1 2=196608
BinaryOp                 add_34                   2 1 296 310 311 0=0
Split                    splitncnn_65             1 2 311 312 313
Crop                     select_5                 1 1 17 314 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_6                 1 1 2 315 -23310=1,2 -23311=1,0 -23309=1,1
PoolingModuleNoProj      pooling_modul_no_proj_503 3 3 313 315 314 316 317 318
InnerProduct             linear_146               1 1 316 319 0=256 1=0 2=65536
BinaryOp                 add_35                   2 1 312 319 320 0=0
Split                    splitncnn_66             1 2 320 321 322
Crop                     select_7                 1 1 32 323 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_8                 1 1 47 324 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_147               1 1 322 325 0=496 1=1 2=126976
Slice                    tensor_split_1           1 4 325 326 327 328 329 -23300=4,192,192,96,-233 1=1
Concat                   cat_5                    2 1 324 328 330 0=0
Split                    splitncnn_67             1 2 330 331 332
Reshape                  reshape_261              1 1 331 333 0=24 1=4 2=80
Reshape                  reshape_262              1 1 326 334 0=48 1=4 2=16
Reshape                  reshape_263              1 1 329 335 0=4 1=4 2=16
Concat                   cat_6                    2 1 323 327 336 0=0
Split                    splitncnn_68             1 2 336 337 338
Reshape                  reshape_264              1 1 337 339 0=48 1=4 2=80
InnerProduct             linear_148               1 1 129 340 0=16 1=0 2=4096
Reshape                  reshape_265              1 1 340 341 0=4 1=4 2=95
Permute                  permute_524              1 1 341 342 0=3
Permute                  permute_522              1 1 335 343 0=2
MatMul                   matmul_420               2 1 343 342 344
Permute                  permute_523              1 1 339 345 0=3
Permute                  permute_521              1 1 334 346 0=2
MatMul                   matmul_421               2 1 346 345 347
TensorAsStrided          tensor_as_strided_613    1 1 344 348 -23300=3,4,16,80 -23301=3,1520,94,1 2=15
BinaryOp                 add_36                   2 1 347 348 349 0=0
Reshape                  view_389                 1 1 349 350 0=80 1=16 2=4
Softmax                  softmax_74               1 1 350 351 0=-1 1=1
Split                    splitncnn_69             1 2 351 352 353
Permute                  permute_520              1 1 333 354 0=2
MatMul                   bmm_400                  2 1 353 354 355
Permute                  permute_525              1 1 355 356 0=2
Reshape                  reshape_266              1 1 356 357 0=96 1=16
InnerProduct             linear_149               1 1 357 358 0=256 1=1 2=24576
BinaryOp                 add_37                   2 1 321 358 359 0=0
Split                    splitncnn_70             1 2 359 360 361
Permute                  permute_454              1 1 361 362 0=1
Convolution1D            conv1d_92                1 1 362 363 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_2                    1 1 363 364 0=0
Concat                   cat_7                    2 1 301 364 365 0=1
Split                    splitncnn_71             1 2 365 366 367
ConvolutionDepthWise1D   convdw1d_633             1 1 367 368 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_72             1 2 368 369 370
BinaryOp                 sub_38                   1 1 369 371 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_29               1 1 371 372
BinaryOp                 mul_39                   2 1 370 372 373 0=2
Convolution1D            conv1d_93                1 1 373 374 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_455              1 1 374 375 0=1
BinaryOp                 add_40                   2 1 360 375 376 0=0
Split                    splitncnn_73             1 2 376 377 378
InnerProduct             linear_150               1 1 378 379 0=768 1=1 2=196608
Split                    splitncnn_74             1 2 379 380 381
BinaryOp                 sub_41                   1 1 380 382 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_30               1 1 382 383
BinaryOp                 mul_42                   2 1 381 383 384 0=2
InnerProduct             linear_151               1 1 384 385 0=256 1=1 2=196608
BinaryOp                 add_43                   2 1 377 385 386 0=0
Split                    splitncnn_75             1 2 386 387 388
Crop                     select_9                 1 1 62 389 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_152               1 1 388 390 0=96 1=0 2=24576
Concat                   cat_8                    2 1 389 390 391 0=0
Split                    splitncnn_76             1 2 391 392 393
Reshape                  reshape_267              1 1 392 394 0=24 1=4 2=80
Permute                  permute_526              1 1 394 395 0=2
MatMul                   bmm_401                  2 1 352 395 396
Permute                  permute_527              1 1 396 397 0=2
Reshape                  reshape_268              1 1 397 398 0=96 1=16
InnerProduct             linear_153               1 1 398 399 0=256 1=1 2=24576
BinaryOp                 add_44                   2 1 387 399 400 0=0
Split                    splitncnn_77             1 2 400 401 402
Permute                  permute_456              1 1 402 403 0=1
Convolution1D            conv1d_94                1 1 403 404 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_3                    1 1 404 405 0=0
Concat                   cat_9                    2 1 303 405 406 0=1
Split                    splitncnn_78             1 2 406 407 408
ConvolutionDepthWise1D   convdw1d_634             1 1 408 409 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_79             1 2 409 410 411
BinaryOp                 sub_45                   1 1 410 412 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_31               1 1 412 413
BinaryOp                 mul_46                   2 1 411 413 414 0=2
Convolution1D            conv1d_95                1 1 414 415 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_457              1 1 415 416 0=1
BinaryOp                 add_47                   2 1 401 416 417 0=0
Split                    splitncnn_80             1 2 417 418 419
InnerProduct             linear_154               1 1 419 420 0=768 1=1 2=196608
Split                    splitncnn_81             1 2 420 421 422
BinaryOp                 sub_48                   1 1 421 423 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_32               1 1 423 424
BinaryOp                 mul_49                   2 1 422 424 425 0=2
InnerProduct             linear_155               1 1 425 426 0=256 1=1 2=196608
BinaryOp                 add_50                   2 1 418 426 427 0=0
Split                    splitncnn_82             1 3 427 428 429 430
BinaryOp                 mul_51                   2 1 428 429 431 0=2
Reduction                mean_439                 1 1 431 432 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_52                   1 1 432 433 0=0 1=1 2=8.898914e+00
BinaryOp                 pow_53                   1 1 433 434 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_54                   2 1 430 434 435 0=2
BinaryOp                 sub_55                   2 1 435 297 436 0=1
BinaryOp                 mul_56                   2 1 436 126 437 0=2
BinaryOp                 add_57                   2 1 298 437 438 0=0
Split                    splitncnn_83             1 2 438 439 440
MemoryData               encoders.1.downsample    0 1 441 0=256 1=1 2=1
Reshape                  reshape_269              1 1 440 442 0=256 1=2 2=8
Split                    splitncnn_84             1 2 442 443 444
BinaryOp                 mul_58                   2 1 443 441 445 0=2
Reduction                sum_491                  1 1 445 446 0=0 1=0 -23303=1,-1 4=1 5=1
Softmax                  softmax_75               1 1 446 447 0=1 1=1
BinaryOp                 mul_59                   2 1 444 447 448 0=2
Reduction                sum_492                  1 1 448 449 0=0 1=0 -23303=1,1 4=0 5=1
Crop                     crop_596                 1 1 81 450 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  encoders.1.encoder.state_select_list.0_ncnnreshape0 1 1 450 451 0=0 1=0
Crop                     crop_597                 1 1 96 452 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  pnnx_unique_25_ncnnreshape0 1 1 452 453 0=0 1=0
Split                    splitncnn_85             1 4 449 454 455 456 457
InnerProduct             linear_156               1 1 457 458 0=768 1=1 2=196608
Split                    splitncnn_86             1 2 458 459 460
BinaryOp                 sub_60                   1 1 459 461 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_33               1 1 461 462
BinaryOp                 mul_61                   2 1 460 462 463 0=2
InnerProduct             linear_157               1 1 463 464 0=256 1=1 2=196608
BinaryOp                 add_62                   2 1 454 464 465 0=0
Split                    splitncnn_87             1 2 465 466 467
Crop                     select_10                1 1 21 468 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_11                1 1 6 469 -23310=1,1 -23311=1,0 -23309=1,0
PoolingModuleNoProj      pooling_modul_no_proj_504 3 3 467 469 468 470 471 472
InnerProduct             linear_158               1 1 470 473 0=256 1=0 2=65536
BinaryOp                 add_63                   2 1 466 473 474 0=0
Split                    splitncnn_88             1 2 474 475 476
Crop                     select_12                1 1 36 477 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_13                1 1 51 478 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_159               1 1 476 479 0=496 1=1 2=126976
Slice                    tensor_split_2           1 4 479 480 481 482 483 -23300=4,192,192,96,-233 1=1
Concat                   cat_10                   2 1 478 482 484 0=0
Split                    splitncnn_89             1 2 484 485 486
Reshape                  reshape_270              1 1 485 487 0=24 1=4 2=40
Reshape                  reshape_271              1 1 480 488 0=48 1=4 2=8
Reshape                  reshape_272              1 1 483 489 0=4 1=4 2=8
Concat                   cat_11                   2 1 477 481 490 0=0
Split                    splitncnn_90             1 2 490 491 492
Reshape                  reshape_273              1 1 491 493 0=48 1=4 2=40
InnerProduct             linear_160               1 1 125 494 0=16 1=0 2=4096
Reshape                  reshape_274              1 1 494 495 0=4 1=4 2=47
Permute                  permute_532              1 1 495 496 0=3
Permute                  permute_530              1 1 489 497 0=2
MatMul                   matmul_422               2 1 497 496 498
Permute                  permute_531              1 1 493 499 0=3
Permute                  permute_529              1 1 488 500 0=2
MatMul                   matmul_423               2 1 500 499 501
TensorAsStrided          tensor_as_strided_614    1 1 498 502 -23300=3,4,8,40 -23301=3,376,46,1 2=7
BinaryOp                 add_64                   2 1 501 502 503 0=0
Reshape                  view_390                 1 1 503 504 0=40 1=8 2=4
Softmax                  softmax_76               1 1 504 505 0=-1 1=1
Split                    splitncnn_91             1 2 505 506 507
Permute                  permute_528              1 1 487 508 0=2
MatMul                   bmm_402                  2 1 507 508 509
Permute                  permute_533              1 1 509 510 0=2
Reshape                  reshape_275              1 1 510 511 0=96 1=8
InnerProduct             linear_161               1 1 511 512 0=256 1=1 2=24576
BinaryOp                 add_65                   2 1 475 512 513 0=0
Split                    splitncnn_92             1 2 513 514 515
Permute                  permute_458              1 1 515 516 0=1
Convolution1D            conv1d_96                1 1 516 517 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_4                    1 1 517 518 0=0
Concat                   cat_12                   2 1 451 518 519 0=1
Split                    splitncnn_93             1 2 519 520 521
ConvolutionDepthWise1D   convdw1d_635             1 1 521 522 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_94             1 2 522 523 524
BinaryOp                 sub_66                   1 1 523 525 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_34               1 1 525 526
BinaryOp                 mul_67                   2 1 524 526 527 0=2
Convolution1D            conv1d_97                1 1 527 528 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_459              1 1 528 529 0=1
BinaryOp                 add_68                   2 1 514 529 530 0=0
Split                    splitncnn_95             1 2 530 531 532
InnerProduct             linear_162               1 1 532 533 0=768 1=1 2=196608
Split                    splitncnn_96             1 2 533 534 535
BinaryOp                 sub_69                   1 1 534 536 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_35               1 1 536 537
BinaryOp                 mul_70                   2 1 535 537 538 0=2
InnerProduct             linear_163               1 1 538 539 0=256 1=1 2=196608
BinaryOp                 add_71                   2 1 531 539 540 0=0
Split                    splitncnn_97             1 2 540 541 542
Crop                     select_14                1 1 66 543 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_164               1 1 542 544 0=96 1=0 2=24576
Concat                   cat_13                   2 1 543 544 545 0=0
Split                    splitncnn_98             1 2 545 546 547
Reshape                  reshape_276              1 1 546 548 0=24 1=4 2=40
Permute                  permute_534              1 1 548 549 0=2
MatMul                   bmm_403                  2 1 506 549 550
Permute                  permute_535              1 1 550 551 0=2
Reshape                  reshape_277              1 1 551 552 0=96 1=8
InnerProduct             linear_165               1 1 552 553 0=256 1=1 2=24576
BinaryOp                 add_72                   2 1 541 553 554 0=0
Split                    splitncnn_99             1 2 554 555 556
Permute                  permute_460              1 1 556 557 0=1
Convolution1D            conv1d_98                1 1 557 558 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_5                    1 1 558 559 0=0
Concat                   cat_14                   2 1 453 559 560 0=1
Split                    splitncnn_100            1 2 560 561 562
ConvolutionDepthWise1D   convdw1d_636             1 1 562 563 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_101            1 2 563 564 565
BinaryOp                 sub_73                   1 1 564 566 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_36               1 1 566 567
BinaryOp                 mul_74                   2 1 565 567 568 0=2
Convolution1D            conv1d_99                1 1 568 569 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_461              1 1 569 570 0=1
BinaryOp                 add_75                   2 1 555 570 571 0=0
Split                    splitncnn_102            1 2 571 572 573
InnerProduct             linear_166               1 1 573 574 0=768 1=1 2=196608
Split                    splitncnn_103            1 2 574 575 576
BinaryOp                 sub_76                   1 1 575 577 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_37               1 1 577 578
BinaryOp                 mul_77                   2 1 576 578 579 0=2
InnerProduct             linear_167               1 1 579 580 0=256 1=1 2=196608
BinaryOp                 add_78                   2 1 572 580 581 0=0
Split                    splitncnn_104            1 3 581 582 583 584
BinaryOp                 mul_79                   2 1 582 583 585 0=2
Reduction                mean_440                 1 1 585 586 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_80                   1 1 586 587 0=0 1=1 2=5.620271e+00
BinaryOp                 pow_81                   1 1 587 588 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_82                   2 1 584 588 589 0=2
BinaryOp                 sub_83                   2 1 589 455 590 0=1
BinaryOp                 mul_84                   2 1 590 122 591 0=2
BinaryOp                 add_85                   2 1 456 591 592 0=0
Split                    splitncnn_105            1 4 592 593 594 595 596
Crop                     crop_598                 1 1 80 597 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  encoders.1.encoder.state_select_list.1_ncnnreshape0 1 1 597 598 0=0 1=0
Crop                     crop_599                 1 1 95 599 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  pnnx_unique_33_ncnnreshape0 1 1 599 600 0=0 1=0
InnerProduct             linear_168               1 1 596 601 0=768 1=1 2=196608
Split                    splitncnn_106            1 2 601 602 603
BinaryOp                 sub_86                   1 1 602 604 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_38               1 1 604 605
BinaryOp                 mul_87                   2 1 603 605 606 0=2
InnerProduct             linear_169               1 1 606 607 0=256 1=1 2=196608
BinaryOp                 add_88                   2 1 593 607 608 0=0
Split                    splitncnn_107            1 2 608 609 610
Crop                     select_15                1 1 20 611 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_16                1 1 5 612 -23310=1,2 -23311=1,0 -23309=1,1
PoolingModuleNoProj      pooling_modul_no_proj_505 3 3 610 612 611 613 614 615
InnerProduct             linear_170               1 1 613 616 0=256 1=0 2=65536
BinaryOp                 add_89                   2 1 609 616 617 0=0
Split                    splitncnn_108            1 2 617 618 619
Crop                     select_17                1 1 35 620 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_18                1 1 50 621 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_171               1 1 619 622 0=496 1=1 2=126976
Slice                    tensor_split_3           1 4 622 623 624 625 626 -23300=4,192,192,96,-233 1=1
Concat                   cat_15                   2 1 621 625 627 0=0
Split                    splitncnn_109            1 2 627 628 629
Reshape                  reshape_278              1 1 628 630 0=24 1=4 2=40
Reshape                  reshape_279              1 1 623 631 0=48 1=4 2=8
Reshape                  reshape_280              1 1 626 632 0=4 1=4 2=8
Concat                   cat_16                   2 1 620 624 633 0=0
Split                    splitncnn_110            1 2 633 634 635
Reshape                  reshape_281              1 1 634 636 0=48 1=4 2=40
InnerProduct             linear_172               1 1 124 637 0=16 1=0 2=4096
Reshape                  reshape_282              1 1 637 638 0=4 1=4 2=47
Permute                  permute_540              1 1 638 639 0=3
Permute                  permute_538              1 1 632 640 0=2
MatMul                   matmul_424               2 1 640 639 641
Permute                  permute_539              1 1 636 642 0=3
Permute                  permute_537              1 1 631 643 0=2
MatMul                   matmul_425               2 1 643 642 644
TensorAsStrided          tensor_as_strided_615    1 1 641 645 -23300=3,4,8,40 -23301=3,376,46,1 2=7
BinaryOp                 add_90                   2 1 644 645 646 0=0
Reshape                  view_391                 1 1 646 647 0=40 1=8 2=4
Softmax                  softmax_77               1 1 647 648 0=-1 1=1
Split                    splitncnn_111            1 2 648 649 650
Permute                  permute_536              1 1 630 651 0=2
MatMul                   bmm_404                  2 1 650 651 652
Permute                  permute_541              1 1 652 653 0=2
Reshape                  reshape_283              1 1 653 654 0=96 1=8
InnerProduct             linear_173               1 1 654 655 0=256 1=1 2=24576
BinaryOp                 add_91                   2 1 618 655 656 0=0
Split                    splitncnn_112            1 2 656 657 658
Permute                  permute_462              1 1 658 659 0=1
Convolution1D            conv1d_100               1 1 659 660 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_6                    1 1 660 661 0=0
Concat                   cat_17                   2 1 598 661 662 0=1
Split                    splitncnn_113            1 2 662 663 664
ConvolutionDepthWise1D   convdw1d_637             1 1 664 665 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_114            1 2 665 666 667
BinaryOp                 sub_92                   1 1 666 668 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_39               1 1 668 669
BinaryOp                 mul_93                   2 1 667 669 670 0=2
Convolution1D            conv1d_101               1 1 670 671 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_463              1 1 671 672 0=1
BinaryOp                 add_94                   2 1 657 672 673 0=0
Split                    splitncnn_115            1 2 673 674 675
InnerProduct             linear_174               1 1 675 676 0=768 1=1 2=196608
Split                    splitncnn_116            1 2 676 677 678
BinaryOp                 sub_95                   1 1 677 679 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_40               1 1 679 680
BinaryOp                 mul_96                   2 1 678 680 681 0=2
InnerProduct             linear_175               1 1 681 682 0=256 1=1 2=196608
BinaryOp                 add_97                   2 1 674 682 683 0=0
Split                    splitncnn_117            1 2 683 684 685
Crop                     select_19                1 1 65 686 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_176               1 1 685 687 0=96 1=0 2=24576
Concat                   cat_18                   2 1 686 687 688 0=0
Split                    splitncnn_118            1 2 688 689 690
Reshape                  reshape_284              1 1 689 691 0=24 1=4 2=40
Permute                  permute_542              1 1 691 692 0=2
MatMul                   bmm_405                  2 1 649 692 693
Permute                  permute_543              1 1 693 694 0=2
Reshape                  reshape_285              1 1 694 695 0=96 1=8
InnerProduct             linear_177               1 1 695 696 0=256 1=1 2=24576
BinaryOp                 add_98                   2 1 684 696 697 0=0
Split                    splitncnn_119            1 2 697 698 699
Permute                  permute_464              1 1 699 700 0=1
Convolution1D            conv1d_102               1 1 700 701 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_7                    1 1 701 702 0=0
Concat                   cat_19                   2 1 600 702 703 0=1
Split                    splitncnn_120            1 2 703 704 705
ConvolutionDepthWise1D   convdw1d_638             1 1 705 706 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_121            1 2 706 707 708
BinaryOp                 sub_99                   1 1 707 709 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_41               1 1 709 710
BinaryOp                 mul_100                  2 1 708 710 711 0=2
Convolution1D            conv1d_103               1 1 711 712 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_465              1 1 712 713 0=1
BinaryOp                 add_101                  2 1 698 713 714 0=0
Split                    splitncnn_122            1 2 714 715 716
InnerProduct             linear_178               1 1 716 717 0=768 1=1 2=196608
Split                    splitncnn_123            1 2 717 718 719
BinaryOp                 sub_102                  1 1 718 720 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_42               1 1 720 721
BinaryOp                 mul_103                  2 1 719 721 722 0=2
InnerProduct             linear_179               1 1 722 723 0=256 1=1 2=196608
BinaryOp                 add_104                  2 1 715 723 724 0=0
Split                    splitncnn_124            1 3 724 725 726 727
BinaryOp                 mul_105                  2 1 725 726 728 0=2
Reduction                mean_441                 1 1 728 729 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_106                  1 1 729 730 0=0 1=1 2=1.053647e+01
BinaryOp                 pow_107                  1 1 730 731 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_108                  2 1 727 731 732 0=2
BinaryOp                 sub_109                  2 1 732 594 733 0=1
BinaryOp                 mul_110                  2 1 733 121 734 0=2
BinaryOp                 add_111                  2 1 595 734 735 0=0
MemoryData               encoders.1.out_combiner  0 1 736 0=1
Split                    splitncnn_125            1 2 736 737 738
BinaryOp                 sub_112                  1 1 737 739 0=7 1=1 2=1.000000e+00
SimpleUpsample           simple_upsample_627      1 1 735 740 0=2 1=256 2=512
BinaryOp                 mul_113                  2 1 740 739 741 0=2
BinaryOp                 mul_114                  2 1 439 738 742 0=2
BinaryOp                 add_115                  2 1 742 741 743 0=0
Split                    splitncnn_126            1 3 743 744 745 746
MemoryData               encoders.2.downsample    0 1 747 0=256 1=1 2=1
Reshape                  reshape_286              1 1 746 748 0=256 1=4 2=4
Split                    splitncnn_127            1 2 748 749 750
BinaryOp                 mul_116                  2 1 749 747 751 0=2
Reduction                sum_493                  1 1 751 752 0=0 1=0 -23303=1,-1 4=1 5=1
Softmax                  softmax_78               1 1 752 753 0=1 1=1
BinaryOp                 mul_117                  2 1 750 753 754 0=2
Reduction                sum_494                  1 1 754 755 0=0 1=0 -23303=1,1 4=0 5=1
Crop                     crop_600                 1 1 84 756 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  encoders.2.encoder.state_select_list.0_ncnnreshape0 1 1 756 757 0=0 1=0
Crop                     crop_601                 1 1 99 758 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  pnnx_unique_42_ncnnreshape0 1 1 758 759 0=0 1=0
Split                    splitncnn_128            1 4 755 760 761 762 763
InnerProduct             linear_180               1 1 763 764 0=768 1=1 2=196608
Split                    splitncnn_129            1 2 764 765 766
BinaryOp                 sub_118                  1 1 765 767 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_43               1 1 767 768
BinaryOp                 mul_119                  2 1 766 768 769 0=2
InnerProduct             linear_181               1 1 769 770 0=256 1=1 2=196608
BinaryOp                 add_120                  2 1 760 770 771 0=0
Split                    splitncnn_130            1 2 771 772 773
Crop                     select_20                1 1 24 774 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_21                1 1 9 775 -23310=1,1 -23311=1,0 -23309=1,0
PoolingModuleNoProj      pooling_modul_no_proj_506 3 3 773 775 774 776 777 778
InnerProduct             linear_182               1 1 776 779 0=256 1=0 2=65536
BinaryOp                 add_121                  2 1 772 779 780 0=0
Split                    splitncnn_131            1 2 780 781 782
Crop                     select_22                1 1 39 783 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_23                1 1 54 784 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_183               1 1 782 785 0=496 1=1 2=126976
Slice                    tensor_split_4           1 4 785 786 787 788 789 -23300=4,192,192,96,-233 1=1
Concat                   cat_20                   2 1 784 788 790 0=0
Split                    splitncnn_132            1 2 790 791 792
Reshape                  reshape_287              1 1 791 793 0=24 1=4 2=20
Reshape                  reshape_288              1 1 786 794 0=48 1=4 2=4
Reshape                  reshape_289              1 1 789 795 0=4 1=4 2=4
Concat                   cat_21                   2 1 783 787 796 0=0
Split                    splitncnn_133            1 2 796 797 798
Reshape                  reshape_290              1 1 797 799 0=48 1=4 2=20
InnerProduct             linear_184               1 1 120 800 0=16 1=0 2=4096
Reshape                  reshape_291              1 1 800 801 0=4 1=4 2=23
Permute                  permute_548              1 1 801 802 0=3
Permute                  permute_546              1 1 795 803 0=2
MatMul                   matmul_426               2 1 803 802 804
Permute                  permute_547              1 1 799 805 0=3
Permute                  permute_545              1 1 794 806 0=2
MatMul                   matmul_427               2 1 806 805 807
TensorAsStrided          tensor_as_strided_616    1 1 804 808 -23300=3,4,4,20 -23301=3,92,22,1 2=3
BinaryOp                 add_122                  2 1 807 808 809 0=0
Reshape                  view_392                 1 1 809 810 0=20 1=4 2=4
Softmax                  softmax_79               1 1 810 811 0=-1 1=1
Split                    splitncnn_134            1 2 811 812 813
Permute                  permute_544              1 1 793 814 0=2
MatMul                   bmm_406                  2 1 813 814 815
Permute                  permute_549              1 1 815 816 0=2
Reshape                  reshape_292              1 1 816 817 0=96 1=4
InnerProduct             linear_185               1 1 817 818 0=256 1=1 2=24576
BinaryOp                 add_123                  2 1 781 818 819 0=0
Split                    splitncnn_135            1 2 819 820 821
Permute                  permute_466              1 1 821 822 0=1
Convolution1D            conv1d_104               1 1 822 823 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_8                    1 1 823 824 0=0
Concat                   cat_22                   2 1 757 824 825 0=1
Split                    splitncnn_136            1 2 825 826 827
ConvolutionDepthWise1D   convdw1d_639             1 1 827 828 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_137            1 2 828 829 830
BinaryOp                 sub_124                  1 1 829 831 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_44               1 1 831 832
BinaryOp                 mul_125                  2 1 830 832 833 0=2
Convolution1D            conv1d_105               1 1 833 834 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_467              1 1 834 835 0=1
BinaryOp                 add_126                  2 1 820 835 836 0=0
Split                    splitncnn_138            1 2 836 837 838
InnerProduct             linear_186               1 1 838 839 0=768 1=1 2=196608
Split                    splitncnn_139            1 2 839 840 841
BinaryOp                 sub_127                  1 1 840 842 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_45               1 1 842 843
BinaryOp                 mul_128                  2 1 841 843 844 0=2
InnerProduct             linear_187               1 1 844 845 0=256 1=1 2=196608
BinaryOp                 add_129                  2 1 837 845 846 0=0
Split                    splitncnn_140            1 2 846 847 848
Crop                     select_24                1 1 69 849 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_188               1 1 848 850 0=96 1=0 2=24576
Concat                   cat_23                   2 1 849 850 851 0=0
Split                    splitncnn_141            1 2 851 852 853
Reshape                  reshape_293              1 1 852 854 0=24 1=4 2=20
Permute                  permute_550              1 1 854 855 0=2
MatMul                   bmm_407                  2 1 812 855 856
Permute                  permute_551              1 1 856 857 0=2
Reshape                  reshape_294              1 1 857 858 0=96 1=4
InnerProduct             linear_189               1 1 858 859 0=256 1=1 2=24576
BinaryOp                 add_130                  2 1 847 859 860 0=0
Split                    splitncnn_142            1 2 860 861 862
Permute                  permute_468              1 1 862 863 0=1
Convolution1D            conv1d_106               1 1 863 864 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_9                    1 1 864 865 0=0
Concat                   cat_24                   2 1 759 865 866 0=1
Split                    splitncnn_143            1 2 866 867 868
ConvolutionDepthWise1D   convdw1d_640             1 1 868 869 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_144            1 2 869 870 871
BinaryOp                 sub_131                  1 1 870 872 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_46               1 1 872 873
BinaryOp                 mul_132                  2 1 871 873 874 0=2
Convolution1D            conv1d_107               1 1 874 875 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_469              1 1 875 876 0=1
BinaryOp                 add_133                  2 1 861 876 877 0=0
Split                    splitncnn_145            1 2 877 878 879
InnerProduct             linear_190               1 1 879 880 0=768 1=1 2=196608
Split                    splitncnn_146            1 2 880 881 882
BinaryOp                 sub_134                  1 1 881 883 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_47               1 1 883 884
BinaryOp                 mul_135                  2 1 882 884 885 0=2
InnerProduct             linear_191               1 1 885 886 0=256 1=1 2=196608
BinaryOp                 add_136                  2 1 878 886 887 0=0
Split                    splitncnn_147            1 3 887 888 889 890
BinaryOp                 mul_137                  2 1 888 889 891 0=2
Reduction                mean_442                 1 1 891 892 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_138                  1 1 892 893 0=0 1=1 2=3.654023e+00
BinaryOp                 pow_139                  1 1 893 894 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_140                  2 1 890 894 895 0=2
BinaryOp                 sub_141                  2 1 895 761 896 0=1
BinaryOp                 mul_142                  2 1 896 117 897 0=2
BinaryOp                 add_143                  2 1 762 897 898 0=0
Split                    splitncnn_148            1 4 898 899 900 901 902
Crop                     crop_602                 1 1 83 903 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  encoders.2.encoder.state_select_list.1_ncnnreshape0 1 1 903 904 0=0 1=0
Crop                     crop_603                 1 1 98 905 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  pnnx_unique_50_ncnnreshape0 1 1 905 906 0=0 1=0
InnerProduct             linear_192               1 1 902 907 0=768 1=1 2=196608
Split                    splitncnn_149            1 2 907 908 909
BinaryOp                 sub_144                  1 1 908 910 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_48               1 1 910 911
BinaryOp                 mul_145                  2 1 909 911 912 0=2
InnerProduct             linear_193               1 1 912 913 0=256 1=1 2=196608
BinaryOp                 add_146                  2 1 899 913 914 0=0
Split                    splitncnn_150            1 2 914 915 916
Crop                     select_25                1 1 23 917 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_26                1 1 8 918 -23310=1,2 -23311=1,0 -23309=1,1
PoolingModuleNoProj      pooling_modul_no_proj_507 3 3 916 918 917 919 920 921
InnerProduct             linear_194               1 1 919 922 0=256 1=0 2=65536
BinaryOp                 add_147                  2 1 915 922 923 0=0
Split                    splitncnn_151            1 2 923 924 925
Crop                     select_27                1 1 38 926 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_28                1 1 53 927 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_195               1 1 925 928 0=496 1=1 2=126976
Slice                    tensor_split_5           1 4 928 929 930 931 932 -23300=4,192,192,96,-233 1=1
Concat                   cat_25                   2 1 927 931 933 0=0
Split                    splitncnn_152            1 2 933 934 935
Reshape                  reshape_295              1 1 934 936 0=24 1=4 2=20
Reshape                  reshape_296              1 1 929 937 0=48 1=4 2=4
Reshape                  reshape_297              1 1 932 938 0=4 1=4 2=4
Concat                   cat_26                   2 1 926 930 939 0=0
Split                    splitncnn_153            1 2 939 940 941
Reshape                  reshape_298              1 1 940 942 0=48 1=4 2=20
InnerProduct             linear_196               1 1 119 943 0=16 1=0 2=4096
Reshape                  reshape_299              1 1 943 944 0=4 1=4 2=23
Permute                  permute_556              1 1 944 945 0=3
Permute                  permute_554              1 1 938 946 0=2
MatMul                   matmul_428               2 1 946 945 947
Permute                  permute_555              1 1 942 948 0=3
Permute                  permute_553              1 1 937 949 0=2
MatMul                   matmul_429               2 1 949 948 950
TensorAsStrided          tensor_as_strided_617    1 1 947 951 -23300=3,4,4,20 -23301=3,92,22,1 2=3
BinaryOp                 add_148                  2 1 950 951 952 0=0
Reshape                  view_393                 1 1 952 953 0=20 1=4 2=4
Softmax                  softmax_80               1 1 953 954 0=-1 1=1
Split                    splitncnn_154            1 2 954 955 956
Permute                  permute_552              1 1 936 957 0=2
MatMul                   bmm_408                  2 1 956 957 958
Permute                  permute_557              1 1 958 959 0=2
Reshape                  reshape_300              1 1 959 960 0=96 1=4
InnerProduct             linear_197               1 1 960 961 0=256 1=1 2=24576
BinaryOp                 add_149                  2 1 924 961 962 0=0
Split                    splitncnn_155            1 2 962 963 964
Permute                  permute_470              1 1 964 965 0=1
Convolution1D            conv1d_108               1 1 965 966 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_10                   1 1 966 967 0=0
Concat                   cat_27                   2 1 904 967 968 0=1
Split                    splitncnn_156            1 2 968 969 970
ConvolutionDepthWise1D   convdw1d_641             1 1 970 971 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_157            1 2 971 972 973
BinaryOp                 sub_150                  1 1 972 974 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_49               1 1 974 975
BinaryOp                 mul_151                  2 1 973 975 976 0=2
Convolution1D            conv1d_109               1 1 976 977 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_471              1 1 977 978 0=1
BinaryOp                 add_152                  2 1 963 978 979 0=0
Split                    splitncnn_158            1 2 979 980 981
InnerProduct             linear_198               1 1 981 982 0=768 1=1 2=196608
Split                    splitncnn_159            1 2 982 983 984
BinaryOp                 sub_153                  1 1 983 985 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_50               1 1 985 986
BinaryOp                 mul_154                  2 1 984 986 987 0=2
InnerProduct             linear_199               1 1 987 988 0=256 1=1 2=196608
BinaryOp                 add_155                  2 1 980 988 989 0=0
Split                    splitncnn_160            1 2 989 990 991
Crop                     select_29                1 1 68 992 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_200               1 1 991 993 0=96 1=0 2=24576
Concat                   cat_28                   2 1 992 993 994 0=0
Split                    splitncnn_161            1 2 994 995 996
Reshape                  reshape_301              1 1 995 997 0=24 1=4 2=20
Permute                  permute_558              1 1 997 998 0=2
MatMul                   bmm_409                  2 1 955 998 999
Permute                  permute_559              1 1 999 1000 0=2
Reshape                  reshape_302              1 1 1000 1001 0=96 1=4
InnerProduct             linear_201               1 1 1001 1002 0=256 1=1 2=24576
BinaryOp                 add_156                  2 1 990 1002 1003 0=0
Split                    splitncnn_162            1 2 1003 1004 1005
Permute                  permute_472              1 1 1005 1006 0=1
Convolution1D            conv1d_110               1 1 1006 1007 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_11                   1 1 1007 1008 0=0
Concat                   cat_29                   2 1 906 1008 1009 0=1
Split                    splitncnn_163            1 2 1009 1010 1011
ConvolutionDepthWise1D   convdw1d_642             1 1 1011 1012 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_164            1 2 1012 1013 1014
BinaryOp                 sub_157                  1 1 1013 1015 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_51               1 1 1015 1016
BinaryOp                 mul_158                  2 1 1014 1016 1017 0=2
Convolution1D            conv1d_111               1 1 1017 1018 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_473              1 1 1018 1019 0=1
BinaryOp                 add_159                  2 1 1004 1019 1020 0=0
Split                    splitncnn_165            1 2 1020 1021 1022
InnerProduct             linear_202               1 1 1022 1023 0=768 1=1 2=196608
Split                    splitncnn_166            1 2 1023 1024 1025
BinaryOp                 sub_160                  1 1 1024 1026 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_52               1 1 1026 1027
BinaryOp                 mul_161                  2 1 1025 1027 1028 0=2
InnerProduct             linear_203               1 1 1028 1029 0=256 1=1 2=196608
BinaryOp                 add_162                  2 1 1021 1029 1030 0=0
Split                    splitncnn_167            1 3 1030 1031 1032 1033
BinaryOp                 mul_163                  2 1 1031 1032 1034 0=2
Reduction                mean_443                 1 1 1034 1035 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_164                  1 1 1035 1036 0=0 1=1 2=5.342896e+00
BinaryOp                 pow_165                  1 1 1036 1037 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_166                  2 1 1033 1037 1038 0=2
BinaryOp                 sub_167                  2 1 1038 900 1039 0=1
BinaryOp                 mul_168                  2 1 1039 116 1040 0=2
BinaryOp                 add_169                  2 1 901 1040 1041 0=0
MemoryData               encoders.2.out_combiner  0 1 1042 0=1
Split                    splitncnn_168            1 2 1042 1043 1044
BinaryOp                 sub_170                  1 1 1043 1045 0=7 1=1 2=1.000000e+00
SimpleUpsample           simple_upsample_628      1 1 1041 1046 0=4 1=256 2=1024
BinaryOp                 mul_171                  2 1 1046 1045 1047 0=2
BinaryOp                 mul_172                  2 1 744 1044 1048 0=2
BinaryOp                 add_173                  2 1 1048 1047 1049 0=0
Split                    splitncnn_169            1 2 1049 1050 1051
MemoryData               encoders.3.downsample    0 1 1052 0=256 1=1 2=1
Reshape                  reshape_303              1 1 1051 1053 0=256 1=8 2=2
Split                    splitncnn_170            1 2 1053 1054 1055
BinaryOp                 mul_174                  2 1 1054 1052 1056 0=2
Reduction                sum_495                  1 1 1056 1057 0=0 1=0 -23303=1,-1 4=1 5=1
Softmax                  softmax_81               1 1 1057 1058 0=1 1=1
BinaryOp                 mul_175                  2 1 1055 1058 1059 0=2
Reduction                sum_496                  1 1 1059 1060 0=0 1=0 -23303=1,1 4=0 5=1
Crop                     crop_604                 1 1 87 1061 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  encoders.3.encoder.state_select_list.0_ncnnreshape0 1 1 1061 1062 0=0 1=0
Crop                     crop_605                 1 1 102 1063 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  pnnx_unique_59_ncnnreshape0 1 1 1063 1064 0=0 1=0
Split                    splitncnn_171            1 4 1060 1065 1066 1067 1068
InnerProduct             linear_204               1 1 1068 1069 0=768 1=1 2=196608
Split                    splitncnn_172            1 2 1069 1070 1071
BinaryOp                 sub_176                  1 1 1070 1072 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_53               1 1 1072 1073
BinaryOp                 mul_177                  2 1 1071 1073 1074 0=2
InnerProduct             linear_205               1 1 1074 1075 0=256 1=1 2=196608
BinaryOp                 add_178                  2 1 1065 1075 1076 0=0
Split                    splitncnn_173            1 2 1076 1077 1078
Crop                     select_30                1 1 27 1079 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_31                1 1 12 1080 -23310=1,1 -23311=1,0 -23309=1,0
PoolingModuleNoProj      pooling_modul_no_proj_508 3 3 1078 1080 1079 1081 1082 1083
InnerProduct             linear_206               1 1 1081 1084 0=256 1=0 2=65536
BinaryOp                 add_179                  2 1 1077 1084 1085 0=0
Split                    splitncnn_174            1 2 1085 1086 1087
Crop                     select_32                1 1 42 1088 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_33                1 1 57 1089 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_207               1 1 1087 1090 0=496 1=1 2=126976
Slice                    tensor_split_6           1 4 1090 1091 1092 1093 1094 -23300=4,192,192,96,-233 1=1
Concat                   cat_30                   2 1 1089 1093 1095 0=0
Split                    splitncnn_175            1 2 1095 1096 1097
Reshape                  reshape_304              1 1 1096 1098 0=24 1=4 2=10
Reshape                  reshape_305              1 1 1091 1099 0=48 1=4 2=2
Reshape                  reshape_306              1 1 1094 1100 0=4 1=4 2=2
Concat                   cat_31                   2 1 1088 1092 1101 0=0
Split                    splitncnn_176            1 2 1101 1102 1103
Reshape                  reshape_307              1 1 1102 1104 0=48 1=4 2=10
InnerProduct             linear_208               1 1 115 1105 0=16 1=0 2=4096
Reshape                  reshape_308              1 1 1105 1106 0=4 1=4 2=11
Permute                  permute_564              1 1 1106 1107 0=3
Permute                  permute_562              1 1 1100 1108 0=2
MatMul                   matmul_430               2 1 1108 1107 1109
Permute                  permute_563              1 1 1104 1110 0=3
Permute                  permute_561              1 1 1099 1111 0=2
MatMul                   matmul_431               2 1 1111 1110 1112
TensorAsStrided          tensor_as_strided_618    1 1 1109 1113 -23300=3,4,2,10 -23301=3,22,10,1 2=1
BinaryOp                 add_180                  2 1 1112 1113 1114 0=0
Reshape                  view_394                 1 1 1114 1115 0=10 1=2 2=4
Softmax                  softmax_82               1 1 1115 1116 0=-1 1=1
Split                    splitncnn_177            1 2 1116 1117 1118
Permute                  permute_560              1 1 1098 1119 0=2
MatMul                   bmm_410                  2 1 1118 1119 1120
Permute                  permute_565              1 1 1120 1121 0=2
Reshape                  reshape_309              1 1 1121 1122 0=96 1=2
InnerProduct             linear_209               1 1 1122 1123 0=256 1=1 2=24576
BinaryOp                 add_181                  2 1 1086 1123 1124 0=0
Split                    splitncnn_178            1 2 1124 1125 1126
Permute                  permute_474              1 1 1126 1127 0=1
Convolution1D            conv1d_112               1 1 1127 1128 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_12                   1 1 1128 1129 0=0
Concat                   cat_32                   2 1 1062 1129 1130 0=1
Split                    splitncnn_179            1 2 1130 1131 1132
ConvolutionDepthWise1D   convdw1d_643             1 1 1132 1133 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_180            1 2 1133 1134 1135
BinaryOp                 sub_182                  1 1 1134 1136 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_54               1 1 1136 1137
BinaryOp                 mul_183                  2 1 1135 1137 1138 0=2
Convolution1D            conv1d_113               1 1 1138 1139 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_475              1 1 1139 1140 0=1
BinaryOp                 add_184                  2 1 1125 1140 1141 0=0
Split                    splitncnn_181            1 2 1141 1142 1143
InnerProduct             linear_210               1 1 1143 1144 0=768 1=1 2=196608
Split                    splitncnn_182            1 2 1144 1145 1146
BinaryOp                 sub_185                  1 1 1145 1147 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_55               1 1 1147 1148
BinaryOp                 mul_186                  2 1 1146 1148 1149 0=2
InnerProduct             linear_211               1 1 1149 1150 0=256 1=1 2=196608
BinaryOp                 add_187                  2 1 1142 1150 1151 0=0
Split                    splitncnn_183            1 2 1151 1152 1153
Crop                     select_34                1 1 72 1154 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_212               1 1 1153 1155 0=96 1=0 2=24576
Concat                   cat_33                   2 1 1154 1155 1156 0=0
Split                    splitncnn_184            1 2 1156 1157 1158
Reshape                  reshape_310              1 1 1157 1159 0=24 1=4 2=10
Permute                  permute_566              1 1 1159 1160 0=2
MatMul                   bmm_411                  2 1 1117 1160 1161
Permute                  permute_567              1 1 1161 1162 0=2
Reshape                  reshape_311              1 1 1162 1163 0=96 1=2
InnerProduct             linear_213               1 1 1163 1164 0=256 1=1 2=24576
BinaryOp                 add_188                  2 1 1152 1164 1165 0=0
Split                    splitncnn_185            1 2 1165 1166 1167
Permute                  permute_476              1 1 1167 1168 0=1
Convolution1D            conv1d_114               1 1 1168 1169 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_13                   1 1 1169 1170 0=0
Concat                   cat_34                   2 1 1064 1170 1171 0=1
Split                    splitncnn_186            1 2 1171 1172 1173
ConvolutionDepthWise1D   convdw1d_644             1 1 1173 1174 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_187            1 2 1174 1175 1176
BinaryOp                 sub_189                  1 1 1175 1177 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_56               1 1 1177 1178
BinaryOp                 mul_190                  2 1 1176 1178 1179 0=2
Convolution1D            conv1d_115               1 1 1179 1180 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_477              1 1 1180 1181 0=1
BinaryOp                 add_191                  2 1 1166 1181 1182 0=0
Split                    splitncnn_188            1 2 1182 1183 1184
InnerProduct             linear_214               1 1 1184 1185 0=768 1=1 2=196608
Split                    splitncnn_189            1 2 1185 1186 1187
BinaryOp                 sub_192                  1 1 1186 1188 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_57               1 1 1188 1189
BinaryOp                 mul_193                  2 1 1187 1189 1190 0=2
InnerProduct             linear_215               1 1 1190 1191 0=256 1=1 2=196608
BinaryOp                 add_194                  2 1 1183 1191 1192 0=0
Split                    splitncnn_190            1 3 1192 1193 1194 1195
BinaryOp                 mul_195                  2 1 1193 1194 1196 0=2
Reduction                mean_444                 1 1 1196 1197 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_196                  1 1 1197 1198 0=0 1=1 2=4.219106e+00
BinaryOp                 pow_197                  1 1 1198 1199 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_198                  2 1 1195 1199 1200 0=2
BinaryOp                 sub_199                  2 1 1200 1066 1201 0=1
BinaryOp                 mul_200                  2 1 1201 112 1202 0=2
BinaryOp                 add_201                  2 1 1067 1202 1203 0=0
Split                    splitncnn_191            1 4 1203 1204 1205 1206 1207
Crop                     crop_606                 1 1 86 1208 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  encoders.3.encoder.state_select_list.1_ncnnreshape0 1 1 1208 1209 0=0 1=0
Crop                     crop_607                 1 1 101 1210 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  pnnx_unique_67_ncnnreshape0 1 1 1210 1211 0=0 1=0
InnerProduct             linear_216               1 1 1207 1212 0=768 1=1 2=196608
Split                    splitncnn_192            1 2 1212 1213 1214
BinaryOp                 sub_202                  1 1 1213 1215 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_58               1 1 1215 1216
BinaryOp                 mul_203                  2 1 1214 1216 1217 0=2
InnerProduct             linear_217               1 1 1217 1218 0=256 1=1 2=196608
BinaryOp                 add_204                  2 1 1204 1218 1219 0=0
Split                    splitncnn_193            1 2 1219 1220 1221
Crop                     select_35                1 1 26 1222 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_36                1 1 11 1223 -23310=1,2 -23311=1,0 -23309=1,1
PoolingModuleNoProj      pooling_modul_no_proj_509 3 3 1221 1223 1222 1224 1225 1226
InnerProduct             linear_218               1 1 1224 1227 0=256 1=0 2=65536
BinaryOp                 add_205                  2 1 1220 1227 1228 0=0
Split                    splitncnn_194            1 2 1228 1229 1230
Crop                     select_37                1 1 41 1231 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_38                1 1 56 1232 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_219               1 1 1230 1233 0=496 1=1 2=126976
Slice                    tensor_split_7           1 4 1233 1234 1235 1236 1237 -23300=4,192,192,96,-233 1=1
Concat                   cat_35                   2 1 1232 1236 1238 0=0
Split                    splitncnn_195            1 2 1238 1239 1240
Reshape                  reshape_312              1 1 1239 1241 0=24 1=4 2=10
Reshape                  reshape_313              1 1 1234 1242 0=48 1=4 2=2
Reshape                  reshape_314              1 1 1237 1243 0=4 1=4 2=2
Concat                   cat_36                   2 1 1231 1235 1244 0=0
Split                    splitncnn_196            1 2 1244 1245 1246
Reshape                  reshape_315              1 1 1245 1247 0=48 1=4 2=10
InnerProduct             linear_220               1 1 114 1248 0=16 1=0 2=4096
Reshape                  reshape_316              1 1 1248 1249 0=4 1=4 2=11
Permute                  permute_572              1 1 1249 1250 0=3
Permute                  permute_570              1 1 1243 1251 0=2
MatMul                   matmul_432               2 1 1251 1250 1252
Permute                  permute_571              1 1 1247 1253 0=3
Permute                  permute_569              1 1 1242 1254 0=2
MatMul                   matmul_433               2 1 1254 1253 1255
TensorAsStrided          tensor_as_strided_619    1 1 1252 1256 -23300=3,4,2,10 -23301=3,22,10,1 2=1
BinaryOp                 add_206                  2 1 1255 1256 1257 0=0
Reshape                  view_395                 1 1 1257 1258 0=10 1=2 2=4
Softmax                  softmax_83               1 1 1258 1259 0=-1 1=1
Split                    splitncnn_197            1 2 1259 1260 1261
Permute                  permute_568              1 1 1241 1262 0=2
MatMul                   bmm_412                  2 1 1261 1262 1263
Permute                  permute_573              1 1 1263 1264 0=2
Reshape                  reshape_317              1 1 1264 1265 0=96 1=2
InnerProduct             linear_221               1 1 1265 1266 0=256 1=1 2=24576
BinaryOp                 add_207                  2 1 1229 1266 1267 0=0
Split                    splitncnn_198            1 2 1267 1268 1269
Permute                  permute_478              1 1 1269 1270 0=1
Convolution1D            conv1d_116               1 1 1270 1271 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_14                   1 1 1271 1272 0=0
Concat                   cat_37                   2 1 1209 1272 1273 0=1
Split                    splitncnn_199            1 2 1273 1274 1275
ConvolutionDepthWise1D   convdw1d_645             1 1 1275 1276 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_200            1 2 1276 1277 1278
BinaryOp                 sub_208                  1 1 1277 1279 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_59               1 1 1279 1280
BinaryOp                 mul_209                  2 1 1278 1280 1281 0=2
Convolution1D            conv1d_117               1 1 1281 1282 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_479              1 1 1282 1283 0=1
BinaryOp                 add_210                  2 1 1268 1283 1284 0=0
Split                    splitncnn_201            1 2 1284 1285 1286
InnerProduct             linear_222               1 1 1286 1287 0=768 1=1 2=196608
Split                    splitncnn_202            1 2 1287 1288 1289
BinaryOp                 sub_211                  1 1 1288 1290 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_60               1 1 1290 1291
BinaryOp                 mul_212                  2 1 1289 1291 1292 0=2
InnerProduct             linear_223               1 1 1292 1293 0=256 1=1 2=196608
BinaryOp                 add_213                  2 1 1285 1293 1294 0=0
Split                    splitncnn_203            1 2 1294 1295 1296
Crop                     select_39                1 1 71 1297 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_224               1 1 1296 1298 0=96 1=0 2=24576
Concat                   cat_38                   2 1 1297 1298 1299 0=0
Split                    splitncnn_204            1 2 1299 1300 1301
Reshape                  reshape_318              1 1 1300 1302 0=24 1=4 2=10
Permute                  permute_574              1 1 1302 1303 0=2
MatMul                   bmm_413                  2 1 1260 1303 1304
Permute                  permute_575              1 1 1304 1305 0=2
Reshape                  reshape_319              1 1 1305 1306 0=96 1=2
InnerProduct             linear_225               1 1 1306 1307 0=256 1=1 2=24576
BinaryOp                 add_214                  2 1 1295 1307 1308 0=0
Split                    splitncnn_205            1 2 1308 1309 1310
Permute                  permute_480              1 1 1310 1311 0=1
Convolution1D            conv1d_118               1 1 1311 1312 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_15                   1 1 1312 1313 0=0
Concat                   cat_39                   2 1 1211 1313 1314 0=1
Split                    splitncnn_206            1 2 1314 1315 1316
ConvolutionDepthWise1D   convdw1d_646             1 1 1316 1317 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_207            1 2 1317 1318 1319
BinaryOp                 sub_215                  1 1 1318 1320 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_61               1 1 1320 1321
BinaryOp                 mul_216                  2 1 1319 1321 1322 0=2
Convolution1D            conv1d_119               1 1 1322 1323 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_481              1 1 1323 1324 0=1
BinaryOp                 add_217                  2 1 1309 1324 1325 0=0
Split                    splitncnn_208            1 2 1325 1326 1327
InnerProduct             linear_226               1 1 1327 1328 0=768 1=1 2=196608
Split                    splitncnn_209            1 2 1328 1329 1330
BinaryOp                 sub_218                  1 1 1329 1331 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_62               1 1 1331 1332
BinaryOp                 mul_219                  2 1 1330 1332 1333 0=2
InnerProduct             linear_227               1 1 1333 1334 0=256 1=1 2=196608
BinaryOp                 add_220                  2 1 1326 1334 1335 0=0
Split                    splitncnn_210            1 3 1335 1336 1337 1338
BinaryOp                 mul_221                  2 1 1336 1337 1339 0=2
Reduction                mean_445                 1 1 1339 1340 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_222                  1 1 1340 1341 0=0 1=1 2=7.292570e+00
BinaryOp                 pow_223                  1 1 1341 1342 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_224                  2 1 1338 1342 1343 0=2
BinaryOp                 sub_225                  2 1 1343 1205 1344 0=1
BinaryOp                 mul_226                  2 1 1344 111 1345 0=2
BinaryOp                 add_227                  2 1 1206 1345 1346 0=0
MemoryData               encoders.3.out_combiner  0 1 1347 0=1
Split                    splitncnn_211            1 2 1347 1348 1349
BinaryOp                 sub_228                  1 1 1348 1350 0=7 1=1 2=1.000000e+00
MemoryData               skip_modules.4           0 1 1351 0=1
Split                    splitncnn_212            1 2 1351 1352 1353
BinaryOp                 sub_229                  1 1 1352 1354 0=7 1=1 2=1.000000e+00
SimpleUpsample           simple_upsample_629      1 1 1346 1355 0=8 1=256 2=2048
BinaryOp                 mul_230                  2 1 1355 1350 1356 0=2
BinaryOp                 mul_231                  2 1 1050 1349 1357 0=2
BinaryOp                 add_232                  2 1 1357 1356 1358 0=0
BinaryOp                 mul_233                  2 1 1358 1354 1359 0=2
BinaryOp                 mul_234                  2 1 745 1353 1360 0=2
BinaryOp                 add_235                  2 1 1360 1359 1361 0=0
Split                    splitncnn_213            1 2 1361 1362 1363
MemoryData               encoders.4.downsample    0 1 1364 0=256 1=1 2=1
Reshape                  reshape_320              1 1 1363 1365 0=256 1=2 2=8
Split                    splitncnn_214            1 2 1365 1366 1367
BinaryOp                 mul_236                  2 1 1366 1364 1368 0=2
Reduction                sum_497                  1 1 1368 1369 0=0 1=0 -23303=1,-1 4=1 5=1
Softmax                  softmax_84               1 1 1369 1370 0=1 1=1
BinaryOp                 mul_237                  2 1 1367 1370 1371 0=2
Reduction                sum_498                  1 1 1371 1372 0=0 1=0 -23303=1,1 4=0 5=1
Crop                     crop_608                 1 1 90 1373 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  encoders.4.encoder.state_select_list.0_ncnnreshape0 1 1 1373 1374 0=0 1=0
Crop                     crop_609                 1 1 105 1375 -23310=1,1 -23311=1,0 -23309=1,0
Reshape                  pnnx_unique_76_ncnnreshape0 1 1 1375 1376 0=0 1=0
Split                    splitncnn_215            1 4 1372 1377 1378 1379 1380
InnerProduct             linear_228               1 1 1380 1381 0=768 1=1 2=196608
Split                    splitncnn_216            1 2 1381 1382 1383
BinaryOp                 sub_238                  1 1 1382 1384 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_63               1 1 1384 1385
BinaryOp                 mul_239                  2 1 1383 1385 1386 0=2
InnerProduct             linear_229               1 1 1386 1387 0=256 1=1 2=196608
BinaryOp                 add_240                  2 1 1377 1387 1388 0=0
Split                    splitncnn_217            1 2 1388 1389 1390
Crop                     select_40                1 1 30 1391 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_41                1 1 15 1392 -23310=1,1 -23311=1,0 -23309=1,0
PoolingModuleNoProj      pooling_modul_no_proj_510 3 3 1390 1392 1391 1393 1394 1395
InnerProduct             linear_230               1 1 1393 1396 0=256 1=0 2=65536
BinaryOp                 add_241                  2 1 1389 1396 1397 0=0
Split                    splitncnn_218            1 2 1397 1398 1399
Crop                     select_42                1 1 45 1400 -23310=1,1 -23311=1,0 -23309=1,0
Crop                     select_43                1 1 60 1401 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_231               1 1 1399 1402 0=496 1=1 2=126976
Slice                    tensor_split_8           1 4 1402 1403 1404 1405 1406 -23300=4,192,192,96,-233 1=1
Concat                   cat_40                   2 1 1401 1405 1407 0=0
Split                    splitncnn_219            1 2 1407 1408 1409
Reshape                  reshape_321              1 1 1408 1410 0=24 1=4 2=40
Reshape                  reshape_322              1 1 1403 1411 0=48 1=4 2=8
Reshape                  reshape_323              1 1 1406 1412 0=4 1=4 2=8
Concat                   cat_41                   2 1 1400 1404 1413 0=0
Split                    splitncnn_220            1 2 1413 1414 1415
Reshape                  reshape_324              1 1 1414 1416 0=48 1=4 2=40
InnerProduct             linear_232               1 1 110 1417 0=16 1=0 2=4096
Reshape                  reshape_325              1 1 1417 1418 0=4 1=4 2=47
Permute                  permute_580              1 1 1418 1419 0=3
Permute                  permute_578              1 1 1412 1420 0=2
MatMul                   matmul_434               2 1 1420 1419 1421
Permute                  permute_579              1 1 1416 1422 0=3
Permute                  permute_577              1 1 1411 1423 0=2
MatMul                   matmul_435               2 1 1423 1422 1424
TensorAsStrided          tensor_as_strided_620    1 1 1421 1425 -23300=3,4,8,40 -23301=3,376,46,1 2=7
BinaryOp                 add_242                  2 1 1424 1425 1426 0=0
Reshape                  view_396                 1 1 1426 1427 0=40 1=8 2=4
Softmax                  softmax_85               1 1 1427 1428 0=-1 1=1
Split                    splitncnn_221            1 2 1428 1429 1430
Permute                  permute_576              1 1 1410 1431 0=2
MatMul                   bmm_414                  2 1 1430 1431 1432
Permute                  permute_581              1 1 1432 1433 0=2
Reshape                  reshape_326              1 1 1433 1434 0=96 1=8
InnerProduct             linear_233               1 1 1434 1435 0=256 1=1 2=24576
BinaryOp                 add_243                  2 1 1398 1435 1436 0=0
Split                    splitncnn_222            1 2 1436 1437 1438
Permute                  permute_482              1 1 1438 1439 0=1
Convolution1D            conv1d_120               1 1 1439 1440 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_16                   1 1 1440 1441 0=0
Concat                   cat_42                   2 1 1374 1441 1442 0=1
Split                    splitncnn_223            1 2 1442 1443 1444
ConvolutionDepthWise1D   convdw1d_647             1 1 1444 1445 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_224            1 2 1445 1446 1447
BinaryOp                 sub_244                  1 1 1446 1448 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_64               1 1 1448 1449
BinaryOp                 mul_245                  2 1 1447 1449 1450 0=2
Convolution1D            conv1d_121               1 1 1450 1451 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_483              1 1 1451 1452 0=1
BinaryOp                 add_246                  2 1 1437 1452 1453 0=0
Split                    splitncnn_225            1 2 1453 1454 1455
InnerProduct             linear_234               1 1 1455 1456 0=768 1=1 2=196608
Split                    splitncnn_226            1 2 1456 1457 1458
BinaryOp                 sub_247                  1 1 1457 1459 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_65               1 1 1459 1460
BinaryOp                 mul_248                  2 1 1458 1460 1461 0=2
InnerProduct             linear_235               1 1 1461 1462 0=256 1=1 2=196608
BinaryOp                 add_249                  2 1 1454 1462 1463 0=0
Split                    splitncnn_227            1 2 1463 1464 1465
Crop                     select_44                1 1 75 1466 -23310=1,1 -23311=1,0 -23309=1,0
InnerProduct             linear_236               1 1 1465 1467 0=96 1=0 2=24576
Concat                   cat_43                   2 1 1466 1467 1468 0=0
Split                    splitncnn_228            1 2 1468 1469 1470
Reshape                  reshape_327              1 1 1469 1471 0=24 1=4 2=40
Permute                  permute_582              1 1 1471 1472 0=2
MatMul                   bmm_415                  2 1 1429 1472 1473
Permute                  permute_583              1 1 1473 1474 0=2
Reshape                  reshape_328              1 1 1474 1475 0=96 1=8
InnerProduct             linear_237               1 1 1475 1476 0=256 1=1 2=24576
BinaryOp                 add_250                  2 1 1464 1476 1477 0=0
Split                    splitncnn_229            1 2 1477 1478 1479
Permute                  permute_484              1 1 1479 1480 0=1
Convolution1D            conv1d_122               1 1 1480 1481 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_17                   1 1 1481 1482 0=0
Concat                   cat_44                   2 1 1376 1482 1483 0=1
Split                    splitncnn_230            1 2 1483 1484 1485
ConvolutionDepthWise1D   convdw1d_648             1 1 1485 1486 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_231            1 2 1486 1487 1488
BinaryOp                 sub_251                  1 1 1487 1489 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_66               1 1 1489 1490
BinaryOp                 mul_252                  2 1 1488 1490 1491 0=2
Convolution1D            conv1d_123               1 1 1491 1492 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_485              1 1 1492 1493 0=1
BinaryOp                 add_253                  2 1 1478 1493 1494 0=0
Split                    splitncnn_232            1 2 1494 1495 1496
InnerProduct             linear_238               1 1 1496 1497 0=768 1=1 2=196608
Split                    splitncnn_233            1 2 1497 1498 1499
BinaryOp                 sub_254                  1 1 1498 1500 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_67               1 1 1500 1501
BinaryOp                 mul_255                  2 1 1499 1501 1502 0=2
InnerProduct             linear_239               1 1 1502 1503 0=256 1=1 2=196608
BinaryOp                 add_256                  2 1 1495 1503 1504 0=0
Split                    splitncnn_234            1 3 1504 1505 1506 1507
BinaryOp                 mul_257                  2 1 1505 1506 1508 0=2
Reduction                mean_446                 1 1 1508 1509 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_258                  1 1 1509 1510 0=0 1=1 2=6.848550e+00
BinaryOp                 pow_259                  1 1 1510 1511 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_260                  2 1 1507 1511 1512 0=2
BinaryOp                 sub_261                  2 1 1512 1378 1513 0=1
BinaryOp                 mul_262                  2 1 1513 107 1514 0=2
BinaryOp                 add_263                  2 1 1379 1514 1515 0=0
Split                    splitncnn_235            1 4 1515 1516 1517 1518 1519
Crop                     crop_610                 1 1 89 1520 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  encoders.4.encoder.state_select_list.1_ncnnreshape0 1 1 1520 1521 0=0 1=0
Crop                     crop_611                 1 1 104 1522 -23310=1,2 -23311=1,0 -23309=1,1
Reshape                  pnnx_unique_84_ncnnreshape0 1 1 1522 1523 0=0 1=0
InnerProduct             linear_240               1 1 1519 1524 0=768 1=1 2=196608
Split                    splitncnn_236            1 2 1524 1525 1526
BinaryOp                 sub_264                  1 1 1525 1527 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_68               1 1 1527 1528
BinaryOp                 mul_265                  2 1 1526 1528 1529 0=2
InnerProduct             linear_241               1 1 1529 1530 0=256 1=1 2=196608
BinaryOp                 add_266                  2 1 1516 1530 1531 0=0
Split                    splitncnn_237            1 2 1531 1532 1533
Crop                     select_45                1 1 29 1534 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_46                1 1 14 1535 -23310=1,2 -23311=1,0 -23309=1,1
PoolingModuleNoProj      pooling_modul_no_proj_511 3 3 1533 1535 1534 1536 1537 1538
InnerProduct             linear_242               1 1 1536 1539 0=256 1=0 2=65536
BinaryOp                 add_267                  2 1 1532 1539 1540 0=0
Split                    splitncnn_238            1 2 1540 1541 1542
Crop                     select_47                1 1 44 1543 -23310=1,2 -23311=1,0 -23309=1,1
Crop                     select_48                1 1 59 1544 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_243               1 1 1542 1545 0=496 1=1 2=126976
Slice                    tensor_split_9           1 4 1545 1546 1547 1548 1549 -23300=4,192,192,96,-233 1=1
Concat                   cat_45                   2 1 1544 1548 1550 0=0
Split                    splitncnn_239            1 2 1550 1551 1552
Reshape                  reshape_329              1 1 1551 1553 0=24 1=4 2=40
Reshape                  reshape_330              1 1 1546 1554 0=48 1=4 2=8
Reshape                  reshape_331              1 1 1549 1555 0=4 1=4 2=8
Concat                   cat_46                   2 1 1543 1547 1556 0=0
Split                    splitncnn_240            1 2 1556 1557 1558
Reshape                  reshape_332              1 1 1557 1559 0=48 1=4 2=40
InnerProduct             linear_244               1 1 109 1560 0=16 1=0 2=4096
Reshape                  reshape_333              1 1 1560 1561 0=4 1=4 2=47
Permute                  permute_588              1 1 1561 1562 0=3
Permute                  permute_586              1 1 1555 1563 0=2
MatMul                   matmul_436               2 1 1563 1562 1564
Permute                  permute_587              1 1 1559 1565 0=3
Permute                  permute_585              1 1 1554 1566 0=2
MatMul                   matmul_437               2 1 1566 1565 1567
TensorAsStrided          tensor_as_strided_621    1 1 1564 1568 -23300=3,4,8,40 -23301=3,376,46,1 2=7
BinaryOp                 add_268                  2 1 1567 1568 1569 0=0
Reshape                  view_397                 1 1 1569 1570 0=40 1=8 2=4
Softmax                  softmax_86               1 1 1570 1571 0=-1 1=1
Split                    splitncnn_241            1 2 1571 1572 1573
Permute                  permute_584              1 1 1553 1574 0=2
MatMul                   bmm_416                  2 1 1573 1574 1575
Permute                  permute_589              1 1 1575 1576 0=2
Reshape                  reshape_334              1 1 1576 1577 0=96 1=8
InnerProduct             linear_245               1 1 1577 1578 0=256 1=1 2=24576
BinaryOp                 add_269                  2 1 1541 1578 1579 0=0
Split                    splitncnn_242            1 2 1579 1580 1581
Permute                  permute_486              1 1 1581 1582 0=1
Convolution1D            conv1d_124               1 1 1582 1583 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_18                   1 1 1583 1584 0=0
Concat                   cat_47                   2 1 1521 1584 1585 0=1
Split                    splitncnn_243            1 2 1585 1586 1587
ConvolutionDepthWise1D   convdw1d_649             1 1 1587 1588 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_244            1 2 1588 1589 1590
BinaryOp                 sub_270                  1 1 1589 1591 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_69               1 1 1591 1592
BinaryOp                 mul_271                  2 1 1590 1592 1593 0=2
Convolution1D            conv1d_125               1 1 1593 1594 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_487              1 1 1594 1595 0=1
BinaryOp                 add_272                  2 1 1580 1595 1596 0=0
Split                    splitncnn_245            1 2 1596 1597 1598
InnerProduct             linear_246               1 1 1598 1599 0=768 1=1 2=196608
Split                    splitncnn_246            1 2 1599 1600 1601
BinaryOp                 sub_273                  1 1 1600 1602 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_70               1 1 1602 1603
BinaryOp                 mul_274                  2 1 1601 1603 1604 0=2
InnerProduct             linear_247               1 1 1604 1605 0=256 1=1 2=196608
BinaryOp                 add_275                  2 1 1597 1605 1606 0=0
Split                    splitncnn_247            1 2 1606 1607 1608
Crop                     select_49                1 1 74 1609 -23310=1,2 -23311=1,0 -23309=1,1
InnerProduct             linear_248               1 1 1608 1610 0=96 1=0 2=24576
Concat                   cat_48                   2 1 1609 1610 1611 0=0
Split                    splitncnn_248            1 2 1611 1612 1613
Reshape                  reshape_335              1 1 1612 1614 0=24 1=4 2=40
Permute                  permute_590              1 1 1614 1615 0=2
MatMul                   bmm_417                  2 1 1572 1615 1616
Permute                  permute_591              1 1 1616 1617 0=2
Reshape                  reshape_336              1 1 1617 1618 0=96 1=8
InnerProduct             linear_249               1 1 1618 1619 0=256 1=1 2=24576
BinaryOp                 add_276                  2 1 1607 1619 1620 0=0
Split                    splitncnn_249            1 2 1620 1621 1622
Permute                  permute_488              1 1 1622 1623 0=1
Convolution1D            conv1d_126               1 1 1623 1624 0=512 1=1 2=1 3=1 4=0 5=1 6=131072
GLU                      glu_19                   1 1 1624 1625 0=0
Concat                   cat_49                   2 1 1523 1625 1626 0=1
Split                    splitncnn_250            1 2 1626 1627 1628
ConvolutionDepthWise1D   convdw1d_650             1 1 1628 1629 0=256 1=31 2=1 3=1 4=0 5=1 6=7936 7=256
Split                    splitncnn_251            1 2 1629 1630 1631
BinaryOp                 sub_277                  1 1 1630 1632 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_71               1 1 1632 1633
BinaryOp                 mul_278                  2 1 1631 1633 1634 0=2
Convolution1D            conv1d_127               1 1 1634 1635 0=256 1=1 2=1 3=1 4=0 5=1 6=65536
Permute                  permute_489              1 1 1635 1636 0=1
BinaryOp                 add_279                  2 1 1621 1636 1637 0=0
Split                    splitncnn_252            1 2 1637 1638 1639
InnerProduct             linear_250               1 1 1639 1640 0=768 1=1 2=196608
Split                    splitncnn_253            1 2 1640 1641 1642
BinaryOp                 sub_280                  1 1 1641 1643 0=1 1=1 2=1.000000e+00
Sigmoid                  sigmoid_72               1 1 1643 1644
BinaryOp                 mul_281                  2 1 1642 1644 1645 0=2
InnerProduct             linear_251               1 1 1645 1646 0=256 1=1 2=196608
BinaryOp                 add_282                  2 1 1638 1646 1647 0=0
Split                    splitncnn_254            1 3 1647 1648 1649 1650
BinaryOp                 mul_283                  2 1 1648 1649 1651 0=2
Reduction                mean_447                 1 1 1651 1652 0=3 1=0 -23303=1,-1 4=1 5=1
BinaryOp                 add_284                  1 1 1652 1653 0=0 1=1 2=4.731342e+00
BinaryOp                 pow_285                  1 1 1653 1654 0=6 1=1 2=-5.000000e-01
BinaryOp                 mul_286                  2 1 1650 1654 1655 0=2
BinaryOp                 sub_287                  2 1 1655 1517 1656 0=1
BinaryOp                 mul_288                  2 1 1656 106 1657 0=2
BinaryOp                 add_289                  2 1 1518 1657 1658 0=0
MemoryData               encoders.4.out_combiner  0 1 1659 0=1
Split                    splitncnn_255            1 2 1659 1660 1661
BinaryOp                 sub_290                  1 1 1660 1662 0=7 1=1 2=1.000000e+00
SimpleUpsample           simple_upsample_630      1 1 1658 1663 0=2 1=256 2=512
BinaryOp                 mul_291                  2 1 1663 1662 1664 0=2
BinaryOp                 mul_292                  2 1 1362 1661 1665 0=2
BinaryOp                 add_293                  2 1 1665 1664 1666 0=0
MemoryData               downsample_output        0 1 1667 0=256
Reshape                  reshape_337              1 1 1666 1668 0=256 1=2 2=8
Split                    splitncnn_256            1 2 1668 1669 1670
BinaryOp                 mul_294                  2 1 1669 1667 1671 0=2
Reduction                sum_499                  1 1 1671 1672 0=0 1=0 -23303=1,-1 4=1 5=1
Softmax                  softmax_87               1 1 1672 1673 0=1 1=1
BinaryOp                 mul_295                  2 1 1670 1673 1674 0=2
Reduction                sum_500                  1 1 1674 out0 0=0 1=0 -23303=1,1 4=0 5=1
Crop                     slice_339                1 1 1627 1676 -23310=1,-233 -23311=1,1 -23309=1,8
Crop                     slice_338                1 1 1484 1677 -23310=1,-233 -23311=1,1 -23309=1,8
Stack                    stack_0                  2 1 1677 1676 out35 0=0
Crop                     slice_341                1 1 1586 1679 -23310=1,-233 -23311=1,1 -23309=1,8
Crop                     slice_340                1 1 1443 1680 -23310=1,-233 -23311=1,1 -23309=1,8
Stack                    stack_1                  2 1 1680 1679 out30 0=0
Crop                     slice_343                1 1 1613 1682 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_342                1 1 1470 1683 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_2                  2 1 1683 1682 out25 0=0
Crop                     slice_345                1 1 1552 1685 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_344                1 1 1409 1686 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_3                  2 1 1686 1685 out20 0=0
Crop                     slice_347                1 1 1558 1688 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_346                1 1 1415 1689 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_4                  2 1 1689 1688 out15 0=0
Stack                    stack_5                  2 1 1395 1538 out10 0=0
Stack                    stack_6                  2 1 1394 1537 out5 0=0
Crop                     slice_349                1 1 1315 1693 -23310=1,-233 -23311=1,1 -23309=1,2
Crop                     slice_348                1 1 1172 1694 -23310=1,-233 -23311=1,1 -23309=1,2
Stack                    stack_7                  2 1 1694 1693 out34 0=0
Crop                     slice_351                1 1 1274 1696 -23310=1,-233 -23311=1,1 -23309=1,2
Crop                     slice_350                1 1 1131 1697 -23310=1,-233 -23311=1,1 -23309=1,2
Stack                    stack_8                  2 1 1697 1696 out29 0=0
Crop                     slice_353                1 1 1301 1699 -23310=1,-233 -23311=1,0 -23309=1,2
Crop                     slice_352                1 1 1158 1700 -23310=1,-233 -23311=1,0 -23309=1,2
Stack                    stack_9                  2 1 1700 1699 out24 0=0
Crop                     slice_355                1 1 1240 1702 -23310=1,-233 -23311=1,0 -23309=1,2
Crop                     slice_354                1 1 1097 1703 -23310=1,-233 -23311=1,0 -23309=1,2
Stack                    stack_10                 2 1 1703 1702 out19 0=0
Crop                     slice_357                1 1 1246 1705 -23310=1,-233 -23311=1,0 -23309=1,2
Crop                     slice_356                1 1 1103 1706 -23310=1,-233 -23311=1,0 -23309=1,2
Stack                    stack_11                 2 1 1706 1705 out14 0=0
Stack                    stack_12                 2 1 1083 1226 out9 0=0
Stack                    stack_13                 2 1 1082 1225 out4 0=0
Crop                     slice_359                1 1 1010 1710 -23310=1,-233 -23311=1,1 -23309=1,4
Crop                     slice_358                1 1 867 1711 -23310=1,-233 -23311=1,1 -23309=1,4
Stack                    stack_14                 2 1 1711 1710 out33 0=0
Crop                     slice_361                1 1 969 1713 -23310=1,-233 -23311=1,1 -23309=1,4
Crop                     slice_360                1 1 826 1714 -23310=1,-233 -23311=1,1 -23309=1,4
Stack                    stack_15                 2 1 1714 1713 out28 0=0
Crop                     slice_363                1 1 996 1716 -23310=1,-233 -23311=1,0 -23309=1,4
Crop                     slice_362                1 1 853 1717 -23310=1,-233 -23311=1,0 -23309=1,4
Stack                    stack_16                 2 1 1717 1716 out23 0=0
Crop                     slice_365                1 1 935 1719 -23310=1,-233 -23311=1,0 -23309=1,4
Crop                     slice_364                1 1 792 1720 -23310=1,-233 -23311=1,0 -23309=1,4
Stack                    stack_17                 2 1 1720 1719 out18 0=0
Crop                     slice_367                1 1 941 1722 -23310=1,-233 -23311=1,0 -23309=1,4
Crop                     slice_366                1 1 798 1723 -23310=1,-233 -23311=1,0 -23309=1,4
Stack                    stack_18                 2 1 1723 1722 out13 0=0
Stack                    stack_19                 2 1 778 921 out8 0=0
Stack                    stack_20                 2 1 777 920 out3 0=0
Crop                     slice_369                1 1 704 1727 -23310=1,-233 -23311=1,1 -23309=1,8
Crop                     slice_368                1 1 561 1728 -23310=1,-233 -23311=1,1 -23309=1,8
Stack                    stack_21                 2 1 1728 1727 out32 0=0
Crop                     slice_371                1 1 663 1730 -23310=1,-233 -23311=1,1 -23309=1,8
Crop                     slice_370                1 1 520 1731 -23310=1,-233 -23311=1,1 -23309=1,8
Stack                    stack_22                 2 1 1731 1730 out27 0=0
Crop                     slice_373                1 1 690 1733 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_372                1 1 547 1734 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_23                 2 1 1734 1733 out22 0=0
Crop                     slice_375                1 1 629 1736 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_374                1 1 486 1737 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_24                 2 1 1737 1736 out17 0=0
Crop                     slice_377                1 1 635 1739 -23310=1,-233 -23311=1,0 -23309=1,8
Crop                     slice_376                1 1 492 1740 -23310=1,-233 -23311=1,0 -23309=1,8
Stack                    stack_25                 2 1 1740 1739 out12 0=0
Stack                    stack_26                 2 1 472 615 out7 0=0
Stack                    stack_27                 2 1 471 614 out2 0=0
Crop                     slice_379                1 1 407 1744 -23310=1,-233 -23311=1,1 -23309=1,16
Crop                     slice_378                1 1 264 1745 -23310=1,-233 -23311=1,1 -23309=1,16
Stack                    stack_28                 2 1 1745 1744 out31 0=0
Crop                     slice_381                1 1 366 1747 -23310=1,-233 -23311=1,1 -23309=1,16
Crop                     slice_380                1 1 223 1748 -23310=1,-233 -23311=1,1 -23309=1,16
Stack                    stack_29                 2 1 1748 1747 out26 0=0
Crop                     slice_383                1 1 393 1750 -23310=1,-233 -23311=1,0 -23309=1,16
Crop                     slice_382                1 1 250 1751 -23310=1,-233 -23311=1,0 -23309=1,16
Stack                    stack_30                 2 1 1751 1750 out21 0=0
Crop                     slice_385                1 1 332 1753 -23310=1,-233 -23311=1,0 -23309=1,16
Crop                     slice_384                1 1 189 1754 -23310=1,-233 -23311=1,0 -23309=1,16
Stack                    stack_31                 2 1 1754 1753 out16 0=0
Crop                     slice_387                1 1 338 1756 -23310=1,-233 -23311=1,0 -23309=1,16
Crop                     slice_386                1 1 195 1757 -23310=1,-233 -23311=1,0 -23309=1,16
Stack                    stack_32                 2 1 1757 1756 out11 0=0
Stack                    stack_33                 2 1 175 318 out6 0=0
Stack                    stack_34                 2 1 174 317 out1 0=0