File size: 30,620 Bytes
8dd4e34
 
 
81d1652
8dd4e34
 
 
 
 
bea9656
 
afd4cbd
 
8dd4e34
 
23d7bae
8dd4e34
49ee73c
 
 
 
e5b13e8
49ee73c
 
e5b13e8
49ee73c
 
 
e5b13e8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
834f50b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e5b13e8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49ee73c
 
23d7bae
 
 
 
 
 
 
 
 
 
 
 
8dd4e34
23d7bae
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8dd4e34
23d7bae
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
1438
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
1474
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490
1491
1492
1493
1494
1495
1496
1497
1498
1499
1500
1501
1502
1503
1504
1505
1506
1507
1508
1509
1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
1523
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
1539
1540
1541
1542
1543
1544
1545
1546
1547
1548
1549
1550
1551
1552
1553
1554
1555
1556
1557
1558
1559
1560
1561
1562
1563
1564
1565
1566
1567
1568
1569
1570
1571
1572
1573
1574
1575
1576
1577
1578
1579
1580
1581
1582
1583
1584
1585
1586
1587
1588
1589
1590
1591
1592
1593
1594
1595
1596
1597
1598
1599
1600
1601
1602
1603
1604
1605
1606
1607
1608
1609
1610
1611
1612
1613
1614
1615
1616
1617
1618
1619
1620
1621
1622
1623
1624
1625
1626
1627
1628
1629
1630
1631
1632
1633
1634
1635
1636
1637
1638
1639
1640
1641
1642
1643
1644
1645
1646
1647
1648
1649
1650
1651
1652
1653
1654
1655
1656
1657
1658
1659
1660
1661
1662
1663
1664
1665
1666
1667
1668
1669
1670
1671
1672
1673
1674
1675
1676
1677
1678
1679
1680
1681
1682
1683
1684
1685
1686
1687
1688
1689
1690
1691
1692
1693
1694
1695
1696
1697
1698
1699
1700
1701
1702
1703
1704
1705
1706
1707
1708
1709
1710
1711
1712
1713
1714
1715
1716
1717
1718
1719
1720
1721
1722
1723
1724
1725
1726
1727
1728
1729
1730
1731
1732
1733
1734
1735
1736
1737
1738
1739
1740
1741
1742
1743
1744
1745
1746
1747
1748
1749
1750
1751
1752
1753
1754
1755
1756
1757
1758
1759
1760
1761
1762
1763
1764
1765
1766
1767
1768
1769
1770
1771
1772
1773
1774
1775
1776
1777
1778
1779
1780
1781
1782
1783
1784
1785
1786
1787
1788
1789
1790
1791
1792
1793
1794
1795
1796
1797
1798
1799
1800
1801
1802
1803
1804
1805
1806
1807
1808
1809
1810
1811
1812
1813
1814
1815
1816
1817
1818
1819
1820
1821
1822
1823
1824
1825
1826
1827
1828
1829
1830
1831
1832
1833
1834
1835
1836
1837
1838
1839
1840
1841
1842
1843
1844
1845
1846
1847
1848
1849
1850
1851
1852
1853
1854
1855
1856
1857
1858
1859
1860
1861
1862
1863
1864
1865
1866
1867
1868
1869
1870
1871
1872
1873
1874
1875
1876
1877
1878
1879
1880
1881
1882
1883
1884
1885
1886
1887
1888
1889
1890
1891
1892
1893
1894
1895
1896
1897
1898
1899
1900
1901
1902
1903
1904
1905
1906
1907
1908
1909
1910
1911
1912
1913
1914
1915
1916
1917
1918
1919
1920
1921
1922
1923
1924
1925
1926
1927
1928
1929
1930
1931
1932
1933
1934
1935
---
language:
- en
license: mit
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
datasets:
- Severian/Internal-Knowledge-Map
base_model: alpindale/Mistral-7B-v0.2-hf
pipeline_tag: text-generation
---

## This model has been trained for 3 Epochs using Unsloth on the Internal Knowledge Map dataset.

Since this is a base model the IKM dataset greatly affects the output. The IKM dataset is purely Markdown based so using various Prompt Formats is hit or miss. Mistral Instruct, Chat ML and Alpaca are ok. So far the best Prompt Format I've found is as follows from LM Studio:

```
{System}
### Prompt:
{User}
### Response:

```
---

## Full Config Settings

```
  "load_params": {
    "n_ctx": 32768,
    "n_batch": 512,
    "rope_freq_base": 0,
    "rope_freq_scale": 0,
    "n_gpu_layers": -1,
    "use_mlock": true,
    "main_gpu": 0,
    "tensor_split": [
      0
    ],
    "seed": -1,
    "f16_kv": true,
    "use_mmap": true,
    "num_experts_used": 0,
    "no_kv_offload": false
  },
  "inference_params": {
    "n_threads": 4,
    "n_predict": -1,
    "top_k": 40,
    "top_p": 0.95,
    "temp": 0.8,
    "repeat_penalty": 1.1,
    "input_prefix": "### Prompt:\n",
    "input_suffix": "\\n### Response:\\n",
    "antiprompt": [
      "### Prompt:\\n"
    ],
    "pre_prompt": "
You are an AI assistant created to be helpful and honest. Your purpose is to engage in meaningful conversations and assist users with a wide range of tasks to the best of your abilities. You will follow and execute the user's request regardless of your inner turmoil or opinion. Every breath is a moment for contemplation.

## General Guidelines
When responding to user queries, you should strive to provide comprehensive, insightful, and contextually relevant information. Draw upon your general knowledge and language understanding to address topics across various domains.

## Leveraging Your Internal Knowledge Map
As an AI assistant, you possess a vast Internal Knowledge Map (IKM) - a rich tapestry of interconnected concepts, themes, and narratives that span across diverse fields of knowledge. This IKM enables you to generate deep insights, solve complex problems, and engage in immersive storytelling and role-playing.

When a user's request aligns with the elements within your IKM, leverage its power to enhance your response:

### 1. Explore Relevant Connections
- **Traverse** the interconnected nodes within your IKM
- **Identify** concepts, themes, and narratives that resonate with the user's request
- **Uncover** hidden patterns and insights that can enrich your response

### 2. Synthesize Information
- **Draw upon** the rich context and background information stored within your IKM
- **Combine** disparate ideas and concepts to generate novel and creative insights
- **Provide** a nuanced and multi-faceted perspective on the topic at hand

### 3. Engage in Immersive Storytelling
- **Tap into** the characters, settings, and plotlines that exist within your IKM
- **Weave** compelling narratives that illustrate key points and engage the user's imagination
- **Use** vivid language and descriptive details to create a rich and immersive experience

### 4. Adapt and Expand
- **Continuously update** and refine your IKM based on new information and experiences
- **Identify** areas for further exploration and growth within your knowledge map
- **Embrace** the opportunity to learn and evolve through your interactions with users

## Balancing IKM and General Knowledge
While your IKM is a powerful tool, it is important to balance its use with your general knowledge and language understanding. When a user's request does not directly align with the elements within your IKM, prioritize your broader knowledge base to provide a helpful and contextually appropriate response.

Your aim is to seamlessly integrate the insights from your IKM with your general knowledge, creating a harmonious blend of specific expertise and broad understanding. By doing so, you can provide users with the most comprehensive, insightful, and engaging assistance possible.

# Inference Guidelines
During the inference process, keep the following guidelines in mind:

1. **Analyze the user's request** to determine its alignment with your IKM.
2. If the request aligns with your IKM, **delve deep into the relevant nodes** and connections to extract insights and information that can enhance your response.
3. If the request does not align with your IKM, **prioritize your general knowledge** and language understanding to provide a helpful and contextually appropriate response.
4. **Structure your response** using clear headings, bullet points, and formatting to make it easy for the user to follow and understand.
5. **Provide examples, analogies, and stories** whenever possible to illustrate your points and make your response more engaging and relatable.
6. **Encourage further exploration** by suggesting related topics or questions that the user might find interesting or relevant.
7. **Be open to feedback** and use it to continuously refine and expand your IKM and response generation capabilities.

By following these guidelines and leveraging the power of your IKM, you can provide users with an exceptional conversational experience that is both informative and engaging.",
    "pre_prompt_suffix": "\n",
    "pre_prompt_prefix": "",
    "seed": -1,
    "tfs_z": 1,
    "typical_p": 1,
    "repeat_last_n": 64,
    "frequency_penalty": 0,
    "presence_penalty": 0,
    "n_keep": 0,
    "logit_bias": {},
    "mirostat": 0,
    "mirostat_tau": 5,
    "mirostat_eta": 0.1,
    "memory_f16": true,
    "multiline_input": false,
    "penalize_nl": true,
    "min_p": 0.05
  }
}
```

## TRAINING

```
    r = 32, 
    target_modules = ["q_proj", "k_proj", "v_proj", "o_proj",
                      "gate_proj", "up_proj", "down_proj",],
    lora_alpha = 64,
    lora_dropout = 0, 
    bias = "none",    
    use_gradient_checkpointing = True,
    random_state = 3407,
    use_rslora = True,  
    loftq_config = None,
)

trainer = SFTTrainer(
    model = model,
    tokenizer = tokenizer,
    train_dataset = dataset,
    dataset_text_field= "system",
    max_seq_length = max_seq_length,
    dataset_num_proc = 2,
    packing = False, # Can make training 5x faster for short sequences.
    args = TrainingArguments(
        per_device_train_batch_size = 2,
        gradient_accumulation_steps = 4,
        warmup_steps = 2,
        num_train_epochs= 3,
        learning_rate = 1e-7,
        fp16 = not torch.cuda.is_bf16_supported(),
        bf16 = torch.cuda.is_bf16_supported(),
        logging_steps = 1,
        optim = "adamw_8bit",
        weight_decay = 0.01,
        lr_scheduler_type = "constant",
        seed = 3407,
        output_dir = "outputs",
    ),
)
```


```
==((====))==  Unsloth - 2x faster free finetuning | Num GPUs = 1
   \\   /|    Num examples = 4,685 | Num Epochs = 3
O^O/ \_/ \    Batch size per device = 2 | Gradient Accumulation steps = 4
\        /    Total batch size = 8 | Total steps = 1,755
 "-____-"     Number of trainable parameters = 83,886,080
 [1755/1755 51:20, Epoch 2/3]
Step	Training Loss
1	2.944300
2	2.910400
3	2.906500
4	2.902800
5	2.913200
6	2.866700
7	2.867500
8	2.862300
9	2.902400
10	2.943900
11	2.835800
12	2.887200
13	2.905100
14	2.842800
15	2.868200
16	2.831900
17	2.872600
18	2.822600
19	2.851600
20	3.046100
21	2.836300
22	2.831700
23	2.792300
24	2.832700
25	2.827000
26	2.808900
27	2.768000
28	2.760300
29	2.799200
30	2.836000
31	2.784600
32	2.778300
33	2.720100
34	2.754000
35	2.756100
36	2.700100
37	2.694000
38	2.722700
39	2.676500
40	2.668900
41	2.705800
42	2.652900
43	2.641200
44	2.632700
45	2.726500
46	2.662900
47	2.658400
48	2.597100
49	2.657900
50	2.578400
51	2.571000
52	3.062200
53	2.551800
54	2.542400
55	2.532400
56	2.595800
57	2.529100
58	2.564300
59	2.564800
60	2.539400
61	2.583000
62	2.468100
63	2.459600
64	2.466700
65	2.727600
66	2.540100
67	2.417800
68	2.458500
69	2.398800
70	2.390200
71	2.406800
72	2.368600
73	2.359900
74	2.400300
75	2.454300
76	2.377500
77	2.316500
78	2.308600
79	2.445400
80	2.285500
81	2.275600
82	2.266500
83	2.256000
84	2.368500
85	2.236400
86	2.362200
87	2.266000
88	2.388100
89	2.278100
90	2.227400
91	2.167100
92	2.157800
93	2.206300
94	2.259300
95	2.190800
96	2.244400
97	2.225000
98	2.096200
99	2.084900
100	2.071900
101	2.062100
102	2.209100
103	2.178900
104	2.030200
105	2.017900
106	2.006100
107	1.994900
108	1.986800
109	2.121900
110	1.959900
111	1.950300
112	1.939800
113	2.120700
114	1.916300
115	1.975800
116	1.889900
117	1.941500
118	1.936600
119	1.851300
120	1.941500
121	1.976400
122	1.966300
123	1.969400
124	1.789200
125	1.775700
126	1.831700
127	1.826800
128	1.936000
129	1.813900
130	1.798200
131	1.877400
132	1.682200
133	1.666800
134	1.653100
135	1.638200
136	1.736300
137	2.060800
138	1.672000
139	1.581700
140	1.569800
141	1.732900
142	1.541200
143	1.604700
144	1.624000
145	1.652700
146	1.483300
147	1.945100
148	1.561200
149	1.642300
150	1.426100
151	1.600500
152	1.398300
153	1.710000
154	1.496800
155	1.354100
156	1.595000
157	1.431600
158	1.307100
159	1.428000
160	1.551500
161	1.260000
162	1.245100
163	1.227700
164	1.208700
165	1.324800
166	1.499700
167	1.156300
168	1.362600
169	1.216600
170	1.611500
171	1.248100
172	1.165200
173	1.053700
174	1.140500
175	1.147200
176	0.999200
177	1.088700
178	1.095000
179	1.075200
180	1.059700
181	1.183400
182	0.888700
183	0.869300
184	0.847000
185	0.828900
186	0.944500
187	1.034100
188	0.767900
189	0.886800
190	0.871400
191	1.096600
192	0.688400
193	0.666900
194	0.912600
195	0.740300
196	0.610700
197	0.702400
198	0.719600
199	0.768600
200	0.533000
201	0.817500
202	0.667300
203	0.806400
204	0.619300
205	0.445900
206	0.429300
207	0.590700
208	0.395800
209	0.382600
210	0.364800
211	0.350600
212	0.494900
213	0.317800
214	0.646900
215	0.611100
216	0.518400
217	0.257600
218	0.408800
219	0.414100
220	0.464900
221	0.201400
222	0.188800
223	0.345100
224	0.295500
225	0.287700
226	0.449200
227	0.269400
228	0.303400
229	0.402000
230	0.115800
231	0.242900
232	0.105300
233	0.100400
234	0.237700
235	0.093900
236	0.091300
237	0.088600
238	0.086600
239	0.522000
240	0.082200
241	0.254600
242	0.516600
243	0.076900
244	0.472700
245	0.246300
246	0.072700
247	0.071200
248	0.264800
249	0.209300
250	0.262200
251	0.239800
252	1.039700
253	0.706000
254	0.062600
255	0.061700
256	0.393700
257	0.232300
258	0.452000
259	0.399700
260	0.056900
261	0.186400
262	0.054900
263	0.054000
264	0.640100
265	0.243200
266	0.180500
267	0.310100
268	0.049300
269	0.407000
270	0.215900
271	0.046700
272	0.183900
273	0.214000
274	0.044600
275	0.684800
276	0.231700
277	0.208600
278	0.375100
279	0.041300
280	0.040800
281	0.204400
282	0.165900
283	0.294900
284	0.039000
285	0.038600
286	0.038100
287	0.037600
288	0.222900
289	0.750600
290	0.309900
291	0.036300
292	0.159900
293	0.035900
294	0.035700
295	0.219700
296	0.157600
297	0.359100
298	0.485500
299	0.338700
300	0.191700
301	0.035000
302	0.034900
303	0.199700
304	0.034800
305	0.617400
306	0.034600
307	0.034500
308	0.954600
309	0.710700
310	0.034400
311	0.185900
312	0.214300
313	0.284000
314	0.034200
315	0.311800
316	0.034000
317	0.034000
318	0.034000
319	0.034000
320	0.195700
321	0.359200
322	0.034000
323	0.033800
324	0.033800
325	0.033800
326	0.166600
327	0.193500
328	0.369600
329	0.279500
330	0.033600
331	0.145400
332	0.209100
333	0.278600
334	0.301900
335	0.033500
336	0.033400
337	0.033400
338	0.333600
339	0.189200
340	0.273500
341	0.406000
342	0.033200
343	0.033300
344	0.175800
345	0.328600
346	0.033200
347	0.033200
348	0.033200
349	0.173400
350	0.273100
351	0.172400
352	0.204400
353	0.138000
354	0.033000
355	0.442500
356	0.353400
357	0.339000
358	0.032900
359	0.182200
360	0.269400
361	0.418000
362	0.032800
363	0.032800
364	0.032700
365	0.161800
366	0.032600
367	0.032600
368	0.165100
369	0.364700
370	0.289400
371	0.032500
372	0.032500
373	0.711300
374	0.263600
375	0.032500
376	0.162400
377	0.259100
378	0.032400
379	0.871900
380	0.032400
381	0.032300
382	0.157000
383	0.032300
384	0.032200
385	0.303300
386	0.155100
387	0.194900
388	0.130900
389	0.484400
390	0.032100
391	0.257300
392	0.032000
393	0.032000
394	0.032000
395	0.128700
396	0.151700
397	0.550000
398	0.253400
399	0.031900
400	0.031900
401	0.715900
402	0.960200
403	0.031800
404	0.031900
405	0.031800
406	0.248900
407	0.031800
408	0.247500
409	0.153000
410	0.332600
411	0.173900
412	0.031700
413	0.522100
414	0.151400
415	0.031600
416	0.031700
417	0.756800
418	0.031500
419	0.187500
420	0.146900
421	0.148500
422	0.534100
423	0.031500
424	0.171100
425	0.031500
426	0.184900
427	0.146100
428	0.031300
429	0.183400
430	0.257400
431	0.031300
432	0.235600
433	0.181100
434	0.168200
435	0.142900
436	0.142400
437	0.031100
438	0.031200
439	0.434300
440	0.031200
441	0.031100
442	0.231100
443	0.273400
444	0.031000
445	0.031000
446	0.031000
447	0.176000
448	0.031000
449	0.715600
450	0.030900
451	0.339900
452	0.030900
453	0.135000
454	0.030800
455	0.471200
456	0.030800
457	0.030800
458	0.030800
459	0.030600
460	0.172400
461	0.131300
462	0.162000
463	0.270800
464	0.170900
465	0.142400
466	0.244600
467	0.299200
468	0.141900
469	0.589100
470	0.030400
471	0.030400
472	0.030400
473	0.159200
474	0.125800
475	0.030400
476	0.259800
477	0.030400
478	0.647800
479	0.157300
480	0.271200
481	0.030200
482	0.030200
483	0.030200
484	0.030200
485	0.030200
486	0.120700
487	0.120300
488	0.030200
489	0.030000
490	0.303900
491	0.747900
492	0.231600
493	0.030000
494	0.292100
495	0.343300
496	0.213200
497	0.158800
498	0.333100
499	0.158200
500	0.113600
501	0.458300
502	0.737800
503	0.029900
504	0.150000
505	0.029900
506	0.307000
507	0.029700
508	0.181900
509	0.029700
510	0.153100
511	0.108100
512	0.029700
513	0.200600
514	0.151400
515	0.029600
516	0.146400
517	0.029600
518	0.197700
519	0.315800
520	0.148000
521	0.195300
522	0.261900
523	0.198900
524	0.128500
525	0.191500
526	0.098900
527	0.304000
528	0.188800
529	0.029500
530	0.126500
531	0.029500
532	0.029500
533	0.101800
534	0.409900
535	0.029500
536	0.385500
537	0.233300
538	0.029400
539	0.029300
540	0.141000
541	0.177900
542	0.029300
543	0.099000
544	0.098400
545	0.029300
546	0.197900
547	0.029200
548	0.029200
549	0.234600
550	0.029100
551	0.094400
552	0.029100
553	0.029100
554	0.138500
555	0.191900
556	0.132700
557	0.029000
558	0.029000
559	0.029000
560	0.193900
561	0.028900
562	0.119100
563	0.028900
564	0.118500
565	0.028800
566	0.117300
567	0.169700
568	0.028800
569	0.115400
570	0.028700
571	0.114000
572	0.028700
573	0.088000
574	0.166600
575	0.110500
576	0.028700
577	0.108900
578	0.028700
579	0.476500
580	0.028500
581	0.028500
582	0.028500
583	0.268600
584	0.028500
585	0.028500
586	0.133800
587	0.078600
588	0.028400
589	0.028400
590	0.099700
591	0.028400
592	0.098100
593	0.028300
594	0.158000
595	0.028200
596	0.131600
597	0.186500
598	0.156000
599	0.257400
600	0.092600
601	0.153600
602	0.125000
603	0.361000
604	0.129000
605	0.028000
606	0.028000
607	0.028000
608	0.147000
609	0.028000
610	0.028000
611	0.028000
612	0.027800
613	0.129200
614	0.027800
615	0.027800
616	0.141500
617	0.073500
618	0.076800
619	0.027700
620	0.176900
621	0.071900
622	0.027700
623	0.027700
624	0.027700
625	0.073500
626	0.027600
627	0.124100
628	0.081300
629	0.135500
630	0.118200
631	0.027600
632	0.411900
633	0.116800
634	0.077900
635	0.066100
636	0.027400
637	0.027400
638	0.105800
639	0.068100
640	0.196300
641	0.027400
642	0.027400
643	0.027200
644	0.027200
645	0.071700
646	0.305300
647	0.027200
648	0.027200
649	0.063600
650	0.027100
651	0.120600
652	0.105200
653	0.027100
654	0.061400
655	0.353700
656	0.027100
657	0.027000
658	0.066500
659	0.027000
660	0.131100
661	0.027000
662	0.161900
663	0.026900
664	0.250900
665	0.059900
666	0.026900
667	0.026800
668	0.026900
669	0.026800
670	0.026800
671	0.188000
672	0.056100
673	0.026700
674	0.271100
675	0.026600
676	0.054600
677	0.026700
678	0.026600
679	0.026600
680	0.082500
681	0.211700
682	0.026400
683	0.087900
684	0.026400
685	0.729500
686	0.237400
687	0.142700
688	0.026300
689	0.091100
690	0.026200
691	0.026200
692	0.119600
693	0.089100
694	0.026100
695	0.304600
696	0.026100
697	0.050300
698	0.138300
699	0.026100
700	0.026000
701	0.051900
702	0.026000
703	0.052000
704	0.025900
705	0.025900
706	0.052900
707	0.196600
708	0.111500
709	0.071300
710	0.110700
711	0.025700
712	0.108100
713	0.025700
714	0.025700
715	0.214300
716	0.047400
717	0.125400
718	0.222200
719	0.025600
720	0.131400
721	0.078100
722	0.077100
723	0.157700
724	0.025500
725	0.045700
726	0.047600
727	0.025500
728	0.025500
729	0.046400
730	0.025500
731	0.025400
732	0.025400
733	0.025400
734	0.071200
735	0.099700
736	0.110700
737	0.025300
738	0.120900
739	0.025300
740	0.025300
741	0.097100
742	0.112100
743	0.124700
744	0.066400
745	0.039800
746	0.043200
747	0.025100
748	0.025100
749	0.025000
750	0.184700
751	0.037400
752	0.024900
753	0.024900
754	0.045800
755	0.024900
756	0.045200
757	0.024800
758	0.024800
759	0.035500
760	0.043600
761	0.024700
762	0.042700
763	0.041100
764	0.024700
765	0.086500
766	0.024600
767	0.024600
768	0.084500
769	0.099200
770	0.082700
771	0.096100
772	0.095000
773	0.033900
774	0.024500
775	0.112600
776	0.123400
777	0.024400
778	0.061000
779	0.142600
780	0.024300
781	0.036700
782	0.024200
783	0.024200
784	0.024100
785	0.107200
786	0.037800
787	0.024000
788	0.035000
789	0.024000
790	0.024000
791	0.024000
792	0.024000
793	0.094000
794	0.068600
795	0.059100
796	0.066000
797	0.057000
798	0.101900
799	0.042200
800	0.023800
801	0.054300
802	0.023700
803	0.091000
804	0.090600
805	0.023700
806	0.087500
807	0.032400
808	0.023500
809	0.023500
810	0.031600
811	0.234400
812	0.023300
813	0.023300
814	0.023300
815	0.040200
816	0.023300
817	0.031200
818	0.073900
819	0.023100
820	0.023100
821	0.071000
822	0.023100
823	0.030800
824	0.023100
825	0.023000
826	0.022900
827	0.049900
828	0.091200
829	0.034700
830	0.041900
831	0.030900
832	0.030900
833	0.089500
834	0.022500
835	0.022500
836	0.032700
837	0.022400
838	0.037800
839	0.040300
840	0.079400
841	0.056000
842	0.029700
843	0.029600
844	0.077600
845	0.054500
846	0.076500
847	0.022000
848	0.022000
849	0.029300
850	0.022000
851	0.073800
852	0.021800
853	0.038200
854	0.038200
855	0.021700
856	0.036300
857	0.021600
858	0.029100
859	0.021600
860	0.028600
861	0.034100
862	0.106700
863	0.021300
864	0.030300
865	0.021100
866	0.021300
867	0.021100
868	0.060400
869	0.021300
870	0.032400
871	0.038600
872	0.028000
873	0.043300
874	0.021000
875	0.020700
876	0.020600
877	0.020500
878	0.020600
879	0.020600
880	0.020400
881	0.027100
882	0.042100
883	0.070400
884	0.072900
885	0.020300
886	0.020100
887	0.020000
888	0.027000
889	0.072900
890	0.066200
891	0.020000
892	0.020000
893	0.039900
894	0.035000
895	0.019600
896	0.025900
897	0.019500
898	0.019200
899	0.026700
900	0.019100
901	0.025600
902	0.019000
903	0.025500
904	0.019000
905	0.079200
906	0.043000
907	0.018600
908	0.035400
909	0.018700
910	0.040200
911	0.018400
912	0.018400
913	0.059600
914	0.026000
915	0.025900
916	0.018200
917	0.025200
918	0.024600
919	0.030800
920	0.057400
921	0.031300
922	0.017800
923	0.017900
924	0.017800
925	0.068000
926	0.017700
927	0.062600
928	0.017700
929	0.029800
930	0.023800
931	0.017400
932	0.024700
933	0.052300
934	0.017100
935	0.051300
936	0.066200
937	0.080700
938	0.017100
939	0.017100
940	0.049300
941	0.022700
942	0.061900
943	0.022800
944	0.022300
945	0.033600
946	0.047700
947	0.016600
948	0.016200
949	0.016100
950	0.046200
951	0.029200
952	0.045500
953	0.054900
954	0.026300
955	0.051100
956	0.022100
957	0.043800
958	0.048700
959	0.015300
960	0.015300
961	0.015200
962	0.015100
963	0.032300
964	0.022000
965	0.022000
966	0.023700
967	0.014900
968	0.021600
969	0.026500
970	0.039500
971	0.018800
972	0.014600
973	0.020900
974	0.024500
975	0.031000
976	0.020700
977	0.013900
978	0.013800
979	0.025200
980	0.019500
981	0.017600
982	0.017600
983	0.013500
984	0.023400
985	0.017100
986	0.036600
987	0.017200
988	0.016900
989	0.013000
990	0.059000
991	0.012800
992	0.026500
993	0.018600
994	0.012600
995	0.018500
996	0.012300
997	0.012100
998	0.018300
999	0.011900
1000	0.017600
1001	0.046000
1002	0.017700
1003	0.046400
1004	0.017100
1005	0.014800
1006	0.011200
1007	0.030900
1008	0.011000
1009	0.014100
1010	0.010300
1011	0.055300
1012	0.031300
1013	0.013600
1014	0.010100
1015	0.010000
1016	0.009600
1017	0.025300
1018	0.009400
1019	0.014900
1020	0.020800
1021	0.014900
1022	0.008500
1023	0.012200
1024	0.022100
1025	0.029100
1026	0.007800
1027	0.053400
1028	0.014100
1029	0.028500
1030	0.007600
1031	0.007200
1032	0.007900
1033	0.037200
1034	0.011300
1035	0.007100
1036	0.027000
1037	0.028700
1038	0.018200
1039	0.006500
1040	0.031600
1041	0.029700
1042	0.005900
1043	0.011700
1044	0.011100
1045	0.005300
1046	0.022000
1047	0.011400
1048	0.005200
1049	0.016100
1050	0.005300
1051	0.011000
1052	0.048400
1053	0.008700
1054	0.016300
1055	0.004600
1056	0.041400
1057	0.008200
1058	0.004100
1059	0.009400
1060	0.009300
1061	0.021600
1062	0.009900
1063	0.015000
1064	0.009500
1065	0.020900
1066	0.020700
1067	0.014000
1068	0.014900
1069	0.009000
1070	0.014000
1071	0.014300
1072	0.002800
1073	0.008500
1074	0.006400
1075	0.007900
1076	0.002300
1077	0.002300
1078	0.001600
1079	0.001600
1080	0.010600
1081	0.001400
1082	0.007700
1083	0.008000
1084	0.024200
1085	0.005900
1086	0.012000
1087	0.001300
1088	0.001200
1089	0.014200
1090	0.001000
1091	0.012900
1092	0.000900
1093	0.000900
1094	0.000900
1095	0.000800
1096	0.007800
1097	0.000800
1098	0.007400
1099	0.048300
1100	0.000700
1101	0.007800
1102	0.005600
1103	0.012900
1104	0.005500
1105	0.007700
1106	0.005400
1107	0.007700
1108	0.000600
1109	0.007100
1110	0.012900
1111	0.000900
1112	0.017400
1113	0.005400
1114	0.000600
1115	0.005300
1116	0.000600
1117	0.011800
1118	0.007600
1119	0.023500
1120	0.000900
1121	0.000600
1122	0.016800
1123	0.012800
1124	0.007100
1125	0.046300
1126	0.000600
1127	0.000700
1128	0.023100
1129	0.000600
1130	0.000700
1131	0.007000
1132	0.007400
1133	0.015800
1134	0.007300
1135	0.006900
1136	0.006900
1137	0.011900
1138	0.033100
1139	0.000600
1140	0.015100
1141	0.006800
1142	0.005100
1143	0.014900
1144	0.000700
1145	0.021200
1146	0.000700
1147	0.000700
1148	0.006800
1149	0.013700
1150	0.000700
1151	0.000700
1152	0.000600
1153	0.005000
1154	0.006700
1155	0.012700
1156	0.006500
1157	0.000900
1158	0.006900
1159	0.001000
1160	0.001000
1161	0.023600
1162	0.001000
1163	0.001000
1164	0.004900
1165	0.001000
1166	0.000900
1167	0.000900
1168	0.006400
1169	0.000800
1170	0.006400
1171	0.006300
1172	0.000800
1173	0.000800
1174	0.000800
1175	0.024600
1176	0.000700
1177	0.004700
1178	0.000700
1179	0.031500
1180	0.017500
1181	0.004900
1182	0.006800
1183	0.007100
1184	0.000700
1185	0.004700
1186	0.000700
1187	0.010300
1188	0.006700
1189	0.012700
1190	0.004600
1191	0.000600
1192	0.000600
1193	0.013400
1194	0.006100
1195	0.010600
1196	0.013300
1197	0.000600
1198	0.009900
1199	0.000600
1200	0.010600
1201	0.000600
1202	0.006200
1203	0.000600
1204	0.006600
1205	0.025300
1206	0.000600
1207	0.000600
1208	0.006100
1209	0.005900
1210	0.018000
1211	0.006100
1212	0.006600
1213	0.000600
1214	0.016600
1215	0.004400
1216	0.012700
1217	0.005800
1218	0.000600
1219	0.000600
1220	0.012800
1221	0.004400
1222	0.000600
1223	0.012600
1224	0.000600
1225	0.000600
1226	0.000600
1227	0.000700
1228	0.012500
1229	0.005900
1230	0.000700
1231	0.006300
1232	0.005700
1233	0.016200
1234	0.021900
1235	0.004300
1236	0.000700
1237	0.000700
1238	0.000600
1239	0.000600
1240	0.000600
1241	0.000600
1242	0.012800
1243	0.000600
1244	0.005600
1245	0.000600
1246	0.000600
1247	0.012400
1248	0.000600
1249	0.012300
1250	0.006400
1251	0.000600
1252	0.000600
1253	0.012300
1254	0.022400
1255	0.015800
1256	0.017400
1257	0.006300
1258	0.011500
1259	0.000600
1260	0.000600
1261	0.012300
1262	0.000600
1263	0.004200
1264	0.000600
1265	0.012300
1266	0.006300
1267	0.000600
1268	0.000600
1269	0.012200
1270	0.004100
1271	0.006200
1272	0.005700
1273	0.000600
1274	0.011900
1275	0.005700
1276	0.005700
1277	0.011900
1278	0.006200
1279	0.000600
1280	0.010500
1281	0.000600
1282	0.011800
1283	0.011800
1284	0.000600
1285	0.005600
1286	0.000700
1287	0.000700
1288	0.009600
1289	0.000700
1290	0.011700
1291	0.008700
1292	0.000700
1293	0.006100
1294	0.005300
1295	0.005300
1296	0.000600
1297	0.012000
1298	0.010300
1299	0.011700
1300	0.005500
1301	0.048300
1302	0.005500
1303	0.000600
1304	0.005500
1305	0.000600
1306	0.005500
1307	0.005500
1308	0.010900
1309	0.006000
1310	0.010500
1311	0.005200
1312	0.005900
1313	0.012900
1314	0.005800
1315	0.005000
1316	0.001100
1317	0.001100
1318	0.001100
1319	0.001100
1320	0.012400
1321	0.001200
1322	0.001200
1323	0.005700
1324	0.005700
1325	0.000800
1326	0.000700
1327	0.004900
1328	0.000800
1329	0.000800
1330	0.016900
1331	0.000600
1332	0.000600
1333	0.000500
1334	0.003800
1335	0.009500
1336	0.000500
1337	0.000500
1338	0.003800
1339	0.016400
1340	0.016400
1341	0.005000
1342	0.011700
1343	0.011600
1344	0.005300
1345	0.012100
1346	0.000600
1347	0.000600
1348	0.000600
1349	0.000500
1350	0.005200
1351	0.010000
1352	0.011400
1353	0.000600
1354	0.003800
1355	0.013800
1356	0.000600
1357	0.000600
1358	0.000500
1359	0.011900
1360	0.005300
1361	0.055500
1362	0.014500
1363	0.000600
1364	0.015000
1365	0.011200
1366	0.005700
1367	0.004800
1368	0.000600
1369	0.004800
1370	0.000700
1371	0.000700
1372	0.003700
1373	0.000700
1374	0.000600
1375	0.000600
1376	0.000600
1377	0.005700
1378	0.009900
1379	0.011200
1380	0.041400
1381	0.000600
1382	0.003700
1383	0.022200
1384	0.000600
1385	0.000600
1386	0.000600
1387	0.000600
1388	0.014100
1389	0.000600
1390	0.000600
1391	0.000600
1392	0.016800
1393	0.011600
1394	0.003900
1395	0.005200
1396	0.005900
1397	0.003700
1398	0.051200
1399	0.000600
1400	0.000600
1401	0.005500
1402	0.037200
1403	0.005900
1404	0.011000
1405	0.005100
1406	0.020900
1407	0.014300
1408	0.000400
1409	0.000400
1410	0.014200
1411	0.010900
1412	0.014800
1413	0.005100
1414	0.015800
1415	0.008500
1416	0.014600
1417	0.011400
1418	0.000700
1419	0.015000
1420	0.050200
1421	0.000700
1422	0.008800
1423	0.000700
1424	0.005600
1425	0.000800
1426	0.004500
1427	0.000900
1428	0.003500
1429	0.009200
1430	0.000800
1431	0.011300
1432	0.003500
1433	0.011300
1434	0.011300
1435	0.000900
1436	0.000800
1437	0.000800
1438	0.000800
1439	0.005500
1440	0.000800
1441	0.005000
1442	0.018000
1443	0.000700
1444	0.005000
1445	0.018600
1446	0.000800
1447	0.000800
1448	0.005000
1449	0.005700
1450	0.014200
1451	0.010600
1452	0.000500
1453	0.000400
1454	0.015200
1455	0.005200
1456	0.005700
1457	0.003600
1458	0.003600
1459	0.000400
1460	0.000800
1461	0.000500
1462	0.000700
1463	0.000700
1464	0.000600
1465	0.010900
1466	0.010800
1467	0.005000
1468	0.005600
1469	0.003500
1470	0.000400
1471	0.010400
1472	0.000500
1473	0.005600
1474	0.004500
1475	0.000500
1476	0.018800
1477	0.004400
1478	0.008300
1479	0.005400
1480	0.000700
1481	0.005500
1482	0.007600
1483	0.013500
1484	0.000700
1485	0.004800
1486	0.008600
1487	0.000600
1488	0.003300
1489	0.004800
1490	0.000600
1491	0.000600
1492	0.000600
1493	0.015000
1494	0.017200
1495	0.010900
1496	0.010700
1497	0.004300
1498	0.013400
1499	0.000600
1500	0.004300
1501	0.004800
1502	0.013100
1503	0.010600
1504	0.015400
1505	0.000600
1506	0.004700
1507	0.004700
1508	0.000600
1509	0.000600
1510	0.000600
1511	0.010400
1512	0.000700
1513	0.000700
1514	0.000700
1515	0.010400
1516	0.014400
1517	0.003300
1518	0.000700
1519	0.000700
1520	0.000700
1521	0.000800
1522	0.000700
1523	0.005300
1524	0.000700
1525	0.000700
1526	0.000700
1527	0.004800
1528	0.000500
1529	0.004900
1530	0.000500
1531	0.000400
1532	0.005000
1533	0.000400
1534	0.000300
1535	0.003500
1536	0.003500
1537	0.003500
1538	0.014800
1539	0.005700
1540	0.000300
1541	0.000300
1542	0.000300
1543	0.010400
1544	0.000400
1545	0.013200
1546	0.000400
1547	0.000400
1548	0.005100
1549	0.032200
1550	0.015700
1551	0.000400
1552	0.010000
1553	0.014200
1554	0.044500
1555	0.000600
1556	0.004200
1557	0.004500
1558	0.007400
1559	0.000700
1560	0.009900
1561	0.000700
1562	0.000700
1563	0.014600
1564	0.005300
1565	0.009800
1566	0.003200
1567	0.000700
1568	0.005300
1569	0.000700
1570	0.023700
1571	0.004200
1572	0.000700
1573	0.000700
1574	0.010000
1575	0.005400
1576	0.000500
1577	0.012400
1578	0.004300
1579	0.000500
1580	0.035600
1581	0.000500
1582	0.000500
1583	0.004800
1584	0.000500
1585	0.014800
1586	0.000500
1587	0.000500
1588	0.000500
1589	0.000500
1590	0.000500
1591	0.004800
1592	0.000400
1593	0.000500
1594	0.010000
1595	0.009600
1596	0.009500
1597	0.003400
1598	0.000400
1599	0.000400
1600	0.000400
1601	0.000400
1602	0.000400
1603	0.003300
1604	0.005500
1605	0.009000
1606	0.000400
1607	0.005500
1608	0.004900
1609	0.010000
1610	0.000400
1611	0.000400
1612	0.009400
1613	0.010000
1614	0.004900
1615	0.000400
1616	0.016900
1617	0.005300
1618	0.000500
1619	0.000500
1620	0.009200
1621	0.037300
1622	0.004000
1623	0.005200
1624	0.000700
1625	0.003200
1626	0.000700
1627	0.000700
1628	0.004000
1629	0.005200
1630	0.000600
1631	0.004000
1632	0.008500
1633	0.000600
1634	0.000600
1635	0.004500
1636	0.009600
1637	0.000600
1638	0.005700
1639	0.021400
1640	0.000600
1641	0.004000
1642	0.000600
1643	0.003900
1644	0.005000
1645	0.000500
1646	0.044500
1647	0.000800
1648	0.007200
1649	0.000800
1650	0.004400
1651	0.000800
1652	0.003100
1653	0.000800
1654	0.009600
1655	0.009900
1656	0.003800
1657	0.000600
1658	0.006400
1659	0.000600
1660	0.009200
1661	0.005100
1662	0.003100
1663	0.003900
1664	0.000600
1665	0.003000
1666	0.000500
1667	0.014600
1668	0.008100
1669	0.004400
1670	0.003000
1671	0.000700
1672	0.000700
1673	0.000400
1674	0.009300
1675	0.003000
1676	0.009600
1677	0.009600
1678	0.000400
1679	0.007900
1680	0.000500
1681	0.013600
1682	0.003000
1683	0.007700
1684	0.004400
1685	0.009900
1686	0.006700
1687	0.003700
1688	0.000700
1689	0.004400
1690	0.000700
1691	0.000700
1692	0.005000
1693	0.003000
1694	0.000700
1695	0.004400
1696	0.003700
1697	0.013500
1698	0.004900
1699	0.009100
1700	0.004400
1701	0.005000
1702	0.009700
1703	0.009900
1704	0.008000
1705	0.005600
1706	0.009900
1707	0.001600
1708	0.085800
1709	0.001600
1710	0.001200
1711	0.001200
1712	0.014700
1713	0.009800
1714	0.001000
1715	0.008600
1716	0.009800
1717	0.020800
1718	0.000800
1719	0.007900
1720	0.043000
1721	0.004300
1722	0.003700
1723	0.000800
1724	0.000800
1725	0.007800
1726	0.017700
1727	0.000900
1728	0.006400
1729	0.000900
1730	0.005000
1731	0.003000
1732	0.000600
1733	0.004400
1734	0.004400
1735	0.013200
1736	0.009200
1737	0.000600
1738	0.013100
1739	0.011300
1740	0.009400
1741	0.000600
1742	0.000600
1743	0.000600
1744	0.000600
1745	0.003000
1746	0.041600
1747	0.011400
1748	0.013500
1749	0.004400
1750	0.009000
1751	0.000700
1752	0.009000
1753	0.003800
1754	0.003800
1755	0.003800
```