Datasets processed from MOSS for Fine-Tuning
Matthew Khoriaty
AMindToThink
AI & ML interests
None yet
Recent Activity
updated
a collection
4 days ago
MOSS Processed Data
updated
a collection
4 days ago
MOSS Processed Data
updated
a dataset
5 days ago
AMindToThink/moss-002-sft-data-instruction-output-ascii-only
Organizations
None yet
Collections
2
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • Updated • 9 -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • Updated • 10 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • Updated • 7 -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • Updated • 6
models
106
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr2.2e-06-beta0.1-20250301-0629
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr5.0e-06-beta0.05-20250301-0604
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr1.2e-05-beta0.2-20250301-0539
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr2.8e-05-beta0.2-20250301-0514
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr1.9e-05-beta0.15-20250301-0449
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr1.1e-05-beta0.2-20250301-0424
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr1.0e-06-beta0.15-20250301-0359
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr4.4e-06-beta0.05-20250301-0334
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr1.1e-06-beta0.2-20250301-0308
Updated
AMindToThink/GEMMA-2-2B-FT-ORPO-ISAERFT_gemma-2-2b-lr6.1e-06-beta0.2-20250301-0243
Updated
datasets
7
AMindToThink/moss-002-sft-data-instruction-output-ascii-only
Viewer
•
Updated
•
1.75M
•
45
AMindToThink/openthoughts-as-assistant-for-sft
Viewer
•
Updated
•
114k
•
45
AMindToThink/common_bugs
Viewer
•
Updated
•
45
•
173
AMindToThink/moss-002-sft-data-instruction-output
Viewer
•
Updated
•
3.53M
•
160
AMindToThink/mmlu_wmdp_combined
Viewer
•
Updated
•
4.74k
•
56
AMindToThink/mmlu_wmdp_bio_combined
Viewer
•
Updated
•
1.43k
•
57
AMindToThink/wmdp-cyber-corpus_unpaired-preference
Viewer
•
Updated
•
5.47k
•
42