SiliangZ/RM_mistral_irl2_initilized_from_sft_lr_5e7_idpo
Updated
•
15
Siliang Zeng
SiliangZ
AI & ML interests
Alignment, RLHF, LLM
Recent Activity
updated
a model
about 1 month ago
SiliangZ/RM_mistral_irl2_initilized_from_sft_lr_5e7_idpo
updated
a model
about 1 month ago
SiliangZ/RM_mistral_irl2_initilized_from_irl1_rm_lr_5e7_idpo
updated
a model
about 1 month ago
SiliangZ/RM_mistral_7b_sft_beta_ultrachat_200k_mistral_sft_temp07_lr_5e7
Organizations
models
13
SiliangZ/RM_mistral_irl2_initilized_from_irl1_rm_lr_5e7_idpo
Updated
•
15
SiliangZ/RM_mistral_7b_sft_beta_ultrachat_200k_mistral_sft_temp07_lr_5e7
Updated
•
13
SiliangZ/mistral-7b-sft-beta-rm-mistral-sft-temp07-lr-5e7-iter1
Text Generation
•
Updated
•
313
SiliangZ/RM_iter1_temp07_and_temp1_ACC_707
Updated
•
2
SiliangZ/IRL_RM_Iter1_temp07_temp1_zephyr_init
Updated
•
2
SiliangZ/IRL_RM_Iter1_temp07_temp1
Updated
•
2
SiliangZ/IRL_Iter0_RM_ultrachat_200k_vs_sft_with_spin_iter0_checkpoint_232
Text Generation
•
Updated
•
12
SiliangZ/zephyr-7b-sft-full
Updated
SiliangZ/IRL_Iter0_Policy_Epoch5_RM_Data_SPIN_Iter0
Text Generation
•
Updated
•
13
datasets
24
SiliangZ/mistral_irl2_rm_data_combined_idpo
Viewer
•
Updated
•
416k
•
29
SiliangZ/AIHF_Online_RLHF_Iter2
Viewer
•
Updated
•
20k
•
29
SiliangZ/AIHF_Online_RLHF_Iter1
Viewer
•
Updated
•
20k
•
30
SiliangZ/ultrafeedback_with_demo_sft_pairs_temp07
Viewer
•
Updated
•
269k
•
30
SiliangZ/ultrachat_200k_mistral_sft_iter1_iter2_temp1_generations
Viewer
•
Updated
•
624k
•
36
SiliangZ/ultrachat_200k_mistral_sft_temp1_iter1
Viewer
•
Updated
•
416k
•
30
SiliangZ/ultrachat_200k_mistral_sft_and_mistral_irl1_round1_temp07
Viewer
•
Updated
•
416k
•
28
•
1
SiliangZ/ultrachat_200k_mistral_sft_temp1
Viewer
•
Updated
•
231k
•
30
SiliangZ/ultrachat_200k_mistral_sft_temp07
Viewer
•
Updated
•
231k
•
28
SiliangZ/TLDR_Preference_2
Viewer
•
Updated
•
233k
•
32