Di He

DiHe 's models 60

Sort:  Recently updated

DiHe/LLR-100B

Text Generation • 1B • Updated Feb 28 • 109

DiHe/adamw-r0_0005-100b

Text Generation • 1B • Updated Feb 28 • 17

DiHe/adamw-r0_0005-20b

Updated Jan 27 • 11

DiHe/LLR-20B

Updated Jan 26 • 8

DiHe/sharpness-20B

Updated Jan 26 • 8

DiHe/Lars-20B

Updated Jan 26 • 8

DiHe/Lamb-20B

Updated Jan 26 • 8

DiHe/t5-1024-LLR0-130M-lr0_001-1-5

Updated Jan 26

DiHe/t5-1024-lamb-130M-lr0_05-test

Updated Jan 26

DiHe/t5-1024-lamb-130M-lr0_01-test

Text Generation • 0.1B • Updated Jan 26 • 18

DiHe/t5-1024-adamw-130M-lr0_001-test

Updated Jan 26

DiHe/llama_1b-2025-11-17-22-21-39-LLR-adamw-lr0_0005-WD0_1-1b-20b

Updated Nov 20, 2025 • 7

DiHe/llama_1b-2025-11-14-10-03-54-Uniform-adamw-lr0_0005-WD0_1-1b-20b

Updated Nov 19, 2025 • 8

DiHe/llama_7b-2025-11-15-20-22-13-Uniform-adamw-lr0_0002-WD0_1-7b-10b

Updated Nov 18, 2025 • 5

DiHe/llama_7b-2025-11-13-20-41-14-LLR-adamw-lr0_0002-WD0_1-7b-10b

Updated Nov 17, 2025 • 6

DiHe/llama_7b-2025-11-15-03-18-28-Uniform-adamw-lr0_0002-WD0_1-7b-model_15000

Updated Nov 15, 2025 • 3

DiHe/step0-unsharded

Updated Oct 15, 2025 • 1

DiHe/llama_350m-2025-09-10-02-18-27-adamw-Uniform-350M-lr0_001-WD0_1-90k

Updated Sep 12, 2025

DiHe/llama_350m-2025-09-07-11-12-19-muon-uniform-350M-lr0_01-WD0_1

Text Generation • 0.4B • Updated Sep 9, 2025 • 12

DiHe/llama_350m-2025-09-07-12-32-16-muon-uniform-350M-lr0_03-WD0_1

Text Generation • 0.4B • Updated Sep 9, 2025 • 8

DiHe/llama_350m-2025-09-07-12-32-16-grad_0_05-0_2_muon-unb3-350M-lr0_01-WD0_1

Text Generation • 0.4B • Updated Sep 9, 2025 • 8

DiHe/llama_350m-2025-09-07-11-12-18-grad_0_05-0_2_muon-unb1-350M-lr0_01-WD0_1

Text Generation • 0.4B • Updated Sep 9, 2025 • 8

DiHe/llama_350m-2025-09-07-09-42-24-grad_adamw-unb3-350M-lr0_001-WD0_1

Text Generation • 0.4B • Updated Sep 9, 2025 • 8

DiHe/llama_1b-2025-09-08-02-15-06-adamw-ours-pos2-1B-lr0_0005-WD0_1

Text Generation • 1B • Updated Sep 9, 2025 • 10

DiHe/llama_350m-2025-09-07-01-39-48-grad_adamw-unb1-350M-lr0_002-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 14

DiHe/llama_350m-2025-09-07-01-39-30-grad_adamw-unb2-350M-lr0_001-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 17

DiHe/llama_350m-2025-09-06-19-00-06-adamw-Uniform-350M-lr0_008-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 14

DiHe/llama_350m-2025-08-31-03-31-25-adamw-Uniform-350M-lr0_003-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 18

DiHe/llama_350m-2025-08-31-03-31-23-adamw-Uniform-350M-lr0_001-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 15

DiHe/llama_350m-2025-08-30-06-07-36-adamw-Uniform-350M-lr0_002-WD0_1

Text Generation • 0.4B • Updated Sep 7, 2025 • 19