Distily Project

community

https://github.com/lapp0/distily

AI & ML interests

None defined yet.

models 52

distily/distily_smollm_dataset_sweep

Updated Sep 30, 2024 • 5

distily/distily_tinyBenchmarks

Updated Sep 23, 2024

distily/distily_learning_params

Updated Sep 22, 2024 • 2

distily/distily_seq_len_batch_size

Updated Sep 17, 2024 • 1

distily/distily_distsmollm_max_length

Updated Sep 14, 2024 • 1

distily/distily_distsmollm_long

Updated Sep 14, 2024 • 1

distily/distily_additional_profiling

Updated Sep 13, 2024

distily/distily_profile_smollm_tritoned

Updated Sep 12, 2024 • 1

distily/distily_profile_smollm

Updated Sep 12, 2024 • 3

distily/distily_verify_new_attns

Updated Sep 12, 2024 • 1

datasets 10

distily/filtered_redpajama_en

Viewer • Updated Sep 7, 2024 • 2.21M • 64

distily/filtered_redpajama_multilingual

Viewer • Updated Sep 7, 2024 • 2.86M • 163 • 1

distily/synth_gpt2_t1_seq_1M

Viewer • Updated Aug 27, 2024 • 1M • 41

distily/synth_gpt2_ted_seq_100

Viewer • Updated Aug 26, 2024 • 1k • 25

distily/synth_gpt2_t1_seq_100K

Updated Aug 26, 2024 • 21

distily/synth_gpt2_ted_seq_100K

Viewer • Updated Aug 26, 2024 • 100k • 18

distily/synth_test

Viewer • Updated Aug 26, 2024 • 1k • 22

distily/synth_tdecay_gpt2_seq_1K

Viewer • Updated Aug 26, 2024 • 1k • 22

distily/synthetic_gpt2_sequences_1K

Viewer • Updated Aug 26, 2024 • 1k • 27

distily/c4_multilingual_1M

Viewer • Updated Aug 19, 2024 • 1M • 109 • 1