33B is the number of parameters printed by print_trainable_parameters
#2
by
simsim314
- opened
I am just wondering why all params output from 65B model print_trainable_parameters is 32931848192?
I guess this is a question to llama model even more, but I guess print_trainable_parameters is Guanaco related function, and the bug could be there.
simsim314
changed discussion title from
33B is the number of parameters printed by `print_trainable_parameters`
to 33B is the number of parameters printed by print_trainable_parameters
This comment has been hidden