Tradeoff energy bost / performance

#2
by cerisara - opened

Thanks for this great tool that enables us to compute the energy cost of our LLM, very useful.
But the leaderboard shows ranks only according to the energy cost, while the most important is obviously the tradeoff between energy cost and performance. Isn't there a way to measure this tradeoff? Otherwise, we should all use distilgpt2 ! ;-)

Thank you,
Christophe

Sign up or log in to comment