You should practice drums every single day. These sessions don't all have to be long. As little as 10 minutes can make big differences over time, so long as you're practicing daily.