I believe that a different base in the log only changes the "information unit" of the entropy. If you are computing the entropy a binary random variable, then it is probably more common to use the base 2 in the log.

Anyway, as you already have just mentioned, since we are finally using this entropy to make a decision based on a comparison between entropies and not an absolute value, it should not really make a difference *in this case*.