Instead of going through the mining animation, you can wield a pickaxe and attack the ore vein instead. However, the difference in mining speed is pretty minimal.