Don't calculate A in the last 4 of 61 rounds.
Calculate only the H word of the hash.
Precalculate the first three rounds.

Only the fourth and subsequent rounds depend on the nonce.