One treatment that often works well is to use a warm compress. Also be sure to keep the affected area clean to help the acne clear up more quickly.
Acne products formulated with benzoyl peroxide or salicylic acid can also be effective at clearing up underarm blackheads.