Keratosis pilaris is recalcitrant to treatment. Keratolytics can be of some help. You can try preparations containing salicylic acid and urea.