Try using plastic wrap to cover the bowl rather than a kitchen towel. The plastic will seal in the warm air much better and prevents any draft from entering. Try placing the bowl inside a cupboard or the pantry while it is rising, as this will stop the draft from entering too. Plastic wrap is also a good option over the yeast when proofing it.