It doesn't matter if you blow dry your hair frequently or only occasionally; either way, it can damage your hair. Ideally, you should avoid blow drying at all costs or wait as long as you can between sessions.