Even for rough textures, start with the 60- to 80-grit sandpaper, but finish the job with a finer sandpaper to avoid damage. Use 120- to 150-grit sandpaper if you've first sprayed and scraped away the wall. The sandpaper will help smooth out the surface before you add a new coat of paint.