Sometimes, you can get away without using primer and allow the first coat or two of paint to serve as a primer of sorts. However, this will only work on surfaces that are relatively smooth and undamaged already. \
Otherwise, you may need more than two coats of paint to get a nice, even look and smooth coverage. By the time you're on the third or fourth coat of paint, you probably would have saved yourself some time by priming first. \