If you don't use a primer, the paint may not stick properly to the surface, which can potentially lead to peeling and an uneven finish.