Yes, a magic eraser can be very abrasive and is not designed to be used on paint, so should be avoided.