Rectangular form represents complex numbers as a pair of real numbers (a, b) where a represents the real part and b represents the imaginary part, while polar form represents complex numbers using their magnitude and angle in relation to the positive real axis.