The Fat Boy 103 and 107 differ mainly in engine size; the 103 has a 1690cc engine, while the 107 boasts a 1745cc engine, offering more power and torque.