No, adding a switch will actually improve your overall network performance by keeping high-bandwidth wired devices off the wireless network, reducing congestion for WiFi clients.