WiFi Guard and Wi-Fi Blocker are third-party apps that will help kick people off your network. But you could also change your Wi-Fi password, which is more secure because these apps require access to your router in order to work.