First and foremost keep your balcony neat and clear. Grow spider repellent plants like herbs mints, basal. In a bad situation spray spider repellant on the plants so that it doesn't spread.