A sump pump should go inside a basin or pit, which you should install in your basement or crawl space. Put a replacement sump pump where you had installed the old one. You should place a new one on the bottom floor of your house, where you’ve had the highest water accumulation.