Get down and dirty. Weed by hand. It is a small sacrifice compared to the health risks of weeding by spray bottle. You might even grow to like it. Use mechanical traps to capture pests.
Live traps are a good alternative.
If the pests still won't give in, try recruiting some allies from the natural world. Attract beneficial insects. Some insects such as praying mantis and ladybugs will eat the bugs that eat your plants. Plants such as daisies, sunflowers, marigolds, dill, and fennel attract beneficial insects by providing them with food and a place to lay their eggs. If all the previous options fail, it may be helpful to directly add biological control such as beneficial insects, nematodes, and pathogens.