Vinegar, a common household item, is often used to get rid of aphids. Many people use it in order to kill and remove them.
A major problem with vinegar is that it can actually kill the plant it is being sprayed on as well. This isn't a problem from a human's perspective because they can just add more plants in the yard to replace any dying ones, but gardeners might not be able to replant their plants if they use vinegar as an insecticide for any other reason than just killing the pests.