We have been digging them up when they appear.
Mushrooms look worse than they are.
They simply mean that you have the spores in your soil and when they receive the proper moisture, humidity and temperature, they sprout up. Simply knock them down when you see them. Fungicide drenches may give you limited control, but would not be effective long term and really are not necessary. I have a problem with mushrooms growing in my yard. They seem to be increasing in numbers.