Dig them out the best you can and treat the wall with a fungicidal wash. It’s inevitable some will start to regrow or will decay and damage the painted surface. Without going to extremes, you just have to accept that you’ll need to repaint a bit more often than you might like.