The reality is, unless you've literally caught them in the act, you don't know who's responsible. Accusing your opponent of doing this won't win you any votes. Take the high road, remove the signs that were defaced and replace them if possible, and don't mention the issue again. Focus on your campaign and how you plan to help your local community. Good luck!