Feel free to when you merge - I prefer to leave them in in my repo so they are there when I reuse in future plugins