The seeds are not necessarily harmful. And honestly, they are a hassle to remove, so it’s better to keep them