The beauty of making croutons is that it helps you not waste any leftover or stale bread. For that reason, use all of the bread - crusts included. I do not recommend removing the crusts from the bread when making croutons.