My setup of delete-selection-mode was wrong.