In the Excel Options window, click on Advanced. Scroll down to the Editing options section and find the option for Use insert mode. By default, this option is turned on. To turn it off, simply uncheck the box next to it.