Handle the delete input being inside its label

Fixes #4