Hide the close-icon when the modified one is showing

Fixes #58