Add no-focus style to inline close button

This change ensures that focus will not change when clicking on the close button and therefore fixes fixes #5483.