Fix close button position with RTL direction

The button should be left-aligned, otherwise wit will clash with the
right-aligned text.