Fix a case when another button than primary is focused and user hits an enter key.