Remove ignored key logic

Related to: https://github.com/ueno/libskk/commit/d3a7c881