Fixes #170. Do only react to keys if not in rotate mode