Don't fake the swipe to unlock if not needed.

Re: #695