On action, force the sprite to update
Add background drawing, and support for sprites that don't update
Add arbitrary (I need to work on these) pixel offsets for map edges.
Don't assume movement has stopped on keyup.

I don't like this solution either...