Fix negative y coordinates in scrolling

Signed-off-by: Pekka Enberg <penberg@kernel.org>