Fix Drag n Drop when using Pull To Refresh

Signed-off-by: Jonas Kalderstam <jonas@kalderstam.se>