Only update start OR end when sliding, not both