Fix first horizontal drag of the charts

Drags started from an unclamped center time, rather than
the displayed center time, making the behavior quite confusing
on initial load.