Restore original inset based on finish direction.

When pull to refresh finishes, now it will restore correct inset for direction (When direction is left, it will restore the left inset from original inset).