Do not let number of skipped bytes go below 0. Fix for bb#572