It turns out that bitcoin doesn't actually retarget difficulty based on the time spent mining the last 2016 blocks, it actually looks at the time spent mining the last 2015 blocks at the retarget point (a minor off-by-one bug written by Satoshi himself). This effectively causes difficulty adjustments to be, on average, skewed about 0.0496% more difficult than they should be.