yes, I'm pretty sure that the call to yule_walker should use xm and not x. 
(But I just did a quick check with pdb in nosetests and didn't look at all the details yet. It doesn't look like x is demeaned before calling pacf_yw.)