Make sure tests have needed pid directory