Only reset pointer if we were in control of it.