Move "lazy initialization" code from XlibBackend to TouchpadBackend