Only instantiate the device manager the first time it's needed

Much nicer, thanks for the encouragement, @bobsilverberg