An augmented reality, AR, display system (58, 606, 70) comprising: a display configured to project virtual images to eyes of a wearer; a frame configured to mount the display in front of the eyes of the wearer; one or more cameras (124, 154, 156) mechanically coupled to the frame and configured to capture images of an environment in front of the wearer; an electromagnetic, EM, field emitter (402, 602) configured to generate a magnetic field; an EM sensor (404, 604) configured to sense the magnetic field, wherein the EM sensor (404, 604) is mechanically coupled to the frame and the EM field emitter (402, 602) is mechanically coupled to a component (606; 2500) of the AR display system that is independently movable relative to the frame by the wearer; and a hardware processor programmed to: receive images of the environment in front of the wearer from the one or more cameras (124, 154, 156); receive signals from the EM sensor (404, 604) indicative of a sensed magnetic field; analyze the received images to determine whether the component (606; 2500) of the AR display system is within a zone in back of the wearer which is outside of a field of view, FOV, of the one or more cameras (124, 154, 156); and determine a position of the component of the AR display system based on the received signals and whether the component of the AR display system is determined to be outside of the FOV of the one or more cameras. a display configured to project virtual images to eyes of a wearer; a frame configured to mount the display in front of the eyes of the wearer; one or more cameras (124, 154, 156) mechanically coupled to the frame and configured to capture images of an environment in front of the wearer; an electromagnetic, EM, field emitter (402, 602) configured to generate a magnetic field; an EM sensor (404, 604) configured to sense the magnetic field, wherein the EM sensor (404, 604) is mechanically coupled to the frame and the EM field emitter (402, 602) is mechanically coupled to a component (606; 2500) of the AR display system that is independently movable relative to the frame by the wearer; and a hardware processor programmed to: receive images of the environment in front of the wearer from the one or more cameras (124, 154, 156); receive signals from the EM sensor (404, 604) indicative of a sensed magnetic field; analyze the received images to determine whether the component (606; 2500) of the AR display system is within a zone in back of the wearer which is outside of a field of view, FOV, of the one or more cameras (124, 154, 156); and determine a position of the component of the AR display system based on the received signals and whether the component of the AR display system is determined to be outside of the FOV of the one or more cameras. receive images of the environment in front of the wearer from the one or more cameras (124, 154, 156); receive signals from the EM sensor (404, 604) indicative of a sensed magnetic field; analyze the received images to determine whether the component (606; 2500) of the AR display system is within a zone in back of the wearer which is outside of a field of view, FOV, of the one or more cameras (124, 154, 156); and determine a position of the component of the AR display system based on the received signals and whether the component of the AR display system is determined to be outside of the FOV of the one or more cameras.