A head mounted display (501, 600) comprising: at least one processor; a multiplanar display comprising: a first electronic display (102a, 602a) configured to display a first virtual plane within a virtual scene to a user wearing the HMD; a second electronic display (102b, 602b) configured to display a second virtual plane of the virtual scene to the user wearing the HMD, the first virtual plane being located at a different optical depth to the second virtual plane, wherein objects in the virtual scene are mapped to scene geometry or depth information provided by a content creator, and wherein the first electronic display is mapped to a first subset of said objects based on their scene geometry and the second electronic display is mapped to a different second subset of said objects based on their scene geometry; an optics block configured to direct light from the first electronic display and the second electronic display to an exit pupil of the HMD; an eye tracking system including an image capturing element, the eye tracking system configured to determine an eye position of each eye of the user and gaze lines for each eye of the user; memory including instructions that, when executed by the at least one processor, cause the at least one processor to: determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth for each eye of the user corresponding to a viewing location of the user within the virtual scene. at least one processor; a multiplanar display comprising: a first electronic display (102a, 602a) configured to display a first virtual plane within a virtual scene to a user wearing the HMD; a second electronic display (102b, 602b) configured to display a second virtual plane of the virtual scene to the user wearing the HMD, the first virtual plane being located at a different optical depth to the second virtual plane, wherein objects in the virtual scene are mapped to scene geometry or depth information provided by a content creator, and wherein the first electronic display is mapped to a first subset of said objects based on their scene geometry and the second electronic display is mapped to a different second subset of said objects based on their scene geometry; an optics block configured to direct light from the first electronic display and the second electronic display to an exit pupil of the HMD; an eye tracking system including an image capturing element, the eye tracking system configured to determine an eye position of each eye of the user and gaze lines for each eye of the user; memory including instructions that, when executed by the at least one processor, cause the at least one processor to: determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth for each eye of the user corresponding to a viewing location of the user within the virtual scene. a first electronic display (102a, 602a) configured to display a first virtual plane within a virtual scene to a user wearing the HMD; a second electronic display (102b, 602b) configured to display a second virtual plane of the virtual scene to the user wearing the HMD, the first virtual plane being located at a different optical depth to the second virtual plane, wherein objects in the virtual scene are mapped to scene geometry or depth information provided by a content creator, and wherein the first electronic display is mapped to a first subset of said objects based on their scene geometry and the second electronic display is mapped to a different second subset of said objects based on their scene geometry; an optics block configured to direct light from the first electronic display and the second electronic display to an exit pupil of the HMD; an eye tracking system including an image capturing element, the eye tracking system configured to determine an eye position of each eye of the user and gaze lines for each eye of the user; memory including instructions that, when executed by the at least one processor, cause the at least one processor to: determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth for each eye of the user corresponding to a viewing location of the user within the virtual scene.