A virtual reality headset (100, 300) comprising: at least one processor; an electronic display element configured to display a virtual scene to a user wearing the VR headset (100, 300); an optics block configured to direct light from the electronic display element to an exit pupil of the VR headset (100, 300); an eye tracking system including an image capturing element, the eye tracking system configured to determine an eye position of each eye of the user and gaze lines for each eye of the user; memory including instructions that, when executed by the at least one processor, cause the at least one processor to: determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth, wherein the memory further includes instructions that, when executed by the at least one processor, cause the at least one processor to: determine, for a frame of the virtual scene, a state of the optics block based on a state of the optics block in one or more previously presented frames of the virtual scene, each state of the optics block associated with a distortion correction map that corrects for optical error introduced by the state of the optics block; and determine, based on the state of the optics block for the frame, a distortion correction map for the frame of the virtual scene to correct for optical error introduced by the determined state of the optics block for the frame; and display the frame of the virtual scene on the electronic display element subject to the distortion correction map for the frame of the virtual scene to correct for optical error introduced by the determined state of the optics block for the frame. at least one processor; an electronic display element configured to display a virtual scene to a user wearing the VR headset (100, 300); an optics block configured to direct light from the electronic display element to an exit pupil of the VR headset (100, 300); an eye tracking system including an image capturing element, the eye tracking system configured to determine an eye position of each eye of the user and gaze lines for each eye of the user; memory including instructions that, when executed by the at least one processor, cause the at least one processor to: determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth, determine a vergence depth for the user based on an estimated intersection of the gaze lines for each eye of the user; and a varifocal actuation block configured to change a focal length of the optics block based at least in part on the vergence depth, wherein the memory further includes instructions that, when executed by the at least one processor, cause the at least one processor to: determine, for a frame of the virtual scene, a state of the optics block based on a state of the optics block in one or more previously presented frames of the virtual scene, each state of the optics block associated with a distortion correction map that corrects for optical error introduced by the state of the optics block; and determine, based on the state of the optics block for the frame, a distortion correction map for the frame of the virtual scene to correct for optical error introduced by the determined state of the optics block for the frame; and determine, for a frame of the virtual scene, a state of the optics block based on a state of the optics block in one or more previously presented frames of the virtual scene, each state of the optics block associated with a distortion correction map that corrects for optical error introduced by the state of the optics block; and determine, based on the state of the optics block for the frame, a distortion correction map for the frame of the virtual scene to correct for optical error introduced by the determined state of the optics block for the frame; and display the frame of the virtual scene on the electronic display element subject to the distortion correction map for the frame of the virtual scene to correct for optical error introduced by the determined state of the optics block for the frame.