A virtual, augmented, or mixed reality display system (2500a, 2500b, 2500c) comprising: a display (2500a, 2500b, 2500c) configured to display virtual, augmented, or mixed reality image data, the display (2500a, 2500b, 2500c) comprising a plurality of waveguides which introduce optical distortions or aberrations to the image data, and a plurality of unique and at least partially distinct optical paths corresponding to the plurality of waveguides and a plurality of colors at a plurality of depth planes of the image data; and a display controller (2530a, 2530b, 2530c) configured to provide the image data to the display (2500a, 2500b, 2500c), the display controller (2530a, 2530b, 2530c) comprising: memory for storing optical distortion correction information, the optical distortion correction information comprising separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data, wherein each of the separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data corresponds to respective unique and at least partially distinct optical paths, and one or more processing elements (2532b, 2534b, 2532c, 2534c) to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information, wherein the optical distortion correction information comprises information for performing one or more image warp operations, and wherein the display controller (2530a, 2530b, 2530c) is further configured to perform the one or more image warp operations on the image data. a display (2500a, 2500b, 2500c) configured to display virtual, augmented, or mixed reality image data, the display (2500a, 2500b, 2500c) comprising a plurality of waveguides which introduce optical distortions or aberrations to the image data, and a plurality of unique and at least partially distinct optical paths corresponding to the plurality of waveguides and a plurality of colors at a plurality of depth planes of the image data; and a display controller (2530a, 2530b, 2530c) configured to provide the image data to the display (2500a, 2500b, 2500c), the display controller (2530a, 2530b, 2530c) comprising: memory for storing optical distortion correction information, the optical distortion correction information comprising separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data, wherein each of the separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data corresponds to respective unique and at least partially distinct optical paths, and one or more processing elements (2532b, 2534b, 2532c, 2534c) to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information, wherein the optical distortion correction information comprises information for performing one or more image warp operations, and wherein the display controller (2530a, 2530b, 2530c) is further configured to perform the one or more image warp operations on the image data. memory for storing optical distortion correction information, the optical distortion correction information comprising separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data, wherein each of the separate optical distortion correction information for each of the plurality of colors at each of the plurality of depth planes of the image data corresponds to respective unique and at least partially distinct optical paths, and one or more processing elements (2532b, 2534b, 2532c, 2534c) to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information, wherein the optical distortion correction information comprises information for performing one or more image warp operations, and wherein the display controller (2530a, 2530b, 2530c) is further configured to perform the one or more image warp operations on the image data.