A computer-implemented method of input processing for augmented reality, comprising the steps of: capturing a video image of a scene comprising an object; generating an image augmentation layer for superposition over the captured video image, the image augmentation layer comprising a region depicting a control interface whose shape and area is dependent upon the position and orientation of the object in the captured video image; and the region of the image augmentation layer being defined by mapping with a first mapping a region of a reference two-dimensional array of pixels, depicting the control interface with predetermined dimensions, on to the image augmentation layer through an intermediate three dimensional space representing a 3D environment to be displayed in the image augmentation layer, detecting for each pixel in the region of the image augmentation layer a property of a corresponding pixel in the captured video image, and mapping with a second mapping that is at least in part an inverse of the first mapping the property detected for each pixel of the region of the image augmentation layer to the reference two-dimensional array of pixels; generating an input corresponding to the control interface to a data process for user interaction with the image augmentation layer, based upon the property values as mapped to the reference two-dimensional array of pixels; and wherein the property of a corresponding pixel in the captured video image is one selected from the list consisting of: i. an indication of skin tone; and ii. an indication of a change in an indication of skin tone with respect to a preceding captured video image. capturing a video image of a scene comprising an object; generating an image augmentation layer for superposition over the captured video image, the image augmentation layer comprising a region depicting a control interface whose shape and area is dependent upon the position and orientation of the object in the captured video image; and the region of the image augmentation layer being defined by mapping with a first mapping a region of a reference two-dimensional array of pixels, depicting the control interface with predetermined dimensions, on to the image augmentation layer through an intermediate three dimensional space representing a 3D environment to be displayed in the image augmentation layer, detecting for each pixel in the region of the image augmentation layer a property of a corresponding pixel in the captured video image, and mapping with a second mapping that is at least in part an inverse of the first mapping the property detected for each pixel of the region of the image augmentation layer to the reference two-dimensional array of pixels; generating an input corresponding to the control interface to a data process for user interaction with the image augmentation layer, based upon the property values as mapped to the reference two-dimensional array of pixels; and wherein the property of a corresponding pixel in the captured video image is one selected from the list consisting of: i. an indication of skin tone; and ii. an indication of a change in an indication of skin tone with respect to a preceding captured video image. i. an indication of skin tone; and ii. an indication of a change in an indication of skin tone with respect to a preceding captured video image. <EOS>