A processor-implemented method, comprising: receiving, by one or more processors, one or more images depicting at least a portion of a hand from an image capture device; sampling pixels in the one or more images to determine one or more color values for the pixels; determining a color profile for the hand based on the one or more color values for the sampled pixels, the color profile representing a median color value of the hand, wherein color values within a predetermined color threshold of the color value of a selected sampled pixel are included in the color profile, the color profile being determined by generating a histogram for the sampled pixels within a predetermined portion of a field of view of the image capture device, the histogram being divided into a plurality of histogram bins representing a respective color value among color values from the sampled pixels; determining pixels within the one or more images that correspond to the portion of the hand in the portion of the field of view, the portion of the hand having a finger, by estimating pixels as being associated with the portion of the hand if the histogram bin containing the pixels has a number of pixels above a pixel threshold, the pixel threshold being a number value or a percentage of the total number of pixels within the portion of the field of view, and estimating pixels as being unassociated with the portion of the hand otherwise; based on the pixels corresponding to the portion of the hand, identifying a finger position of the finger; determining (340; 710) a direction of the finger based on the finger position; based on the direction of the finger, dynamically modifying (520; 720) a histogram threshold by modifying at least one of the pixel threshold or the color threshold; and replacing the portion of the hand and the finger with a graphical interface element aligned with the direction of the finger. receiving, by one or more processors, one or more images depicting at least a portion of a hand from an image capture device; sampling pixels in the one or more images to determine one or more color values for the pixels; determining a color profile for the hand based on the one or more color values for the sampled pixels, the color profile representing a median color value of the hand, wherein color values within a predetermined color threshold of the color value of a selected sampled pixel are included in the color profile, the color profile being determined by generating a histogram for the sampled pixels within a predetermined portion of a field of view of the image capture device, the histogram being divided into a plurality of histogram bins representing a respective color value among color values from the sampled pixels; determining pixels within the one or more images that correspond to the portion of the hand in the portion of the field of view, the portion of the hand having a finger, by estimating pixels as being associated with the portion of the hand if the histogram bin containing the pixels has a number of pixels above a pixel threshold, the pixel threshold being a number value or a percentage of the total number of pixels within the portion of the field of view, and estimating pixels as being unassociated with the portion of the hand otherwise; based on the pixels corresponding to the portion of the hand, identifying a finger position of the finger; determining (340; 710) a direction of the finger based on the finger position; based on the direction of the finger, dynamically modifying (520; 720) a histogram threshold by modifying at least one of the pixel threshold or the color threshold; and replacing the portion of the hand and the finger with a graphical interface element aligned with the direction of the finger.