A computer implemented method to interactively capture and utilize a three-dimensional object to be a controlling device for a computer system, comprising: capturing depth data of the three-dimensional object; processing captured depth data of the three-dimensional object to create geometric defining parameters for the three-dimensional object; defining correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system; saving to a recognized object database the geometric defining parameters of the three-dimensional object and correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system in response to recognizing the particular actions; activating an interactive session processed by the computer system, the interactive session including: capturing depth data and analyzing the depth data, the depth data being compared to the geometric defining parameters stored in the recognized object database so as to recognize a three-dimensional object held by a user amongst a set of three-dimensional objects having geometric defining parameters saved in the recognized object database; and triggering activation of actions during the interactive session in response to (i) the recognition of the three-dimensional object amongst the set of three-dimensional objects and (ii) actions performed with the three-dimensional object, as defined by the correlations between particular actions performed with the recognized three-dimensional object and particular actions to be performed by the computer system capturing depth data of the three-dimensional object; processing captured depth data of the three-dimensional object to create geometric defining parameters for the three-dimensional object; defining correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system; saving to a recognized object database the geometric defining parameters of the three-dimensional object and correlations between particular actions performed with the three-dimensional object and particular actions to be performed by the computer system in response to recognizing the particular actions; activating an interactive session processed by the computer system, the interactive session including: capturing depth data and analyzing the depth data, the depth data being compared to the geometric defining parameters stored in the recognized object database so as to recognize a three-dimensional object held by a user amongst a set of three-dimensional objects having geometric defining parameters saved in the recognized object database; and triggering activation of actions during the interactive session in response to (i) the recognition of the three-dimensional object amongst the set of three-dimensional objects and (ii) actions performed with the three-dimensional object, as defined by the correlations between particular actions performed with the recognized three-dimensional object and particular actions to be performed by the computer system capturing depth data and analyzing the depth data, the depth data being compared to the geometric defining parameters stored in the recognized object database so as to recognize a three-dimensional object held by a user amongst a set of three-dimensional objects having geometric defining parameters saved in the recognized object database; and triggering activation of actions during the interactive session in response to (i) the recognition of the three-dimensional object amongst the set of three-dimensional objects and (ii) actions performed with the three-dimensional object, as defined by the correlations between particular actions performed with the recognized three-dimensional object and particular actions to be performed by the computer system <EOS>