A method of interaction using augmented reality, the method comprising the following steps performed on a device operated by a local user: capturing a video image using an imaging device (250; 410; 1520); generating augmented reality coordinates corresponding to the video image, wherein the augmented reality coordinates are generated by an augmented reality toolkit that receives the video image; updating a local user scene view according to the generated augmented reality coordinates, wherein a scene view is a rendered scene's camera view comprising rendered 3D objects within an augmented reality scene; encoding the video image; loading 3D object information, comprising an animation of a first object, from external storage; combining the AR coordinates, 3D object information and encoded video image into combined data; and transmitting the combined data to a remote user, the method further comprising the following steps performed on a device operated by the remote user: receiving the combined data from the local user, updating a background image in an expert scene view based on the encoded video image; updating the expert scene view according to the augmented reality coordinates; updating positions and existence of the 3D objects in the expert scene view based on the 3D object information; loading additional 3D content, comprising an animation of the first object or a second object, from external storage; creating an updated rendered scene view by combining the loaded 3D content and the expert scene view; and returning the updated rendered scene view to the local user. the method comprising the following steps performed on a device operated by a local user: capturing a video image using an imaging device (250; 410; 1520); generating augmented reality coordinates corresponding to the video image, wherein the augmented reality coordinates are generated by an augmented reality toolkit that receives the video image; updating a local user scene view according to the generated augmented reality coordinates, wherein a scene view is a rendered scene's camera view comprising rendered 3D objects within an augmented reality scene; encoding the video image; loading 3D object information, comprising an animation of a first object, from external storage; combining the AR coordinates, 3D object information and encoded video image into combined data; and transmitting the combined data to a remote user, capturing a video image using an imaging device (250; 410; 1520); generating augmented reality coordinates corresponding to the video image, wherein the augmented reality coordinates are generated by an augmented reality toolkit that receives the video image; updating a local user scene view according to the generated augmented reality coordinates, wherein a scene view is a rendered scene's camera view comprising rendered 3D objects within an augmented reality scene; encoding the video image; loading 3D object information, comprising an animation of a first object, from external storage; combining the AR coordinates, 3D object information and encoded video image into combined data; and transmitting the combined data to a remote user, the method further comprising the following steps performed on a device operated by the remote user: receiving the combined data from the local user, updating a background image in an expert scene view based on the encoded video image; updating the expert scene view according to the augmented reality coordinates; updating positions and existence of the 3D objects in the expert scene view based on the 3D object information; loading additional 3D content, comprising an animation of the first object or a second object, from external storage; creating an updated rendered scene view by combining the loaded 3D content and the expert scene view; and returning the updated rendered scene view to the local user. receiving the combined data from the local user, updating a background image in an expert scene view based on the encoded video image; updating the expert scene view according to the augmented reality coordinates; updating positions and existence of the 3D objects in the expert scene view based on the 3D object information; loading additional 3D content, comprising an animation of the first object or a second object, from external storage; creating an updated rendered scene view by combining the loaded 3D content and the expert scene view; and returning the updated rendered scene view to the local user.