BRICKxAR is an Augmented Reality-based construction method applied to LEGO as a case study . With BRICKxAR, real LEGO brick construction is guided by virtual bricks in the right place at the right time, step by step. Virtual and real object occlusions are implemented to enable a natural appearance of virtual bricksinside real bricks . LEGO players' hand detection and occlusion are realized to allow a realistic immersive AR experience, in which virtual bricks can be "grasped" by the real hand, facilitating hand-eye coordination in AR. High accuracy and high precision of registration, i.e. the virtual - physical model alignment, are achieved. In the best case, the average error of registration is less than 1mm throughout the model. BRICKxAR is expected to enhance Learning Through Play, as well as assemblyand construction by human workers. In the experiment, LEGO Arc de Triomphe is built completely with BRICKxAR, without the instruction booklet .
BRICKxAR is a novel Augmented Reality (AR) instruction method for construction toys such as LEGO . With BRICKxAR, physical LEGO construction is guided by virtual bricks . Compared with the state-of-the-art, accuracy of the virtual - physical model alignment is significantly improved through a new design of marker-based registration, which can achieve an average error less than 1mm throughout the model. Realistic object occlusion is accomplished to reveal the true spatial relationship between physical and virtual bricks . LEGO players' hand detection and occlusion are realized to visualize the correct spatial relationship between real hands and virtual bricks, and allow virtual bricks to be "grasped" by real hands. The integration of these features makes AR instructions possible for small-parts assembly, validated through a working AR prototype for constructing LEGO Arc de Triomphe , quantitative measures of the accuracies of registration and occlusions, and heuristic evaluation of AR instruction features .
R
an Augmented Reality-based construction method applied to LEGO as a case study
a novel Augmented Reality (AR) instruction method for construction toys such as LEGO
R
real LEGO brick
physical LEGO
R
in the right place at the right time, step by step. Virtual and real object occlusions are implemented to enable a natural appearance of virtual bricksinside real bricks
. Compared with the state-of-the-art, accuracy of the virtual - physical model alignment is significantly improved through a new design of marker-based registration, which can achieve an average error less than 1mm throughout the model. Realistic object occlusion is accomplished to reveal the true spatial relationship between physical and virtual bricks
R
allow a realistic immersive AR experience, in which virtual bricks can
visualize the correct spatial relationship between real hands and virtual bricks, and allow virtual bricks to
R
the real hand, facilitating hand-eye coordination in AR. High accuracy and high precision of registration, i.e. the virtual - physical model alignment, are achieved. In the best case, the average error of registration is less than 1mm throughout the model. BRICKxAR is expected to enhance Learning Through Play, as well as assemblyand construction by human workers. In the experiment,
real hands. The integration of these features makes AR instructions possible for small-parts assembly, validated through a working AR prototype for constructing
R
is built completely with BRICKxAR, without the instruction booklet
, quantitative measures of the accuracies of registration and occlusions, and heuristic evaluation of AR instruction features