HoloDesigner： A Mixed Reality Tool for On-site Interactive 3D Visualizationof Design Object○ Yuze Dan*1, Zhenjiang Shen*2*1 Doctoral Student, School of Environmental Design, Kanazawa University*2 Professor, School of Environmental Design, Kanazawa University, Ph.D.
Keywords: Mixed reality; design tool; on-site 3d visualization; real-time interaction; hololens.

1. Introduction

2. Method

1.1. BACKGROUND

2.1. MR TOOL DESIGNIn architectural design or urban planning field, the relationshipIn reality, the conceived new tool HoloDesigner is a MR

between design object and existing environment has been

software application based on HoloLens (Fig 1).

1)

constantly emphasized since modernism movement . Many
famous designers preferred to work closely with design context
and spend significant time imagining, developing and assessing
their design proposal on site2). Nowadays, designing on site has
gradually become an essential means for designers to cope withcomplex urban building environment in actual projects.
However, designing on site never been an easy work.
Because limited by design tool, 2D drawings and 3D models are
difficult to integrate into real design context and makeadjustment in typical design work.
1.2. POTENTIALS OF MIXED REALITY

Fig 1. Concept design of mr tool

Mixed Reality (MR) is the merging spectrum of real and virtualworlds3), which provides huge potentials to implement the new

2.2. MR TOOL DEVELOPMENT

tool to realize on-site visualization and even real-time
interaction of design object. Although experiencing long
discoveries, there are few effective tool supporting specificdesigning on site presently.
With technology leaps, an advanced wearable MR device
Microsoft's HoloLens has emerged, allowing 3D visualizationof hologram and immersive interaction experience in MR
environment4). HoloLens has been successfully applied into
medical field5), educational field6), geography fields7). Althoughrarely involving in urban planning or architectural design until
now, the properties presented by HoloLens, likes true visual
sense, natural interaction and spatial depth perception, bring thepossibilities for improving MR design tool further.
1.3. OBJECTIVE
Therefore, the objective of this study is to present a new MR
design tool on HoloLens for on-site interactive 3D visualization

Fig 2. Development process of mr toolof design object to support designing on-site effectively.
日本建築学会情報システム技術委員会
第 42 回情報･システム･利用･技術シンポジウム論文集， 238-239 ， 2019 年 12 月，東京
Proceedings of the 42nd Symposium on Computer Technology of Information ，Systems and Applications ， AIJ ， 238-239 ， Dec. ， 2019 ， Tokyo－ 238 －The designed new tool HoloDesigner was implemented withthree primary processes in personal computer (Fig 2): Assets
Creation; MR Application Development; and MR Application
Deployment.
Fig 5. Real-time interaction effects

2.3. MR TOOL ON-SITE DEMONSTRATION
To present the final outcome of the new MR tool, we choose atypical community public space to operate HoloDesigner on site.

4. Discussion

We made a design proposal for the place to supplement some

4.1. IMPROVEMENT

landscape furniture and recreational facilities (Fig 3).

HoloDesigner not only contributes to designer’s free perception
and intuitive decision on site, but also redefines the interaction
mode of MR design tool. Also, HoloDesigner brings new design
functions.
4.2. LIMITATION
HoloDesigner can only support slight design adjustment basedon prepared digital design data on site, rather than creating
design object under physical scene from scratch.
4.3. CONCLUSION
HoloDesigners offer the possibilities for designer to understandphysical environments at multi-perspective and check designobject at multi-scale on site, and to develop design proposal inreal-time according to real scene effectively.

Fig 3. On-site demonstration scene of mr tool
3. Results
3.1. ON-SITE 3D VISUALIZATIONIn HoloDesigner, we can select the suitable design object toimmerse into the real community public space (Fig 4).
Visualization of complex design scene with multi objects can bearchived in HoloDesigner. Also HoloDesigner provides us thepossibilities to review the design object on site from multiviews.

Fig 4. On-site 3d visualization effects
3.2. REAL-TIME INTERACTION
Real-time interaction between real scene, design object and user
can be construct by HoloDesigner (Fig 5). Spatial mapping canarchive digitization of physical envrionment for design object
contacting. Meanwhile, user control of design object has been

References
1）Holl, S.: 1989, Anchoring, Princeton Architectural Press, NewYork.
2）Skov, M. B., Kjeldskov, J., Paay, J., Husted, N., Nørskov, J.,
Pedersen, K.: 2013, Designing on-site: Facilitating participatory
contextual architecture with mobile phones, Pervasive andMobile Computing, 9(2), 216–227.
3）Milgram, P. and Kishino, F.: 1994, A Taxonomy of mixed reality
visual displays, IEICE Transactions on Information and Systems,
77(12), 1321–1329.
4）Hanna, M. G., Ahmed, I., Nine, J., Prajapati, S., Pantanowitz, L.:
2018, Augmented Reality Technology Using Microsoft
HoloLens in Anatomic Pathology, Archives of Pathology &Laboratory Medicine, 142(5), 638-644.
5）Brun, H., Bugge, R. A. B., Suther, L. K. R., Birkeland, S., Kumar,R., Pelanis, E., et al.: 2019, Mixed reality holograms for heart
surgery planning: first user experience in congenital heartdisease, Europe Heart Journal — Cardiovasc Imaging, 20(8),883-888.
6）Yilmaz., R. M. and Goktas, Y.: 2017, Using augmented reality
technology in storytelling activities: examining elementary
students’ narrative skill and creativity, Virtual Reality, 21(2),75–89.
7）Wang, W., Wu, X., Chen, G., Chen, Z.: 2018, Holo3DGIS:
Leveraging Microsoft HoloLens in 3D Geographic Information.
ISPRS International Journal of Geo-Information, 7 (2), 60.

realized by gaze and gesture.

インタラクティブ発表 Z105

－ 239 －