「様式３」P-40

Augmented Surfaces as a Basis of Applications
for Imaging Devices［１］Organization
Project Leader: Paolo Bottoni (Department ofComputer Science, Sapienza University ofRome, Italy)
Representative at RIE: Hidenori Mimura(Research Institute of Electronics, Shizuoka
University, Japan)
Participants:
Michael Cohen (School of Computer Science andEngineering, The University of Aizu, Japan)
Shigaku Tei (School of Computer Science andEngineering, The University of Aizu, Japan)
Nikolay Mirenkov (School of Computer Scienceand Engineering, The University of Aizu,Japan)
Roumen Nikolov (State University of LibraryStudies and Information Technologies,Bulgaria)
Volodymyr Gnatyuk (V.E. Lashkaryov Institute of
Semiconductor Physics, National Academy ofSciences of Ukraine)
Pavel Boychev (Faculty of Mathematics andInformatics, Sofia University, Bulgaria)
Evguenia Kovacheva (Faculty of Mathematics
and Informatics, Sofia University, Bulgaria)
Oleg Monakhov (Inst. of Computational
Mathematics and Mathematical Geophysics,
Russian Academy of Sciences, Siberian
Branch, Russia)
Tsukasa Ebihara (Green Company, Japan)
Rentaro Yoshioka (School of Computer Scienceand Engineering, The University of Aizu,
Japan)
Yutaka Watanobe (School of Computer Scienceand Engineering, The University of Aizu,Japan)
Boyan Jekov (State University of Library Studies
and Information Technologies, Bulgaria)
Danilo Avola (Department of Computer Science,Sapienza University of Rome, Italy)

MiguelGeremia Ceriani (Department ofComputer Science, Sapienza University ofRome, Italy)
Roberto Navigli (Department of Computer
Science, Sapienza University of Rome, Italy)
Francesco Parisi Presicce (Department ofComputer Science, Sapienza University ofRome, Italy)
Matilde Mastrangelo (Institiute of Oriental
Studies, Sapienza University of Rome, Italy)
Maria De Marsico (Department of Computer
Science, Sapienza University of Rome, Italy)
Emanuele Panizzi (Department of Computer
Science, Sapienza University of Rome, Italy)
Toru Aoki (Research Institute of Electronics,Shizuoka University, Japan)
Kamen Kanev (Graduate School of Informatics,Shizuoka University, Japan)［２］Research Progress
The research work has been conducted mainly by
the group of Professor Bottoni in Rome, Professor
Kanev in Hamamatsu and Professor Mirenkov in
Aizu, and has also taken advantage of the 2months visit of Professor Kanev to Sapienza
University of Rome in the fall of 2015. Joint
meetings were held in Hamamatsu andAizuwakamatsu in August and December 2015
while Professor Bottoni visited Japan. In thecourse of the December visit to Hamamatsu ajoint CRP workshop was held, at which
presentations from three different projects werecombined.
This year we have focused on the exploration andintegration of different forms of interaction
considering the various types of support on which
they can be performed. More specifically, we
conducted research and development work on cases
where interaction occurs on i) physical surfaces
offering a permanent base for the integration ofsemantics, ii) physical and logical surfaces provided
by digital devices where interactions lead

production of new persistent information, such asannotations,andiii) virtualenvironments
supporting spatial gesture interactions such as“drawing in the air” without reference surfaces.
This has resulted both in the development ofspecific applications and in the proposal of a genericframework for the development of interactive
applications based on a dataflow modeling of theapplication semantics.
［３］Results(３－１) Research results
Most of the obtained research results have beenpresented at different international conferencesin Japan and abroad and/or have been publishedin reputable scientific journals as documented in
the Achievements section of this report.
In particular, the project has progressed on thetopics specified in the proposal, as described below.
• With respect to meta-modeling of interactivemechanisms, work has been done on thedevelopment of methods for dataflow-based
specification of interactive systems, including a
proposal of a general framework for integrationof components developed according to differentontologies.
• With respect to audio-visual interactions and VR
work has been done on the development ofintegrated systems based on visual languages
able to manage self-explanatory components for
big information resources.
• With respect to the theory of annotations, thenotion of annotation contract has been proposed
where transformations of annotated content
require the production of conformantannotations.
• With respect to the interaction with different
interface devices, work has been done on gesturerecognition systems based on smartphone.
• With respect to the integration of different
interaction techniques, work has been done on
the development of sketch-based annotation.
In view of the envisaged specific applications thefollowing work has been conducted:• Data formats based on self-explanatorycomponent have been proposed.
• Security concerns for wireless communication
have been addressed.
• Activities on 3D printing have kept developing.
• Research on problems related to marking ofdifferent materials has been conducted.

(３－２) Ripple effects and further developments
The CRP has developed synergies with other
CRPs in which Professor Kanev is involved, as
well as with the Italy-Japan bilateralcollaboration project funded by the Italian
Ministry of Foreign Affairs and with the facilities
provided by Sapienza University of Rome forvisiting professors, hosting Professor Kanev fortwo months (September – November 2015).
Of particular relevance is the possibility ofintegrating teaching programs relative to Big
Data at SUNY Fredonia, Sapienza University ofRome, and Shizuoka University, as resulting fromexchange of ideas during the CRP joint workshop.
Based on the results achieved in this year, weplan to continue on the lines which have produced
results, especially as concerns the development of
dataflow languages for interacting with theSemantic Web, the development of theory andapplications for annotations, the development ofgesture-based interaction techniques, and theapplications of visual languages based on
self-explanatory components.
［４］Achievements (List of Publications)(１) P.Bottoni, K.Kanev, N.Mirenkov, M.Ceriani,“A Framework for Situated Interaction
with Augmented Surfaces”, to appear in Int
J Software Informatics.
(２) P.Bottoni, M.Ceriani, “Towards anOntology-Based Generic Pipeline Editor”,
Proc. DNIS 2015, LNCS 8999, pp.56-73,
2015.
(３) P.Bottoni, R.Navigli, F.Parisi Presicce,“Conditions, constraints and contracts: On
the use of annotations for policy modeling”,
Proc. GCM@ICGT 2015, pp.18-33.
(４) P.Bottoni, M.Ceriani, “Linked Data
Queries as Jigsaw Puzzles: a VisualInterface for SPARQL Based on BlocklyLibrary”, Proc. CHItaly 2015, pp.86-89,2015.
(５) P.Bottoni,M.Ceriani,“SPARQL
Playground: A Block Programming Tool toExperiment withSPARQL”, Proc.
VOILA@ISWC 2015, pp.103-108, 2015.
(６) K.Kanev, M.De Marsico, P.Bottoni, “A
Human Computer Interaction Frameworkfor Biometric User Identification”, Proc.
InterAcademia 2015.

(７)K.Kanev, A.Mei, P.Bottoni, “HomeCommunications and Services with
Enhanced Security: Augmented Embedded
Systems for Communication Appliances as
anEducationalPlatform”,Proc.
InterAcademia 2015.
(８) M.Antico, D.Avola, P.Bottoni, A. Hawash, K.
Kanev, F. Parisi Presicce, “An Interactive
Tool for Sketch-Based Annotation”, Proc.
InterAcademia 2015.
(９) M.Vynnycky, K.Kanev, “MathematicalAnalysis of the Multisolution Phenomenon

Journal of
Mathematical Imaging and Vision 51(2):intheP3P

Problem”,

326-337, 2015.
(１０) R.Yoshioka, N.Mirenkov, H.Sekine, K.
Noda, “3D Kanji: A new paradigm of 3D
objects to exploit additional dimensions ofhuman sense for enhancing expression”, J.
Vis. Lang. Comput. 28: 250-272, 2015.
(１１) Y.Watanobe, N.Mirenkov, “*AIDA: A
Language of Big Information Resources”,
Proc. DNIS 2015, LNCS 8999, pp.112-121,2015.

Travelling Report（Mention each travel by CRP budget.）Name：Paolo Bottoni
Affiliation：Department of Computer Science, Sapienza University of Rome, Italy
Period of time：10-12 December 2015
Destination：Shizuoka University, Hamamatsu, Japan
Purpose: Research meetings and participation in a Cooperative Research Workshop at which a
presentation titled “Augmented Surfaces as a Basis of Applications for Imaging Devices” wasdelivered.
Name of receiver：Prof. Kamen Kanev and Prof. Hidenori Mimura