「様式３」課題番号 ：P-5

Imaging Devices and Digital Imaging of Semantic Surfaces
in Active Knowledge Management[1] Organization
Leader: Paolo Bottoni (Department of ComputerScience, Sapienza University of Rome, Italy)
Representative at RIE: Hidenori Mimura(Research Institute of Electronics, ShizuokaUniversity, Japan)
Participants:
Michael Cohen (School of Computer Science andEngineering, The University of Aizu, Japan)
Shigaku Tei (School of Computer Science andEngineering, The University of Aizu, Japan)
Nikolay Mirenkov (School of Computer Scienceand Engineering, The University of Aizu,Japan)
Roumen Nikolov (State University of LibraryStudies and Information Technologies,Bulgaria)
Volodymyr Gnatyuk (V.E. Lashkaryov Institute ofSemiconductor Physics, National Academy ofSciences of Ukraine)
Pavel Boychev (Faculty of Mathematics andInformatics, Sofia University, Bulgaria)
Evguenia Kovacheva (Faculty of Mathematics andInformatics, Sofia University, Bulgaria)
Oleg Monakhov (Inst. of Computational
Mathematics and Mathematical Geophysics,
Russian Academy of Sciences, SiberianBranch, Russia)
Tsukasa Ebihara (Green Company, Japan)
Rentaro Yoshioka (School of Computer Scienceand Engineering, The University of Aizu,Japan)
Yutaka Watanobe (School of Computer Scienceand Engineering, The University of Aizu,Japan)
Boyan Jekov (State University of Library Studies
and Information Technologies, Bulgaria)
Danilo Avola (Department of Computer Science,Sapienza University of Rome, Italy)
Miguel Geremia Ceriani (Department ofComputer Science, Sapienza University ofRome, Italy)
Amjad Hawash (Department of Computer Science,Sapienza University of Rome, Italy)
Roberto Navigli (Department of Computer
Science, Sapienza University of Rome, Italy)

Francesco Parisi Presicce (Department ofComputer Science, Sapienza University ofRome, Italy)
Toru Aoki (Research Institute of Electronics,Shizuoka University, Japan)
Kamen Kanev (Graduate School of Informatics,Shizuoka University, Japan)[2] Progress of the ResearchThis year we have focused on considering thedevelopment of multi-media and multi-modal
interface layers, including an imaging layer, toconnect users and information resources
representing the semantics of virtual or physicalobjects and the content of educational material,with reference to some common abstractions.
In particular we have:• considered problems and applications oflaser techniques for creating layers ofmarking in 3D objects;• tested possibilities of different encoding
schemes for the creation of semantic layers
on generic objects and environments;• developed
applications
combiningaugmented reality and marked objects;• defined a modeling framework and anintegrated environment for the developmentof applications based on surface coding;• progressed in the study of integration
between annotations and surface-basedinteraction.
[3] Results(3.1) Research results
Results obtained within the scope of this project
have been presented at various International
conferences and published in corresponding
Proceedings. International collaboration withresearchers from Bulgaria, Canada, Ukraine and
Italy has been successfully continued.
Professors Mirenkov and Watanobe haveprogressed on the development of an environment
for the production and usage of active knowledge
with particular reference to scientific and parallel
programs. They have proposed the approach ofProgramming in algorithmic pictures (a-pictures),where pictures and moving pictures are used assuper-characters for representing features ofcomputational algorithms and data structures.
Within this approach some ‘‘data spacestructures’’ are traversed by ‘‘fronts ofcomputation’’ and/or some “units of activity” aretraversed by flows of data. There are compound apictures to define algorithmic steps (called
Algorithmic CyberFrames) and generic a-pictures
to define the contents of compound pictures.
Compound a-pictures are assembled into special
series to represent some algorithmic features. The
series are assembled into an Algorithmic
CyberFilm. The generic/compound a-pictures andtheir series are developed and acquired in special
galleries of an open type where supportive
pictures with embedded clarity annotations areincluded.
The *AIDA modeling/programming language(AIDA stands for Animation and Images toDevelop Algorithms) and its Filmification
modeling (F-modeling) environment have been
defined and several programs in a-pictures havebeen produced. A special attention is paid to*AIDA programs as information resources whichperception, comprehension and cognition depend
on interaction with, at least, a few different but
mutually supplementing features of a-pictures.
Data/knowledge acquisition is based on clusters
of different views and acquisition can be oriented
to enhancing user’s ability within works on
developing application models, corresponding
algorithms and programs. The language is
extended to define super-characters related tospace structures for imitating some physicalregions (shapes) in 3-D space and (computational)
activities in time on structure nodes, and to
diagram structures for representing connections
between a set of activity units and specifying apartial order of the activity execution. The sets ofthe super-characters are open and adding newones
is
implemented
asa
specialknowledge/experience acquisition to support
various modeling techniques and applications.
Related work on 3D objects has foundapplications to the area of 3D Kanji, where
Professor Yoshioka provided sample 3D models
of selected Kanji characters. The main theme of
the research conducted under the supervision ofProfessors Kanev and Mirenkov was to facilitateand enhance the learning of Kanji. For thispurpose an experimental educational environment
in which students select and combine various
physical components to build correct Kanji anddevelop better understanding of kanji structure
was developed.
Further work on the notion of augmented surfaces
has been conducted principally by Professors
Kanev, Mirenkov and Bottoni. Augmented
surfaces are a novel paradigm for supportinginteraction, where information is coded on thesurface of a physical object, from which it can beread and used for different purposes.
For practical applications, along with traditional
print-based methods, we are exploring laser-based
technologies for permanent digital enhancementof physical objects with different materialproperties. Advanced methods for surface
engraving and undersurface and volumetric laser
marking are being developed in collaboration with
Dr.Gnatyuk and team members from other
Cooperative Research Projects.
In this line, a novel software architecture has been
proposed by which object producers andapplication designers can independently define theinformation to be added on surfaces, as well as
computational activities to be started upon
identification of a coding. Moreover, thearchitecture also offers the possibility for the end
user to choose to set the type of activities tolaunch as well as to select a specific activity whenmore than one is available.
This architecture is connected to the proposal of aframework for the construction of collaborative
services, based on a technique for coding content
generated both by authoritative organizations andby users on interactive supports. In particular,
users can interact in an enriched and focused way
with paper documents and object labels, both indesktop and mobile settings.
This offers the possibility of combiningimmediate access to online information fromphysical support with creation and retrieval ofannotations, while keeping in focus the context of
their creation, thus creating a collaboration spaceby extending the ways of interacting with
documents and objects and the way in which these
allow seamless access to both centralized anddistributed information.
With reference to the possibility of using
identifiable objects in combination with graphicaluser interfaces, Professor Bottoni and his
collaborator Michele Ceriani have proposed agraphical environment for the creation ofinteractive multi-touch applications, possibly
enriched with tangible objects, and able to react todifferent types of events, and supporting different
types of visualization.

With reference to the integration of user
annotations in semantic contexts, Professor
Bottoni and his collaborator Hamjad Hawash haveproceeded in the line of supporting the annotation
activity by the definition of groups related tosemantic domains, so as to keep collaborative
activities focused on the group’s interests.
During the project period several visits forpresentations and research meetings at Shizuoka
University have been accomplished, and a few
researchers from outside of Japan haveparticipated. In particular the Project Leader
Professor Bottoni travelled to Hamamatsu inNovember 2013, where he was joined by theformer Project leader Professor Mirenkov to carryout joint research with Professor Kanev anddevise schemes for further collaboration. In thisoccasion, a CRP workshop was held, withpresentations by Professors Bottoni, Mirenkov,and Gnatyuk. Professor Bottoni’s visit waspartially sponsored by CRP and partly by theItalian Ministry of Foreign Affairs, under ascheme for promoting research exchanges
between Italy and Japan (namely between
Professor Bottoni and Professor Kanev), which
was promoted starting from the CRP collaboration.
Also starting from the CRP collaboration,
Professor Kanev has been awarded a grant for athree-month visit to Sapienza University of Rome.
The Ministry of Foreign Affairs scheme has alsosponsored the visit of Miguel Ceriani to Shizuoka
University, starting on March 27th.
(3.2) Future work
We will progress in the lines discussed above
leveraging on the results of this year
[4] Publications(1) P.Bottoni,
K.Kanev,
N.Mirenkov,“Constructing collaborative services throughaugmented documents and objects”, Proc.
VINCI 2013, pp.1-10, 2013.

(2) P.Bottoni, K.Kanev, “Towards a flexible
architecture for interaction with augmented
surfaces”, Proc. UMEDIA-HC 2013.
(3) D.Avola, P.Bottoni, A.Hawash, “UsersGroups Matching in an Annotation System:
Ontological and URL Relevance Measures”,
to appear in Proc. CSIT 2014.
(4) D.Avola, P.Bottoni, A.Hawash, “GroupsUsers Matching in an Annotation System
Using Ontologies”, poster presented at
CHItaly 2013.
(5) P.Bottoni, M.Ceriani, “A Dataflow Platform
for In-silico Experiments Based on Linked
Data”, Proc. DNIS 2014, pp.112-131.
(6) K.S.Zelenska, S.E.Zelensky, L.V.Poperenko,
S.G.Rozouvan,
K.Kanev,
V.Mizeikis,V.A.Gnatyuk, “Thermal mechanisms of laser
marking in transparent polymers with lightabsorbing microparticles”, Journal of
Physics: Conference Series, to appear.
(7) V.A.,Gnatyuk, O.I.Vlasenko, S.N.Levytskyi,
K.Kanev, V.,Mizeikis, T.Aoki, S.VGagarsky,
L.V.Poperenko,K.S.Zelenska,
A.O.Statsenko, “Features of laser-induced
damage and creation of marking centers indigital material processing”, Journal ofPhysics: Conference Series, to appear.
(8) M.Ceriani, P.Bottoni, S.Valentini, “A userinterface to build interactive visualizations
for the semantic Web”, demo at ISWC 2013
(9) Y.Watanobe,N.Mirenkov,“Hybridintelligence aspects of programming in*AIDA algorithmic pictures, Future
Generation Computer Systems (Elsevier
B.V., 2014)(10) Y.Watanobe, N.Mirenkov, “Diagram scenes
in *AIDA”, Proc. IEEE 12th Int. Conf. onIntelligent Software Methodologies, Tools
and Techniques

Travelling report
Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Nikolay Mirenkov
School of Computer Science and Engineering, The University of Aizu
November 12, 2013 – Nov 17, 2013
Shizuoka University, JapanTo carry out joint research and participate in the Cooperative Research Workshop“Imaging Devices and Digital Imaging of Semantic Surfaces in Active Knowledge
Management” giving a talk titled “Imaging Aspects of *AIDA Programs Based on
Active Knowledge Acquisition”.
Prof. Kamen Kanev
Paolo Bottoni
Department of Computer Science – Sapienza University of Rome
November 7, 2013 – Nov 16, 2013
Shizuoka University, JapanTo carry out joint research, participate in the Cooperative Research Workshop“Imaging Devices and Digital Imaging of Semantic Surfaces in Active Knowledge
Management” at RIE giving a talk titled “A Model for Interaction through AugmentedSurfaces”. Prof.Bottoni also conducted a special session titled “Possibilities for Joint
Research Collaboration and Exchanges between Sapienza University of Rome andShizuoka University” where all interested participants had a possibility to discuss
opportunities for establishing contacts with potential research partners at Sapienza
University of Rome.
Prof. Kamen Kanev
Nikolay Mirenkov
School of Computer Science and Engineering, The University of Aizu
December 11, 2013 – Dec 19, 2013Shizuoka University, JapanTo carry out joint research and participate in the 16th International Conference on
Humans and Computers held on December 17, 2013 (Hamamatsu) making apresentation entitled “Social and Educational Aspects of 3D Printing”.
Prof. Kamen Kanev