「様式３」課題番号 ：P-9

Digital Imaging for Active Knowledge
Semantic Surfaces[1] Organization
Leader: Nikolay Mirenkov (School of Computer
Science and Engineering, The University ofAizu)
Representative at RIE: Kamen Kanev and Toru
Aoki (Research Institute of Electronics,Shizuoka University)
Participants:
Noriaki Kamiya (School of Computer Science andEngineering, The University of Aizu)
Michael Cohen (School of Computer Science andEngineering, The University of Aizu)
Shigaku Tei (School of Computer Science andEngineering, The University of Aizu)
Roumen Nikolov (State University of LibraryStudies and Information Technologies)
Paolo Bottoni (Department of Computer Science,
Sapienza University of Rome)
Volodymyr Gnatyuk (V.E. Lashkaryov Institute ofSemiconductor Physics, National Academy ofSciences of Ukraine)
Pavel Boychev (Faculty of Mathematics andInformatics, Sofia University)
Evguenia Kovacheva (Faculty of Mathematics
and Informatics, Sofia University)
Oleg Monakhov (Inst. of Computational
Mathematics and Mathematical Geophysics,
Russian Academy of Sciences, SiberianBranch)
Tsukasa Ebihara (Green Company)
Rentaro Yoshioka (School of Computer Scienceand Engineering, The University of Aizu)
Yutaka Watanobe (School of Computer Scienceand Engineering, The University of Aizu)
Boyan Jekov (State University of Library Studies
and Information Technologies)[2] Progress of the ResearchThis year we have addressed and employed new
aspects of digital imaging and bya) considering various technical aspects of laser
volumetric marking for creation of encoding
areas on surfaces and in the bulk of different
objects and investigating optical means forcode extraction and consequent analysis,b) conducting experiments and numericalsimulations of environmental conditions

related to time-varying flows and dynamic
solid phase changes addressing e-learning inengineering education,c) constructing and implementing special
installations (environments) with digitallyenhanced tangible interface components fordirect and augmented reality interactions ,d) devising and studying image based
interactions oriented to explanations of
meaning of information resources withinvarious educational processes, ande) conducting integration between annotations,surface-based interaction and tangibles.
More precisely, prospects and technical aspects ofcreation of encoding areas inside different objects
by laser volumetric marking have been analyzed.
Unique capabilities of focused, short laser pulses,
to create different kinds of marks (local structuredamages, micro-cracks, voids, pores, optically
active nanoparticles, light-emitting centers, andother optical inhomogeneities) in the volume ofmaterials, which are transparent for the selected
laser wavelength have been studied. Laserinduced marks with varying appearance (or datapixels) can serve as multi-bit information carriers
that open a wide range of new possibilities forvolumetric parameterized marking, encoding, andrecording of digital information. Promising resultsof experiments with different approaches andlaser techniques for creation, monitoring, andmeasurement of such marks have been obtained[1, 4].
The laser-assisted methods and technologies havebeen considered which can be applied for optical
recording of information by creation of micromarks (pixels) in the bulk of various objects
transparent for laser radiation. Along with existinglaser marking technologies based on changing therefractive index of a local material area and its
shape and size, the possibilities of formation ofcolor marks have been discussed, and a new
approach has been analyzed when laser-induced
marks are absorption or emission centers underbacklight illumination [4, 5].
We studied the solid phase dynamic response due
to time-varying duct flows when a portion of aduct wall is cooled to below the liquidus
temperature,
along
which
unidirectional

solidification from the cooling duct wall,
perpendicular to the flow direction, is assumed. A
one-dimensional numerical model for the averagesolid phase thickness has been formulated
employing the boundary tracking method. It isshown that a quasi-steady state temperature in thesolid layer allows us to develop an analyticalsolution, making use of perturbation technique.
The afore-mentioned perturbation analysisidentifies important three non-dimensionalparameters, i.e. the Biot number based on thesolid phase thickness at steady state, the Stefan
number based on the temperature difference
between the cooling wall and the liquidus
temperatures, and the Stefan number based on theliquidus and the flowing liquid temperatures.
Results obtained by both approaches agree well in
general, and the time-variation trends of solid
phase thickness and its phase delay have beenobtained as a function of the non-dimensional
angular frequency of the modulating duct flow
velocity, with the above three non-dimensionalparameters. Various applications in practicalengineering and in engineering education havebeen identified and are being addressed by thedeveloped Graphical Interface Framework for
Educational and Engineering Support [2].
Our work has also included considering digital
object and environmental enhancements throughdurable surface and undersurface encoding byprinting and laser marking. While resulting
augmented physical objects and environmental
surfaces preserve their usual appearance, they
become easily recognizable and tractable byoptical means. Based on such encodings novel
interaction mechanisms have been developed andconcrete works on interior pattern design andphysical interface component constructions havebeen done along with their applications in thecreation and employment of tangible interfaces
and image-based interactions [3].
The natural intelligence is related, in a great part,with people abilities to perform mental simulation,
including thinking/reasoning, problem solving,and decision making. However, this simulation
depends not only on internal information
processing mechanisms of the brain, but also onlevels of abstraction connecting the physicalworld things and corresponding abstract models.
Perception and cognition of people are usuallymuch higher if they perform
mentalmanipulations with real objects, and essentiallydecreased if abstract information objects areinvolved. Syntax-semantics gap is a fundamental
basis for many problems related to the perception
and cognition. This gap is predefined by existing

systems of symbols, notations, languages, as well
as by ambiguous terminologies, trans-disciplinary
and cross-cultural contexts, etc. We haveaddressed this issue in our tangible interfaces andimage-based interactions and obtained really newresults [6, 7].
We also considered DfPL, an RDF-based pipeline
language for RDF and XML processing [8].
Applications are built using a few basic operatorsthat compose single RDF graphs or datasets tocreate new graphs or datasets. RDF graphs can
include both static and dynamic content. The
language includes stateless operators (graph unionand SPARQL CON-STRUCT) as well as astateful one ("SPARQL updatable" graph). We
also present SWOWS, an environment running
event-based applications specified via DfPL,
supporting both GUIs and touch/tangibleinterfaces.
During the project period several visits forpresentations and research meetings at Shizuoka
University have been accomplished, and a few
researchers from outside of Japan haveparticipated. In particular the Project Leader
Professor Mirenkov travelled to Hamamatsu inFebruary 2012 to carry out joint research andproject organization meetings, to schedule future
research activities, and to participate and reportobtained results at the 15th International
Conference on Human and Computers HC2012.
Dr. Gnatyuk’s visit to Hamamatsu in JanuaryFebruary 2012 was also partially covered by thebudget of this cooperative research project. In thecourse of his visit research meetings were held
and the presentation “Volumetric Marking withLaser-Induced Parameterized Centers” was madeat the 15th International Conference on Humanand Computers HC2012. Professor Kanev visited
Sapienza Universita di Roma in June 2012 andwas hosted by Professor Bottoni who is scheduledfor a three-month research visit to Shizuoka
University in April-June 2013.
[3] Results(3.1) Research results
Results obtained within the scope of this project
have been presented at nine International
conferences and published in corresponding
Proceedings. International collaboration withresearchers from Bulgaria, Canada, Ukraine andItaly has been successfully continued. In
particular, some work in view of an integration
between annotations, surface-based interaction
and tangibles has been conducted in Italy, leading
to two publications, concerning the definition of alanguage for managing interaction with elements
based on RDF, with application to surface-based
interaction [8], and protection of annotations togroups of users sharing some common interest
identified via semantic web techniques [9].
(3.2) Future work
We are planning to use the potential of our results
obtained within the project during the previousyears. We will consider extensions of the tangible
and image based interfaces, cognitive aspects ofsuch interfaces and their use in research andeducational processes.
[4] Publications(1) Gnatyuk, V.A., Kanev, K.D., Mizeikis, V.,
Aoki, T., Gagarsky, S.V., Poperenko, L.V.,
Laser Volumetric Marking and Recording ofDigital Information, The 10th Int. Conf. on
GlobalResearchandEducation
InterAcademia2012, Budapest, Hungary,August 26-30, 2012, pp.189-200.
(2) Kimura, S., Yamamoto, H., Kanev, K.,
Periodic Solidification in a Rectangular Duct
Due to Velocity Modulation; Onedimensional Analysis, In Proceedings of theInt. Conf. Automatics and Informatics’12,Sofia, Bulgaria, October 3-5, 2012, pp.17-21.
(3) Kanev, K., Augmented Tangible Interface
Components and Image Based Interactions,International Conference on Computer
Systems and Technologies CompSysTech’12,
Ruse, Bulgaria, June 22-23, 2012, pp.23-29.
(4) Gnatyuk, V., Kanev, K., Mizeikis, V., Aoki, T.,

Gagarsky, S., Poperenko, L., Volumetric
Marking with Laser-Induced ParameterizedCenters, In El. Abs. of the 15th Int. Conf. onHumans and Computers HC2012, Hamamtsu,Japan, February 11-12, 2013, pp.21-22.
(5) Mizeikis, V., Kanev, K., Gnatyuk, V.,
Automated
SystemforExperimental
Localization Encoding by Laser-induced
Damage, 2012 Symposium on Nanovision
Technology, Taipei, Taiwan, October 19, 2012.
(6) Watanobe, Y., Mirenkov, N., F-modelingenvironment: acquisition techniques for
obtaining
special-purpose
features,
Proceedings of Databases in Networked
Information Systems, DNIS-2013, LNCS
7813.
(7) Watanobe Y., Shiota, T., Mirenkov, N., Unitsof Measure Analysis and its Implementation
for AIDA, New Trends in Software
Methodologies, Tools, and Technologies(Proceedings of the 11-th SoMet-12), IOS
Press, 2012, 198-212.
(8) Bottoni, P., Ceriani, M.G., Medaglia C.M., An
Event-Supporting
RDF-Based
Pipeline
Language for RDF Processing, Proc. of theFirst Workshop on Programming theSemanticWeb(PSW2012),
http://www.inf.puc-rio.br/~psw12/2.pdf(9) Avola, D., Bottoni, P., Hawash, A. Using
Ontologies for Users-Groups Matching in an
Annotation System, Proc. of CSIT 2013, (toappear).

Travelling report
Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Nikolay Mirenkov
School of Computer Science and Engineering, The University of Aizu
February 10, 2013 – February 16, 2013
Shizuoka University, JapanTo carry out joint research and project organization meetings, to schedule future
research activities, and to participate and report obtained results at the 15th
International Conference on Human and Computers HC2012.
Prof. Kamen Kanev
Volodymyr Gnatyuk
V.E. Lashkaryov Institute of Semiconductor Physics, National Academy of Sciences ofUkraine
January 14, 2013 – February 17, 2013
Shizuoka University, JapanTo carry out joint research, plan the future collaboration, and participate and reportobtained results at the 15th International Conference on Human and Computers
HC2012.
Prof. Kamen Kanev