「様式３」課題番号 P-8

Digital Imaging for Active Knowledge
Semantic Surfaces[1] Organization
Leader: Nikolay Mirenkov (Department ofComputer Science and Engineering, TheUniversity of Aizu)
Representative at RIE: Kamen Kanev (ResearchInstitute of Electronics, Shizuoka University)
Participants:
Rentaro Yoshioka (Department of Computer
Science and Engineering, The University ofAizu)
Yutaka Watanobe (Department of Computer
Science and Engineering, The University ofAizu)
Michael Cohen (Department of Computer Scienceand Engineering, The University of Aizu)
Jungpil Shin (Department of Computer Science andEngineering, The University of Aizu)
Norbert Gyorbrio (Department of Computer
Science and Engineering, The University ofAizu)
Kanio Dimitrov (Department of Computer Scienceand Engineering, The University of Aizu)
Tsukasa Ebihara (Green Company)[2] Progress of the Research
In this project we address some technologicalaspects of Ambient Assisted Learning (AAL) by
investigating and deploying innovative methods
and facilities for ambient information control. We
attach spatial connotation to real world surfaces
and create semantic surfaces for direct ambientinteractions. Although different technologies canbe employed for the implementation of semantic
surfaces, our work focuses mainly on opticalmethods for surface encoding and consecutive code
extraction and recognition.
Surfaces around us such as indoor walls, windows,
product packing, newspapers and many others
could be digitally enhanced with embedded spatial
information for surface based interactions.
Recognition of surface semantic could then be
implemented through specialized optical readersthat extract the spatial digital content and employ it
for ambient interface control.
Within the scope of this project we also develop an
infrastructure for visualizing the invisible and forsupporting the understanding of corresponding
things and their features. The infrastructure builds

on the concepts of semantic surfaces and totallyidentified objects.
A semantic surface is an object surface enhancedby special images (codes) [and/or embedded chips(devices)] for supporting access to information
about object features, etc., and for organizing
interactions between objects and people.
A world of totally identified objects is a real world
infrastructure, where most of the physical objects
have their IDs (or sets of IDs for various parts,
their connections, etc.), which are recognizable byappropriate portable or fixed devices for getting
real-time and/or archive information related to theobjects.
In the course of the research the following
problems have been identified and addressed:z creation and deployment of semantic surfacesz extraction of semantic surface encoded
informationz access to meaning through semantic surfaces
On a more practical level, the following tasks havebeen carried out:z analysis of existing codes and evaluation of
their applicability to semantic surfaces ofdifferent scales
z comparison of semantic surfaces with otherlocalization (e.g. GPS) and identification (e.g.
RFID) methods
z consideration of different watermarking
techniques in the context of semantic surfaces
During the project period 7 visits for presentations
and research meetings at Shizuoka University havebeen accomplished.
[3] Results(3.1) Research results
Results obtained within the scope of this project
have been reported at international conferences andpublished in books and reputable international
journals. With a total of 12 published works theresearch outcome of the project well exceeds theinitial goals and makes a very good foundation for
a continuing collaboration.
The more detailed investigation of the newsputerconcept has already started with possiblefunctionality and applications being identified asfollows:

zobtaining ratings of articles and topics, etc. aswell as various statistics
z organizing new types of polls to better know
people needs, feelings, intensions, problems,
and troubles
z multimedia support to people with special
needs including the elderly and disabledz static text/picture advertising with dynamic
video and sound support
z direct real-time access to databases,
dictionaries, encyclopedias, weather sites,
stock exchange data, etc.
z ontology-based information retrieval(3.2) Future work
In our future research we are planning to build on
the potential of semantic surfaces to offer solutions
such as:z robot vision for navigation in indoor andoutdoor environments, based on recognition ofsemantic surface codesz magic sticks with semantic surface tracking
capabilities for guidance of visually impairedz newsputers (an abbreviation from newspaper& computer) that offer a new way to create
and access information resources
Semantic surfaces along with the practicalimplementation of the newsputer concept areexpected to become a basis for a new form ofactive knowledge acquisition with embedded
clarity. Such active knowledge is for easily finding
necessary information and for understanding andusing it with no delays. To realize it, multiple
views and self-explanatory components that
pronounce the semantic richness of knowledge data
will be employed.
For further strengthening the research team andinternationalizing the project we will be invitingprominent researchers from outside of Japan to join.
[4] Publications(1) Kanev, K., Mirenkov, N., Pervasive Carpet
Encoding for Active Knowledge Semantic
Surfaces, Book chapter in “UbiquitousMultimedia Computing”, Qing Li and Timothy
K. Shih (Eds), Chapman & Hall/CRC Press,2010, pp.197-213.
(2) Dimitrov, K., Kanev, K., Kimura, S., Product
Recommendations in Mobile Environments,
Information Technologies and Control, Vol. 7,
No 3, pp.10-14, 2009.
(3) Mirenkov, N., Kanev, K., Takezawa, H.,
Mobile Music Therapy with Multimedia
Quality of Life Supporters for Elderly andDisabled, Journal of Mobile Multimedia:

Special Issue on Multimedia Networking andApplications, Vol. 5, No. 1, pp. 29-44, 2009.
(4) Cohen, M., Gyorbiro, N., Kanev, K., Printbased Interfaces for Multimodal Virtual Tours.
Cryptosteganographic
Affordancesfor
MultimodalInterfaces
andImmersive
Experiences, In Proceedings of the 12th Int.
Conf. on Humans and Computers HC’09,
Hamamatsu, Japan, Dec. 9-10, 2009, pp.26-32.
(5) Dimitrov, K., Mirenkov, N., Kanev., K.,
Towards a World of Totally Identified Objects,
In Proc. of the 2009 Joint Conf. on Pervasive
Computing (JCPC2009), Taiwan, Dec. 3-5,
2009, pp.83-88.
(6) Kanev, K., Mirenkov, N., Brimkov, B.
Dimitrov, K., Semantic Surfaces for Business
Applications, In Proceedings of the Int. Conf.
on Software, Services and SemanticTechnologies s3t2009, Sofia, Bulgaria, Oct. 2829, 2009, pp.36-43.
(7) Dimitrov, K., Kanev, K., Kimura, S., Product
Recommendations in Mobile Environments, In
Proceedings of the Int. Conf. Automatics andInformatics’09, Sofia, Bulgaria, Sept. 29-Oct.
4, 2009, pp.17-20.
(8) Dimitrov, K., Kanev, K., Mirenkov, N.,
Semantic Surfaces in Ambient Assisted Living
Environments, In Proceedings of the First Int.
Workshop on Aware Computing (IWAC09),Aizu Wakamatsu, Japan, Sept. 17-18, 2009,
pp.717-722.
(9) Watanobe, Y., Mirenkov, N., Yoshioka, R.,
Algorithm library based on algorithmic
cyberFilms. Knowledge.-Based Syst. 22(3):
195-208 (2009)(10)Watanobe, Y., Malyshkin, V., Yoshioka, R.,
Mirenkov, N., Fujita, H., Filmification of
Methods: Representation of Particle-In-Cell
Algorithms, In
Proceedings of 10thInternational
Conferenceon
ParallelComputingTechnologies,
PaCT-2009,
September, Novosibirsk, Russia, LNCS 5698,
Springer, 360-376.
(11)Watanobe, Y., Yoshioka, R., Tsukumoto, S.,
Mirenkov, N., Filmification of methods:
Convex Hull algorithms, in Proceedings ofIEEE TENCOM 2009 (Emerging Technologies
for Sustainable Development), November,Singapore, 2009, THU2.4.1, 1-6.
(12) Bottoni, P., Vazhenin, D., Vazhenin, A.,
Mirenkov, N., Shape-based computation on
regular processor networks, in Proceedings ofIEEE Symposium on Visual Languages andHuman‐CentricComputing,Corvallis,Oregon, September 2009, 165-169.

Travelling report
Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Nikolay Mirenkov
Department of Computer Science and Engineering, The University of Aizu
July 16, 2009 – July 19, 2009
Shizuoka University, JapanTo carry out a joint research and project organization meetings and to schedule future
research activities
Prof. Kamen Kanev
Jungpil Shin
Department of Computer Science and Engineering, The University of Aizu
September 3, 2009 – September 5, 2009
Shizuoka University, Japan
To participate in joint research meetings and to schedule future research activities
Prof. Kamen Kanev
Kamen Kanev
Research Institute of Electronics, Shizuoka University, Japan
September 17, 2009 – September 18, 2009
The University of Aizu, JapanTo attend joint research and project organization meetings and to participate in IWAC
2009 where project results were reported
Prof. Nikolay Mirenkov
Michael Cohen
Department of Computer Science and Engineering, The University of Aizu
December 9, 2009 – December 10, 2009
Shizuoka University, Japan
To participate in joint research meetings and to give a presentation, based on project
results, at HC-2009Prof. Kamen Kanev
Norbert Gyorbrio
Department of Computer Science and Engineering, The University of Aizu
December 9, 2009 – December 11, 2009
Shizuoka University, Japan
To participate in joint research collaborative meetings and discussions
Prof. Kamen Kanev
Jungpil Shin
Department of Computer Science and Engineering, The University of Aizu
January 27, 2010 – January 29, 2009
Shizuoka University, JapanTo discuss joint research and give a presentation supported by this projectProf. Kamen Kanev
Nikolay Mirenkov
Department of Computer Science and Engineering, The University of Aizu
February 4, 2010 – February 6, 2009
Shizuoka University, Japan
To conduct joint research and project organization meeting and to give a presentation
about the project research progress
Prof. Kamen Kanev
Paolo Bottoni
Department of Computer Science, “Sapienza” University of Rome, Italy
February 11, 2010 – February 13, 2010
Shizuoka University, JapanTo discuss joint research and to give a presentation, supported by this projectProf. Kamen Kanev