「様式３」
課題番号P-5

Digital Imaging for Active Knowledge
Semantic Surfaces[1] Organization
Leader: Nikolay Mirenkov (Department ofComputer Science and Engineering, TheUniversity of Aizu)
Representative at RIE: Kamen Kanev (ResearchInstitute of Electronics, Shizuoka University)
Participants:
Michael Cohen (Department of Computer Scienceand Engineering, The University of Aizu)
Noriaki Kamiya (Department of Computer Scienceand Engineering, The University of Aizu)
Jungpil Shin (Department of Computer Science andEngineering, The University of Aizu)
Paolo Bottoni (Department of Computer Science,
Sapienza University of Rome)Peter Sapaty (Institute of Mathematical Machinesand Systems, National Academy of Sciences ofUkraine)
Oleg Monakhov (Inst. of Computational
Mathematics and Mathematical Geophysics,
Russian Academy of Sciences, Siberian Branch)
Tsukasa Ebihara (Green Company)
Rentaro Yoshioka (Department of Computer
Science and Engineering, The University ofAizu)
Yutaka Watanobe (Department of Computer
Science and Engineering, The University ofAizu)
Kanio Dimitrov (Department of Computer Scienceand Engineering, The University of Aizu)
Norbert Gyorbrio (Department of Computer
Science and Engineering, The University ofAizu)[2] Progress of the ResearchThis year we have addressed new aspects ofAmbient Assisted Living (AAL) by investigating
and applying:
1. our concept of semantic surfaces as object
surfaces enhanced by special images forsupporting access to information about object
features, etc., and for organizing interactions
between objects and people, and2. our concept of a world of totally identified
objects as a real world infrastructure, wheremost of the physical objects have their IDs,
which are recognizable by appropriate portableor fixed devices for getting real-time and/or

archive information related to the objects.
The new aspects are based on a wider view of“visualizing the invisible” where not only specificcode images and optical devices for theirrecognition are involved, but also multimedia
formats representing corresponding meaning ofthings play a fundamental role. As a result, thisapproach is becoming a fundamental basis fordeveloping the infrastructure of “Internet of things”
with co-existence of real and virtual worlds wherepeople with very different knowledge and physicalabilities can have access to the same information
resources through different channels and remotely
communicate with each other through different
computer panels and different interface devices. In
other words, people with different knowledge andabilities could have more equal opportunity toaccess to information and communication systems.
This is what we need for an ageing society in theinformation era. More specifically, within thescope of the project we have considered how
semantic surfaces can be directly used for ambientinteractions and intuitive support of the elders anddisabled. In the context of Technically Assisted
Rehabilitation, semantic surfaces could make adifference in the treatment, rehabilitation, andconsequent lifestyle of people in need and ensure
their much desired self-confidence and dignity.
In a sense, anyone has his limitations and canrecognize many things or activities which aredifficult or even impossible for him to do.
Consequently many of the technologicalinnovations that are making our life easier are notdirectly accessible for some people. On the other
hand, many people feel comfortable if they cancontinue the use of some existing things,
technologies, and traditions. In this line we haveinvestigated various Japanese traditions andattempted to blend them with new advanced
technologies such as 3D printing and supportivecomputer graphic tools leading to the developmentof 3D Kanji as prototypes for new accessories,
souvenirs, tea ceremony cups, etc.
We also consider some general cultural issues of
how traditions should be preserved and developed,
and how a multidisciplinary approach combining
rapid prototyping, computer graphics, and fine art
can help in creating new values for promoting

traditions by establishing special forms andactivities.
In addition, we have proposed the use of thesemantic surfaces as a framework for theconstruction of collaborative services where users
can interact in an enriched and focused way withpaper documents and object labels, both in desktop
and mobile settings. We expect that combining
immediate access to online information fromphysical support with creation and retrieval ofannotations, while keeping in focus the context of
their creation, would create a new collaboration
space in which seamless access to both centralized
and distributed information is supported. Suchtechniques are open to several extensions andgeneralizations, including a way towards our worldof totally identified objects. Moreover, thecombination of annotation with technologies basedon unique identification of objects or sheets opens
several scenarios for mobile applications, such as
product evaluation. Producers could use the cluster
patterns to advertise their products and consumers
could share and exchange opinions, express their(dis)satisfaction with the products, and/orrecommend them. In general, several types ofinteraction could be performed to access uniqueinformation on objects and create additional
information.
In the course of the research the problem ofdeveloping information resources for attaching tovirtual versions of objects has been especiallyaddressed. A huge amount of such resources
requires the participation of many people in theirdevelopment.
So,theabovementioned
construction of collaborative services including
involvement of technologies for web-based
annotations is a way for solving the problem.
Related annotations, on the other hand, can changeover time as participants add and modify theminteractively.
During the project period several visits forpresentations and research meetings at Shizuoka
University have been accomplished, and a few
researchers from outside of Japan have participated.
[3] Results(3.1) Research results
Results obtained within the scope of this project
have been presented at six International
conferences and published in corresponding
Proceedings. These make a very good foundation
for a continuing collaboration with researchers
from Italy and Canada demonstrating the additional
potential of the project.

(3.2) Future work
In our future research we are planning to use thepotential of semantic surfaces for solving various
problems of ”Internet of Things” including: developing specific code images and opticaldevices for their remote recognition,
 applying multimedia formats representing
information resources and meaning ofcorresponding things of real world (withorientation to e-health and e-learning),
 introducing collaborative activity for joint
creation of information resources, developing navigation techniques in indoorand outdoor environments.
[4] Publications(1) Kanev, K.. Mirenkov, N., Ambient Assisted
Living and Rehabilitation Support Engaging
Semantic Surfaces, In Proceedings of the 3rd
European Conference Technically Assisted
Rehabilitation TAR2011, Berlin, Germany,March 17-18, 2011. (in print)(2) Kanev, K., Mirenkov, N., Satellite Cloud
Computing, In Proceedings of FINA2011 heldin conjunction with the 25th IEEE Int. Conf. on
Advanced Information Networking andApplications (AINA 2011), Biopolis, Singapore,
March 22-25, 2011. (in print)(3) Mirenkov, N., Yoshioka, R., Kanev, K., Rapid
Prototyping and 3D Kanji Sculpturing, In
Proceedings of the 13th Int. Conf. on Humansand Computers HC’10, Aizu-Wakamatsu,
Japan, December 8-10, 2010, pp. 203-208.
(4) Bottoni, P., Kanev, K., Mirenkov, N.,
Distributed and Context-focused Discussion on
Augmented
Documents
andObjects,
International Reports on Socio-Informatics,Vol. 7, No. 1, 2010, “Workshop Proceedings ofthe 9th Int. Conf. on the Design of Cooperative
Systems”, Aix-en-Provence, France, May 1821, 2010, pp. 298-307.
(5) Watanobe, Yu.,Yoshioka, R., Mirenkov, N.,
Embedded Clarity in Filmification of Methods,
New Trends in Software Methodologies, Tools
and Techniques, H. Fujita (Ed.), IOS Press,
2010, pp. 70-82.
(6) Watanobe, Yu., Mirenkov, N., Yoshioka, R.,
Browsing and Editing Tool for Programming inPictures, Selected Topics in Applied Computer
Science (Proc. of 10th WSEAS Int. Conference
on Applied Computer Science, October 4-6,
Iwate, Japan), 2010, pp. 242-250.

Travelling report
Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Noriaki Kamiya
Department of Computer Science and Engineering, The University of Aizu
May 27, 2010 – May 29, 2010
Shizuoka University, Japan
To participate in joint research meetings and discuss future research activities
Prof. Kamen Kanev

Name:
Affiliation:
Period of time:
Destination:
Purpose:Nikolay Mirenkov
Department of Computer Science and Engineering, The University of Aizu
December 7, 2010 – December 11, 2010
Shizuoka University, JapanTo carry out a joint research and project organization meetings, to schedule future
research activities and to make a presentation related to the project at the 13thInternational Conference on Humans and Computers satellite session in Hamamatsu
Prof. Kamen Kanev

Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Paolo Bottoni
Department of Computer Science, “Sapienza” University of Rome, Italy
December 4, 2010 – December 12, 2010
Shizuoka University, JapanTo discuss joint research and to attend the 13th International Conference on Humans
and Computers at Hamamatsu campus, Shizuoka University
Prof. Kamen Kanev
Nikolay Mirenkov
Department of Computer Science and Engineering, The University of Aizu
March 2, 2011 – March 6, 2011
Shizuoka University, JapanTo plan the future collaboration, coordinate the ongoing research, and participate in acollaborative research seminar organized at RIE with a presentation entitled“Programming in Pictures”
Prof. Kamen Kanev