「様式３」課題番号 ：P-14

Digital Imaging for Active Knowledge
Semantic Surfaces[1] Organization
Leader: Nikolay Mirenkov (School of Computer
Science and Engineering, The University ofAizu)
Representative at RIE: Kamen Kanev (ResearchInstitute of Electronics, Shizuoka University)
Participants:
Noriaki Kamiya (School of Computer Science andEngineering, The University of Aizu)
Michael Cohen (School of Computer Science andEngineering, The University of Aizu)
Shigaku Tei (School of Computer Science andEngineering, The University of Aizu)
Roumen Nikolov (State University of LibraryStudies and Information Technologies)
Pavel Boychev (Faculty of Mathematics andInformatics, Sofia University)
Evguenia Kovacheva (Faculty of Mathematics andInformatics, Sofia University)
Boyan Jekov (State University of Library Studies
and Information Technologies)
Paolo Bottoni (Department of Computer Science,Sapienza University of Rome)
Oleg Monakhov (Inst. of Computational
Mathematics and Mathematical Geophysics,
Russian Academy of Sciences, Siberian Branch)
Tsukasa Ebihara (Green Company)
Rentaro Yoshioka (School of Computer Scienceand Engineering, The University of Aizu)
Yutaka Watanobe (School of Computer Scienceand Engineering, The University of Aizu)[2] Progress of the ResearchThis year we have focused on employment of 3D
and multimedia aspects of interfaces involved incomputer-based supportive systems and related tointeractions between objects and people. These
aspects are based on a wider perspective of“visualizing the invisible” where (in addition tospecific code images and optical devices) 3D,
tangible and multimedia forms and formats play afundamental role.
Education is one of important applications for ourresearch. Within its framework, a new learning
environment has been proposed, where 2D kanji,
their parts, and corresponding edge encoded cards
are integrated with 2.5D and 3D versions of kanji
and kanji parts to support developing new forms ofeducational tools and materials. These forms allow

incorporating new tangible associations as well asother associations that might have positive
influenceonchildren’s
perception
andmemorization. Learning of kanji is a complex
process that requires significant time and effort forunderstanding fundamentals of kanji construction,
developing adequate writing skills, retention ofproper meaning and language use, etc. Research
performed is related to earlier stages of kanji
learning where basic understanding of kanji
composition takes place and tangible associations
are being established. Written kanji are essentiallyflat and thus resemble alphabet characters andnumerals but in contrast to them many kanji andkanji components are derived from, and thus
directly associated with existing physical artifacts
and notions. For novice kanji learners, however, it
is usually very hard to analyze and map kanji andkanji components to existing artifacts. We attempt
to facilitate this process by introducing various
tangible kanji representations and bringing flat,
written kanji back to the tangible 3D world wherelearners can get proper touch and feel of them.
Other research results, related to Technology
enhanced learning (TEL), show how and by which
methods multidisciplinary, interdisciplinary, andpandisciplinary educational content can be created,and how its presentation in different forms can beorganized. Tangible interfaces based on digitallyenhanced physical objects, including printed
documents, combined with animation based
interfaces demonstrating processes of geometricalobject creation are a practical way for developing
novel educational environments.
Programming in pictures could further enhance thedevelopment of new educational materials anddedicated content in such environments. In fact,programming in pictures is an approach wherepictures (images) and moving pictures are used assuper-characters for representing features ofcomputational algorithms. Within this approachsome "multidimensional data spaces" are traversed
by "fronts of computation" and necessary
operations are performed during these traversalprocesses. Generic pictures of the algorithmic
super-characters are used to compose compound
pictures (called algorithmic CyberFrames) defining
algorithmic steps. Compound pictures areassembled into special series to represent somepredefined algorithmic features. The series areassembled into Algorithmic CyberScenes and an
Algorithmic CyberFilm. The generic andcompound pictures are developed and acquired inalgorithmic super-character galleries wheresupportive pictures of embedded clarity
annotations are also included.
Our results show how this technique can be used
for creating new information resources and new
educational materials for teaching courses on
algorithms and programming.
Among other considerations and results obtained
within the project, educational framework forverification of object-oriented programs, methods
for localization encoding in the bulk of physicalobjects by laser-induced damage, and anenvironment for sound localization experiments
and automation should be mentioned.
During the project period several visits forpresentations and research meetings at Shizuoka
University have been accomplished, and a few
researchers from outside of Japan have participated.
[3] Results(3.1) Research results
Results obtained within the scope of this project
have been presented at four International
conferences and published in corresponding
Proceedings. In addition, two papers have been
published in journals and one more has appeared asa book chapter. International collaboration withresearchers from Bulgaria and Canada has been
essentially enhanced and a new basis forcontinuing joint research activity has been
established.
(3.2) Future work
We are planning to use the potential of our results
obtained within the project during the previousyears.
We will consider extensions of the tangible 2.5D
kanji based constructions to true 3D Kanji. Whilein the virtual world such constructions a fairly
straightforward dividing a physical 3D Kanji into
parts may be difficult. We will be studying,
therefore, different possibilities to design andcreate 3D models of tangible Kanji that are
essentially different from the previously known 3D
Kanji and can be physically disassembled andassembled in the 3D space.
The educational framework for verification ofobject-oriented programs will also be considered.
We plan to put the focus on project-based learningand related verification approaches. Examples oferrors that are difficult to localize by dynamicalverification methods will be presented.
The plan of our continuing collaboration will also
include various interface layers that connect theusers and information resources representing
semantic of virtual objects or content ofeducational materials.
[4] Publications(1) Kanev, K., Oido, I., Yoshioka, R., Mirenkov,N., Employment of 3D Printing for Enhanced
Kanji Learning, In Proceedings of The Joint
International Conference on Human-Centered
Computer Environments HCCE 2012, AizuWakamatsu, Japan, March 8-13, 2012, pp.165170.
(2) Watanobe, Y., Yoshioka, R., Mirenkov, N.,
Programming in pictures: a way toward
reliable software, In New Trends in Software
methodologies, Tools and Techniques, IOS
Press, 2011, pp.183-197.
(3) Watanobe, Y., Yoshioka, R., Mirenkov, N.,
Cognitive aspects of programming in pictures,
Modern Approaches in Applied Intelligence,
LNAI 6704, Part 2, Springer, 2011, pp. 11-20.
(4) Boytchev, P., Kanev, K., Nikolov, R.,
Technology Enhanced Learning with Subject
Field Multiplicity Support, In Proceedings ofThe Joint International Conference on HumanCentered Computer Environments HCCE 2012,
Aizu-Wakamatsu, Japan, March 8-13, 2012,
pp.39-44.
(5) Kimura, S., Ueda, M., Kanev, K., Dynamic
Solidification in a Square Cavity Cooled fromthe Top and Periodic Heating at the Bottom, In
Proceedings of the Int. Conf. Automatics andInformatics’11, Sofia, Bulgaria, October 3-7,
2011, pp.195-199.
(6) Kimura, S., Ueda, M., Kanev, K., Timedependent Solidification in a Square Cavity
with a Temperature-modulated Liquid Layer
Cooled from Above, Information Technologiesand Control (accepted).
(7) Kanev, K., Kimura, S., Collaborative Learningin Dynamic Group Environments, Book
chapter in “Distance Education Environments
and Emerging Software Systems: newTechnologies”, Qun Jin (Ed.), IGI Global, 2011,
pp.1-14.
(8) Ranaweera, R., Cohen, M., Endo, S., iBaton:
Conducting
VirtualConcerts
UsingSmartphones, In Proceedings of The Joint
International Conference on Human-Centered
Computer Environments HCCE 2012, AizuWakamatsu, Japan, March 8-13, 2012, pp.179183.
(9) Nishimura, K., Cohen, M., iMedia Players forAccessibility, In Proceedings of The Joint
International Conference on Human-Centered
Computer Environments HCCE 2012, AizuWakamatsu, Japan, March 8-13, 2012, pp.184189.

(10) Weerasinghe, P. K., Cohen, M., Rhythm ofMusic Animating Virtual Environment Models,
In Proceedings of The Joint International
Conference on Human-Centered Computer
Environments HCCE 2012, Aizu-Wakamatsu,Japan, March 8-13, 2012, pp.200-202.
(11) Vazhenin, D., Mirenkov, N., Vazhenin, A.,
Movie-based representation of reduction
operations
innumericalcomputing,Knowledge-Based Systems, 24, 2011, Elsevier,977-988.

Travelling report
Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:Name:
Affiliation:
Period of time:
Destination:
Purpose:Name of receiver:

Nikolay Mirenkov
School of Computer Science and Engineering, The University of Aizu
August 29, 2011 – September 2, 2011
Shizuoka University, JapanTo carry out a joint research and project organization meetings and to schedule futureresearch activities.
Prof. Kamen Kanev
Pavel Boytchev
Faculty of Mathematics and Informatics, Sofia University
March 6, 2012 – March 14, 2012
Shizuoka University, JapanTo carry out a joint research, plan the future collaboration, and participate and reportobtained results at The Joint International Conference on Human-Centered Computer
Environments HCCE 2012.
Prof. Kamen Kanev
Nikolay Mirenkov
School of Computer Science and Engineering, The University of Aizu
March 8, 2012 – March 13, 2012
Shizuoka University, JapanTo plan the future collaboration, coordinate the ongoing research, and participate in
The Joint International Conference on Human-Centered Computer Environments
HCCE 2012.
Prof. Kamen Kanev