Shiori Sasaki

This paper describes about project “Data Sensorium” launched at the Asia AI Institute of Musashino University. Data Sensoriumis a conceptual framework of systems providing physical experience of content stored in database. Spatial immersive display is a key technology of Data Sensorium. This paper introduces prototype implementation of the concept and its application to environmental and architectural dataset.

Multispectral image becomes widely used for environmental analysis to detect an object or phenomena that human eyes cannot capture. One of the main type of images acquired by remote sensing such as satellite or aircraft for earth observation. This paper presents a multispectral analysis for aerial images that captured by dual cameras (visible and infrared camera), which are mounted on an unmanned autonomous vehicle (UAV) or Drone. In our experiments, four spectral bands (three visible and one infrared band) were imaged, processed and analyzed to detect agricultural area and measure the health of vegetation. To interpret environmental phenomena and realize an environmental analysis, this study applies semantic analysis by creating a multispectral semantic image space, combined with three numerical indicators (the normalized difference vegetation index (NDVI), the normalized difference water index (NDWI) and the soil adjusted vegetation index (SAVI)) that can be used to analyze plant health, photosynthetic activity and detect environmental object to determine an agricultural area. This paper also proposed the concept of multi-spectrum semantic-image space for agricultural monitoring by defining the correlation meaning from multi-dimensional parameters which related to agricultural analysis to realize and explain agriculture conditions. This paper presents the experimental study on a rice field, a cornfield, a salt farm and a coconut farm in Thailand.

This paper presents real-time sensing, processing and actuating functions of a collaborative knowledge sharing system called 5D World Map System, and the applications in the field of multidisciplinary environmental research and education. The first objective is to integrate the analysis of sensing data into a knowledge sharing system with multimedia, based on the framework of Sensing-Processing-Actuation of Cyber-Physical Systems. The proposed real-time sensing, processing and actuating functions enable multiple remote-users to acquire real-time sensing data from multiple sites around the world, perform analytical visualizations of the acquired sensing data by the selected calculation methods on the system to discover the incidental phenomena, and provide the analysed results to related users' terminal equipment automatically. The second objective of the research is to realize a new multidimensional data analysis and knowledge sharing system for a collaborative environment by applying the concept of "differential computing" to the analysis of sensing data. Especially, in the processing function, the time-series difference of the value of each sensor, the differences between the values of multiple sensors in a selected area, and the timeseries differences between the values of multiple sensors, are calculated, to detect an environmental incident and estimate the possibility of occurrence of the same kind of incident in the neighboring sites within the same area. By using 5D World Map System integrated with these functions, the users are able to perform a global analysis on the environmental sensing data along with the related multimedia data on a single view of time-series maps, based on the spatiotemporal and semantic correlation calculations.

Purpose – The purpose of this paper is to present the design and implementation of music courseware that features a music search system that uses impression keywords. The paper applies the courseware to Kansei (sensibility) development for elementary and junior high school students. The objectives of this courseware are to cultivate children's sensitivity to the mood of a music selection an understanding of the effects of tonality on the mood of the music and) an ability to appreciate and express music through activities such as searching, selecting, and listening while also utilizing information about musical impression. The courseware is also designed to support teachers who do not specialize in music education. Design/methodology/approach – Music courseware is designed containing the following three components: a semantic associative search engine that enables the retrieval of media data related to impression keywords selected by users interfaces and tools for music retrieval and learning, which support users as they study the mood of the music in an easy-to-understand format using basic music teaching scenarios and basic music teaching scenarios that are designed and created by elementary school teachers to encourage student understandings of the tonality and mood of the music in a practical manner. Findings – The results of several qualitative and quantitative experiments show that this courseware assists children in independently learning musical elements by feeling, understanding, and expressing music impressions using words from the courseware that are extracted automatically from musical elements, such as key, rhythm, tempo, pitch, melody, and harmony. Research limitations/implications – Additional applications in various elementary and junior high school settings are needed to address a variety of practical, real-life teaching scenarios. Social implications This courseware have the potential to support enrichment programs not only in ordinary schools but also in a wide range of non-educational settings, such as welfare care, disability care, and cross-cultural communication. Originality/value – The main feature of this courseware is its multimedia database technology, which applies Kansei to music education, thereby enabling students to understand the mood and structure of music based on their own subjective impressions using an objective framework. © 2010, Emerald Group Publishing Limited

This paper presents a design and implementation for the "4D World Map System," a knowledge representation system which enables semantic, temporal and spatial analysis of documents, and integrates and visualizes the analyzed results as a 4-dimentional dynamic historical atlas (4D World Map Set). The main feature of this system is to create various context-dependent patterns of historical/cultural stories according to a user's viewpoints dynamically. This system generates multiple views of semantic and temporal-spatial relationships among documents of the humanities and social sciences. This system organizes the relationships among documents into various historical/cultural stories by a user's viewpoints. A semantic associative search method is applied to this system for realizing the concept that "semantics" of words, documents, and events vary according to the "context". Semantically-evaluated and analyzed document data are also mapped dynamically onto a time-series multi-geographical space. This system provides high visibility of semantic correlations between documents in time series variation with geographic information. In this paper, we also show several experiments by using news articles and International Relations documents to clarify the feasibility of the system.

Cultural computing is an emerging field of multidisciplinary computer science. In the near future, cultural computing will have several important applications in the fields of business, knowledge society, environmental issues, health care, education and research. Our paper is written in collaboration with the authors, who are also participants in the collaborative research project "Ubiquitous Cross-Cultural Multimedia Systems for Mobile Computing Societies/Ubiquitous Cross-Cultural Knowledge Space". The issues discussed in our paper cover background knowledge related to cultural computing, general discussion of culture as a concept, an introduction to the concept and basic design of the Electronic Assistant for Cross-Cultural Communication, and an introduction to the design and implementation of the 3D Cross-Cultural Multimedia Museum" system and its applications. The 3D Cross-Cultural Multimedia Museum has been implemented as a prototype system of Cross-Cultural Cyber Space. The global changes caused not only by scientific and technological development, but by environmental issues as well, are our driving forces towards the era of cultural computing. Our paper is based on the presentations of the panel discussion at the EJC 2009 Conference.

This paper presents a dynamic image-query creation and metadata extraction method with semantic correlation computation between color-combinations and impressions of multiple image data. The main features of our method are (1) to create an image-query which reflects user's intention dynamically according to the color-based combinations of images with common features selected by a user as context, (2) to extract appropriate impression by each image collection which cannot be easily extracted from a single image, (3) to provide users an image retrieval environment reflecting historical and cultural semantics and impression of color especially for cultural properties, and (4) to enable an image retrieval environment for the collection of images by time, culture, author e.t.c.. The queries are created by the combination of multiple image sets and operations, which are intersection, accumulation, average, difference of color elements of sample images. First, a set of multiple images with common features is set as sample data for a query creation. Second, color histograms are extracted from the image sets for creating feature vector of a query. Third, the correlations between an image-query vector and target image vectors are calculated on a space which represents the relationship between color and the impression according to historical and cultural semantics of color. This image-query creation method representing impression of color makes it possible to expand the range of image retrieval for a large number of image data of cultural property in digital archives, such as electronic library and electronic museum, automatically. © 2009 The authors and IOS Press.

In this paper, we present a new creation method of a semantic retrieval space for a specialized field of study, especially for the field of International Relations (IR), and new evaluation criteria for verifying practical effectiveness of the created space. This space creation method needs only a general dictionary and a lexicon of the technical terms for a specific field. Using the newly created space, we realized semantic associative search for documents which include various technical terms with general words, and also documents which include general words with technical terms. Furthermore, to verify practical effectiveness of the space creation method, that is, how much knowledge we can acquire from the created space newly, we present some evaluation criteria besides precision and recall