interactive experience retrieval for a ubiquitous home
We present the current status of a system for continuous capture and retrieval of multimedia data from a home-like ubiquitous environment. A large number of cameras and microphones are used for video and audio acquisition. Pressure based sensors mounted on the house floor capture footsteps. The image and floor sensor data are analyzed further to add more functionality to a previously developed system. Basic image analysis is combined with interactive rank selection to identify significant events. A preliminary study is conducted on activity classification based on floor sensor data and we present the results. The system can be queried interactively based on date and time, location, persons, sounds and basic activity in terms of footsteps. After a brief discussion of the results and observations, the paper concludes with suggestions for possible future directions.
ubiquitous environment floor sensors event detection interactive retrieval video retrieval