Finding the correspondence of audiovisual events by object manipulation
| العنوان: | Finding the correspondence of audiovisual events by object manipulation |
|---|---|
| المؤلفون: | Tetsuya Matsumoto, Yoshinori Takeuchi, Hiroaki Kudo, Kento Nishibori, Noboru Ohnishi |
| المصدر: | Electronics and Communications in Japan. 92:1-13 |
| بيانات النشر: | Wiley, 2009. |
| سنة النشر: | 2009 |
| مصطلحات موضوعية: | Similarity (geometry), Simultaneity, Computer Networks and Communications, Computer science, Event (computing), Microphone, business.industry, Applied Mathematics, General Physics and Astronomy, Object (computer science), Motion (physics), Signal Processing, Gestalt psychology, Robot, Computer vision, Artificial intelligence, Electrical and Electronic Engineering, business |
| الوصف: | A human being understands the objects in the environment by integrating information obtained by the senses of sight, hearing, and touch. In this integration, active manipulation of objects plays an important role. We propose a method for finding the correspondence of audiovisual events by manipulating an object. The method uses the general grouping rules in Gestalt psychology, that is, “simultaneity” and “similarity” among motion command, sound onsets, and motion of the object in images. In experiments, we used a microphone, a camera, and a robot which has a hand manipulator. The robot grasps an object like a bell and shakes it or grasps an object like a stick and beats a drum in a periodic, or nonperiodic motion. Then the object emits periodic/nonperiodic events. To create a more realistic scenario, we put another event source (a metronome) in the environment. As a result, we had a success rate of 73.8% in finding the correspondence between audiovisual events (afferent signal) which are related to robot motion (efferent signal). © 2009 Wiley Periodicals, Inc. Electron Comm Jpn, 92(5): 1–13, 2009; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/ecj.10087 |
| تدمد: | 1942-9541 1942-9533 |
| الوصول الحر: | https://explore.openaire.eu/search/publication?articleId=doi_________::828dd124db5b519561ede511611f0096Test https://doi.org/10.1002/ecj.10087Test |
| حقوق: | CLOSED |
| رقم الانضمام: | edsair.doi...........828dd124db5b519561ede511611f0096 |
| قاعدة البيانات: | OpenAIRE |
| تدمد: | 19429541 19429533 |
|---|