Sound Bot is a sound processing device and method that enables natural behavioural responses from robots to the speech of a user even when music, speech, and noise are simultaneously input. By reducing the influence of noise in sound processing, Sound Bot accurately detects beat intervals and provides instructions to the machine towards improved human/robot interactions. Although Sound Bot has been successfully tested using humanoid robots, it finds applications in a wide range of scenarios involving voice command and multiple sound inputs.
Challenge | Opportunity
In recent years, robots such as humanoids or home robots performing social interactions with persons have actively been studied. The study of musical interaction in which a robot is allowed to hear music and is allowed to sing a song or to move its body to the music is important to allow the robot to give a natural and rich expression. In order to allow a robot to hear speech or music, it is necessary to mount a sound collecting device such as a microphone on the robot. However, sound collected by the sound collecting device of the robot includes a variety of noise. In this way, when the S/N ratio of the collected audio signal is lowered, accuracy of speech recognition is lowered, affecting the interaction between robots and the environment where they operate.
- Allows accurate beat intervals detection from a music signal, by reducing the influence of noise.
- With this invention robots can correctly interpret sound to act accordingly in noise complex environments
- Enables correct behavioural response to speech of a user even when music, speech, and noise are simultaneously input.
- Real-time human/robot interaction, active audition humanoids or audio control applications.
Development StageLab prototype (TRL 3-4)
Further Information<p><a href="https://worldwide.espacenet.com/publicationDetails/originalDocument?FT=D&date=20160628&DB=EPODOC&locale=en_EP&CC=US&NR=9378752B2&KC=B2&ND=1" target="_blank">US9378752 (B2)</a></p> <p><a href="https://worldwide.espacenet.com/publicationDetails/originalDocument?FT=D&date=20170531&DB=EPODOC&locale=en_EP&CC=JP&NR=6140579B2&KC=B2&ND=1" target="_blank">JP6140579 (B2)</a></p>
IPR StatusPatent granted
Industrial CategoriesInformation and Communication, Arts, entertainment, and recreation, Aerospace, defence, and security
TagsSound processing and analysis, Noise suppression, Human-robot interaction