Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Sound Bot


Sound Bot is a sound processing device and method that enables natural behavioural responses from robots to the speech of a user even when music, speech, and noise are simultaneously input. By reducing the influence of noise in sound processing, Sound Bot accurately detects beat intervals and provides instructions to the machine towards improved human/robot interactions. Although Sound Bot has been successfully tested using humanoid robots, it finds applications in a wide range of scenarios involving voice command and multiple sound inputs.

Challenge | Opportunity

In recent years, robots such as humanoids or home robots performing social interactions with persons have actively been studied. The study of musical interaction in which a robot is allowed to hear music and is allowed to sing a song or to move its body to the music is important to allow the robot to give a natural and rich expression. In order to allow a robot to hear speech or music, it is necessary to mount a sound collecting device such as a microphone on the robot. However, sound collected by the sound collecting device of the robot includes a variety of noise.  In this way, when the S/N ratio of the collected audio signal is lowered, accuracy of speech recognition is lowered, affecting the interaction between robots and the environment where they operate.

Main Advantages

  • Allows accurate beat intervals detection from a music signal, by reducing the influence of noise.
  • With this invention robots can correctly interpret sound to act accordingly in noise complex environments
  • Enables correct behavioural response to speech of a user even when music, speech, and noise are simultaneously input.


  • Real-time human/robot interaction, active audition humanoids or audio control applications. 

  • Commercial Rights

  • Development Stage

    Lab prototype (TRL 3-4)
  • Further Information

    <p><a href="" target="_blank">US9378752 (B2)</a></p> <p><a href="" target="_blank">JP6140579 (B2)</a></p>
  • IPR Status

    Patent granted
  • Licensing Availability

  • Industrial Categories

    Information and Communication, Arts, entertainment, and recreation, Aerospace, defence, and security
  • Tags

    Sound processing and analysis, Noise suppression, Human-robot interaction