Identifying Sounds Through Body Language

In a violin or a piano duet, have you ever wondered which person is making the melody and which one is playing the harmony? In order to answer this question, one needs not only his ears but also his eyes.

When the ear fails to tell two instruments apart, the eye often pitches in by matching each musician's movements to the beat of each part.

Taking inspiration from this concept,...

A new artificial intelligence tool developed by the MIT-IBM Watson AI Lab leverages the virtual eyes and ears of a computer to separate similar sounds that are tricky even for humans to differentiate. The tool improves on earlier iterations by matching the movements of individual musicians, via their skeletal keypoints, to the tempo of individual parts, allowing listeners to isolate a single flute or violin among multiple flutes or violins.

This AI tool could be potentially used in sound mixing and reducing confusion in video conference calls.

More details about this over at TechXplore.

(Image Credit: Massachusetts Institute of Technology/ TechXplore)


Login to comment.




Email This Post to a Friend
"Identifying Sounds Through Body Language"

Separate multiple emails with a comma. Limit 5.

 

Success! Your email has been sent!

close window
X

This website uses cookies.

This website uses cookies to improve user experience. By using this website you consent to all cookies in accordance with our Privacy Policy.

I agree
 
Learn More