Music Technology Researchers Create New Robotic Percussionist

*********************************
There is now a CONTENT FREEZE for Mercury while we switch to a new platform. It began on Friday, March 10 at 6pm and will end on Wednesday, March 15 at noon. No new content can be created during this time, but all material in the system as of the beginning of the freeze will be migrated to the new platform, including users and groups. Functionally the new site is identical to the old one. webteam@gatech.edu
*********************************

Robot will interact with humans and give social cues

Contact

Georgia Tech Media Relations
Laura Diamond
laura.diamond@comm.gatech.edu
404-894-6016
Jason Maderer
maderer@gatech.edu
404-660-2926

Sidebar Content
No sidebar content submitted.
Summaries

Summary Sentence:

Shimon is the second robotic percussionist created by Georgia Te

Full Summary:

Georgia Tech has created an improved version of the robotic percussionist. The second edition, named Shimon, is designed to play a melodic instrument, the marimba. It, therefore, utilizes more sophisticated algorithms for music perception and improvisation in comparison to Haile, Georgia Tech's first robotic drummer.

Media
  • Andrea Thomaz and Shimon\'s head Andrea Thomaz and Shimon\'s head
    (image/jpeg)
  • Gil Weinberg, Andrea Thomaz and the robotic percussionist team Gil Weinberg, Andrea Thomaz and the robotic percussionist team
    (YouTube Video)

Georgia Tech has created an improved version of the robotic percussionist. The second edition, named Shimon, is designed to play a melodic instrument, the marimba. It, therefore, utilizes more sophisticated algorithms for music perception and improvisation in comparison to Haile, Georgia Tech's first robotic drummer. The robot can also create richer sound and more communicative visual cues.

Shimon is able to interact with his human counterparts on a much more social level. The robot's head is made to be more interactive and give fellow musicians social cues that relate to the music it's playing.

"I really wanted to make this robot more socially dynamic to enrich the interaction experience for the human musicians," said Gil Weinberg, director of Music Technology. "We start with simple social cues such as recognizing a beat and moving the robot's head. Sort of getting itself into the groove."

Shimon is able to interact with his human counterparts on a much more social level. The robot's head is made to be more interactive and give fellow musicians social cues that relate to the music it's playing.

"I really wanted to make this robot more socially dynamic to enrich the interaction experience for the human musicians," said Gil Weinberg, director of Music Technology. "We start with simple social cues such as recognizing a beat and moving the robot's head. Sort of getting itself into the groove."

"There is really a back channel of social cues that go on between musicians," said Andrea Thomaz, assistant professor in the School of Interactive Computing, who is collaborating with Weinberg on building the robot's head. "Shimon's head is really meant to take Gil's robotic musicians into that realm of being a true social collaborative music partner."

"When a guitar player and a drummer want to finish a piece together, there are synchronization and anticipation social cues given," said Weinberg. "With Shimon, there are four arms that stretch over a large instrument that give other musicians anticipatory cues of what is going to happen next."

Shimon is able to interact with the environment around it, analyze rhythm, melodies and harmony and use his musical understanding to improvise with humans.

Weinberg says that it can help study the way we think and play music because it expands the knowledge we have about music making and the musical mind.

Haile, Weinberg's first robotic percussionist, played in venues all around the world and has led to additional research in human-robotic interaction. The Robotic Musicianship project, which led to the development of Shimon, was supported by NSF and by the GVU Research Innovation grant.

Related Links

Additional Information

Groups

Home

Categories
Music and Music Technology, Research, Robotics
Related Core Research Areas
No core research areas were selected.
Newsroom Topics
No newsroom topics were selected.
Keywords
Center for Music Technology, Gil Weinberg, music technology, Robotic Percussionist, robotics, Shimon
Status
  • Created By: Matthew Nagel
  • Workflow Status: Published
  • Created On: Nov 6, 2008 - 8:00pm
  • Last Updated: Oct 7, 2016 - 11:01pm