DARPA Wants to Make a Jazz-Playing Robot That Can Jam With Humans

Jazz-playing computers and robots could soon yield clues about how to help people collaborate with machines, researchers say.

The new project, called MUSICA (short for Musical Improvising Collaborative Agent), aims to develop a musical device that can improvise a jazz solo in response to human partners, just as real jazz musicians improvise alongside one another.

MUSICA is part of a new program from the Defense Advanced Research Projects Agency (DARPA), the branch of the U.S. military responsible for developing new technologies. The project is designed to explore new ways that people can interact with computers and robots. [Super-Intelligent Machines: 7 Robotic Futures]

• Add to Google

Musical Robots Strike Right Notes at Tokyo Design Expo

00:31

"There is definitely a desire for more natural kinds of communications with computational systems as they grow in their ability to be intelligent," Ben Grosser, an assistant professor of new media at the University of Illinois at Urbana-Champaign, told Live Science. "A lot of us are familiar with various methods of interacting with computers, such as text-based and touch-based interfaces, but language-based interfaces such as Siri or Google Now are extremely limited in their capabilities."

Grosser and his colleague Kelland Thomas, an associate professor of music at the University of Arizona, are developing MUSICA to explore how people can communicate with one another without language. "That could make interactions between humans and machines a lot deeper," said Grosser, who himself is a jazz trumpeter. "When it comes to jazz, you feel the music as much as you hear and think about it — you react instinctively to things that are going on."

Related: Robotic Drumming Prosthesis Gives Musician an Extra Hand

To develop a machine capable of playing improvisational jazz, the researchers will create a database of jazz solos from a variety of musicians and have computers analyze the recordings to figure out the various processes that come into play when a musician improvises. The researchers will then develop a performance system to analyze the components of human jazz performances, including the beat, pitch, harmony and rhythm. The system will also consider what it has learned about jazz solos to communicate and respond musically in real time.

For Subscribers

FOR SUBSCRIBERSAbdul El-Sayed tries to woo MAHA voters as Democrats seek inroads with RFK’s supporters

FOR SUBSCRIBERSKratom-like substances are popping up in a typically benign supplement

FOR SUBSCRIBERSGOP super PAC increases its spending for Sen. Jon Husted in tough Ohio race

FOR SUBSCRIBERSRecords reveal tumultuous marriage between slain New York Times executive and wife

FOR SUBSCRIBERSFrom clean energy warrior to ‘wall of shame,’ James Talarico reverses on a fossil fuel money pledge

FOR SUBSCRIBERSCongressional staff planned official trip with luxury stops in Italy and France weeks before election

FOR SUBSCRIBERSA harrowing ordeal aboard an Israel-bound plane

FOR SUBSCRIBERSOpenAI CEO Sam Altman to skip congressional hearing on rogue AI agents

FOR SUBSCRIBERSKey DOJ lawyers departed Trump ‘grand conspiracy’ probe amid pressure to produce, source says

FOR SUBSCRIBERSTrump’s new AI chatbot often links to a site launched under Clinton 26 years ago

FOR SUBSCRIBERSAt MAHA summit, industry CEOs the movement once vilified take the stage

FOR SUBSCRIBERSThis Paralympian has two goals: Win medals and give away $500,000 to her teammates

FOR SUBSCRIBERSCornell rape allegation spotlights stringent New York state laws that have long drawn criticism

FOR SUBSCRIBERSThe debate over AI’s future rages on both coasts

FOR SUBSCRIBERSDecades-old march dispute reignites in Northern Ireland, threatening political crisis

Related: Hover Band: Flying Drones Play Classical Music Medley

For Subscribers

FOR SUBSCRIBERSAbdul El-Sayed tries to woo MAHA voters as Democrats seek inroads with RFK’s supporters

FOR SUBSCRIBERSKratom-like substances are popping up in a typically benign supplement

FOR SUBSCRIBERSGOP super PAC increases its spending for Sen. Jon Husted in tough Ohio race

FOR SUBSCRIBERSRecords reveal tumultuous marriage between slain New York Times executive and wife

FOR SUBSCRIBERSFrom clean energy warrior to ‘wall of shame,’ James Talarico reverses on a fossil fuel money pledge

FOR SUBSCRIBERSCongressional staff planned official trip with luxury stops in Italy and France weeks before election

FOR SUBSCRIBERSA harrowing ordeal aboard an Israel-bound plane

FOR SUBSCRIBERSOpenAI CEO Sam Altman to skip congressional hearing on rogue AI agents

FOR SUBSCRIBERSKey DOJ lawyers departed Trump ‘grand conspiracy’ probe amid pressure to produce, source says

FOR SUBSCRIBERSTrump’s new AI chatbot often links to a site launched under Clinton 26 years ago

FOR SUBSCRIBERSAt MAHA summit, industry CEOs the movement once vilified take the stage

FOR SUBSCRIBERSThis Paralympian has two goals: Win medals and give away $500,000 to her teammates

FOR SUBSCRIBERSCornell rape allegation spotlights stringent New York state laws that have long drawn criticism

FOR SUBSCRIBERSThe debate over AI’s future rages on both coasts

FOR SUBSCRIBERSDecades-old march dispute reignites in Northern Ireland, threatening political crisis

"Our goal is to by next summer present a 'call and answer' system to DARPA, where I can play a line of music, and the system will analyze that line and give an answer as close to real time as possible," Grosser said.

This is a condensed version of a report from Live Science. Read the full report. Follow Live Science @livescience, Facebook & Google+.

More from Live Science

• Humanoid Robots to Flying Cars: 10 Coolest DARPA Projects
• 11 Odd and Intriguing Smart Home Technologies
• The 6 Strangest Robots Ever Created

Copyright 2015 LiveScience, a Purch company. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.