Project: The Listening Machine
An orchestral sonification of social network dynamics.
by Peter Gregson and Daniel Jones, recorded with Britten Sinfonia
The Listening Machine is a web-based composition that observes the interactions of 500 UK-based Twitter users in real time, translating their words, sentiments and social behaviours into a 6-month-long piece of music. Commissioned by the BBC/Arts Council England as part of on-demand arts channel The Space, it combines natural language processing and algorithmic composition with a vast array of orchestral fragments recorded with the Britten Sinfonia chamber orchestra.
Multiple different elements make up the compositional process: sentiment analysis governs the mood of the piece; prosody analysis generates individual melody lines, based on subjects' syllables and rhythms of speech; and topic detection triggers preset modular segments and field recordings corresponding to given areas of conversation. The whole could be heard live on thelisteningmachine.org between May and October 2012.
Visual design by Joe Hales.
"...an endless and beautiful piece of contemporary music" — El Pais
More information
- Audio excerpts (SoundCloud)
- The Listening Machine website (archive.org)
- The Space
- Articles: Wall Street Journal, Wired, Huffington Post, Scientific American, El Pais
- Source code: isobar, used to generate and manipulate musical patterns