This is the project website & blog of MIRLCAuto: A Virtual Agent for Music Information Retrieval in Live Coding, a project funded by the EPSRC HDI Network Plus Grant - Art, Music, and Culture theme.
Presentation at COSY Colloquium – May 21, 2021
21 May 2021 • Anna Xambó • Post a comment
Today I had the chance to virtually present via Zoom at the Computer Networks meet Music Instruments, a series of talks organised by Oliver Hödl with the help of Patricia Hu in the context of the COSY Colloquium, Faculty of Computer Science, University of Vienna. There were about 25 attendees, including students, faculty members, organisers and speakers.
The session had two talks:
- The Emerging Field of the Internet of Musical Things: Enabling Technologies and Open Challenges by Luca Turchet, PhD, Assistant Professor and Head of the Creative, Intelligent and Multisensory Interactions Lab, Department of Information Engineering and Computer Science, University of Trento, Italy.
- Audience engagement in musical performances through on-site and online networks by Anna Xambó, PhD, Senior Lecturer in Music and Audio Technology, Faculty of Computing, Engineering and Media, De Montfort University, Leicester, UK.
Luca Turchet gave a great presentation about the new field of 'Internet of Musical Things' (IoMTs) in the context of the Internet of Things, with highlights on smart instruments and haptic interfaces. He also mentioned the possibility of audience engagement with IoMTs, which connected well with my follow-up talk, which focused on looking at ways of engaging in musical performances using mobile devices and web technologies.
Here there are more details about my talk, which relates to one aspect of the MIRLCAuto project:
Title: "Audience engagement in musical performances through on-site and online networks".
My talk had three parts: (1) Audience-centric performances where the audience become performers/makers; (2) Audience-led performances where the audience become composers/influencers, and (3) Hands-on demo with a basic prototype of a chat built using WebSockets via Socket.io and incorporated into a MIRLCa live coding session.
Analysis: It was interesting to discuss audience engagement in musical performances, which is an often overlooked aspect that is getting more attention with the emergence of the Web Audio API and web standards. It also becomes relevant in extreme situations such as the pandemic, where new ways of hybrid or online performance need to be explored. The final part of my talk had a little demo where the attendees were invited to join an online chat and suggest tags to be used during my live coding performance with MIRLCa. The overall result was that despite the basic chat prototype, it was an effective approach to engage the audience in a casual setting and going beyond the common Zoom protocol to establish remote communication.
Feedback: The feedback was positive, especially about the final demo. We discussed the three tenets of the project, legibility, agency, and negotiability, in the context of teaching students in computer science. I've found the use of live coding in the classroom, and collaborative live coding, a useful and engaging mechanism to give ownership to the students, and also to make sure that everybody is on the same page. We also discussed the role of the live coder in respect to the chat, and whether instead of curating the "tags", the chat text could also have a sonic effect, which connects with Ariane Stolfi's work entitled "Open Band: Audiotype" presented at the Web Audio Conference 2017.
The slides of my presentation are available here. You can find the reference list below.
Thanks to Dr. Oliver Hödl for the invitation, to Patricia Hu for her help during the organisation of the event, to the attendees for their interesting questions, and to COSY Colloquium, Faculty of Computer Science, University of Vienna for hosting the event.
Reference List #
- Barbosa, A. (2003). Displaced soundscapes: A survey of network systems for music and sonic art creation. Leonardo Music Journal, 13, 53–59.
- Hödl, O., Kayali, F. and Fitzpatrick, G. (2012) Designing interactive audience participation using smart phones in a musical performance. In Proceedings of the ICMC.
- Lorway, N., Jarvis, M., Wilson, A., Powley, E. and Speakman, J. (2019) Autopia: An AI Collaborator for Gamified Live Coding Music Performances. In Society for the Study of Artificial Intelligence and Simulation of Behaviour Convention, Falmouth University.
- Madhavan N, Snyder J. (2016) Constellation: A musical exploration of phone-based audience interaction roles. In Proceedings of the International Web Audio Conference.
- Roma, G., Xambó, A., Freeman, J. (2017) Handwaving: Gesture Recognition for Participatory Mobile Music. In Proceedings of the Audio Mostly Conference.
- Xambó, A. (2015). Tabletop Tangible Interfaces for Music Performance: Design and Evaluation. PhD thesis. The Open University.
- Xambó, A., Roma, G. (2020) Performing Audiences: Composition Strategies for Network Music using Mobile Phones. Proceedings of the New Interfaces for Musical Expression. pp. 55-60.
- Xambó, A., Roma, G., Roig, S., Solaz, E. (Accepted, 2021) “Live Coding with the Cloud and a Virtual Agent”. Proceedings of the New Interfaces for Musical Expression.