Gesture-Timbre Space: Multidimensional Feature Mapping Using Machine Learning and Concatenative Synthesis
Conference Proceeding
Zbyszyński, M., Di Donato, B., Visi, F., & Tanaka, A. (2021)
Gesture-Timbre Space: Multidimensional Feature Mapping Using Machine Learning and Concatenative Synthesis. In R. Kronland-Martinet, S. Ystad, & M. Aramaki (Eds.), Perception, Representations, Image, Sound, Music - 14th International Symposium, CMMR 2019, Marseille, France, October 14–18, 2019, Revised Selected Papers (600-622). https://doi.org/10.1007/978-3-030-70210-6_39
This chapter explores three systems for mapping embodied gesture, acquired with electromyography and motion sensing, to sound synthesis. A pilot study using granular synthesis...
Human-Sound Interaction: Towards a Human-Centred Sonic Interaction Design approach
Conference Proceeding
Donato, B. D., Dewey, C., & Michailidis, T. (2020)
Human-Sound Interaction: Towards a Human-Centred Sonic Interaction Design approach. In MOCO '20: Proceedings of the 7th International Conference on Movement and Computinghttps://doi.org/10.1145/3401956.3404233
In this paper, we explore human-centered interaction design aspects that determine the realisation and appreciation of musical works (installations, composition and performanc...
Quantum GestART: identifying and applying correlations between mathematics, art, and perceptual organization
Journal Article
Mannone, M., Favali, F., Di Donato, B., & Turchet, L. (2021)
Quantum GestART: identifying and applying correlations between mathematics, art, and perceptual organization. Journal of Mathematics and Music, 15(1), 62-94. https://doi.org/10.1080/17459737.2020.1726691
Mathematics can help analyze the arts and inspire new artwork. Mathematics can also help make transformations from one artistic medium to another, considering exceptions and c...
HarpCI, Empowering Performers to Control and Transform Harp Sounds in Live Performance
Journal Article
Di Donato, B., Dooley, J., & Coccioli, L. (2019)
HarpCI, Empowering Performers to Control and Transform Harp Sounds in Live Performance. Contemporary Music Review, 38(6), 667-686. https://doi.org/10.1080/07494467.2019.1706351
The goal of our research is to provide harpists with the tools to control and transform the sounds of their instrument in a natural and musical way. We consider the developmen...
Designing Gestures for Continuous Sonic Interaction
Conference Proceeding
Tanaka, A., Di Donato, B., Zbyszynski, M., & Roks, G. (2019)
Designing Gestures for Continuous Sonic Interaction. In M. Queiroz, & A. X. Sedó (Eds.), Proceedings of the International Conference on New Interfaces for Musical Expression (180-185). https://doi.org/10.5281/zenodo.3672916
This paper presents a system that allows users to quickly try different ways to train neural networks and temporal modeling techniques to associate arm gestures with time vary...
Improvising through the senses: a performance approach with the indirect use of technology
Journal Article
Michailidis, T., Dooley, J., Granieri, N., & Di Donato, B. (2018)
Improvising through the senses: a performance approach with the indirect use of technology. Digital Creativity, 29(2-3), 149-164. https://doi.org/10.1080/14626268.2018.1511600
This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dan...
Myo Mapper: a Myo armband to OSC mapper
Conference Proceeding
Di Donato, B., Bullock, J., & Tanaka, A. (2018)
Myo Mapper: a Myo armband to OSC mapper. In D. Bowman, & L. Dahl (Eds.), Proceedings of the International Conference on New Interfaces for Musical Expression (138-143). https://doi.org/10.5281/zenodo.1302705
Myo Mapper is a free and open source cross-platform application to map data from the gestural device Myo armband into Open Sound Control (OSC) messages. It represents a ‘quick...
MyoSpat: A hand-gesture controlled system for sound and light projections manipulation
Conference Proceeding
Di Donato, B., Dooley, J., Hockman, J., Bullock, J., & Hall, S. (2017)
MyoSpat: A hand-gesture controlled system for sound and light projections manipulation. In Proceedings of the 2017 International Computer Music Conference (335-340
We present MyoSpat, an interactive system that enables performers to control sound and light projections through hand-gestures. MyoSpat is designed and developed using the Myo...