A Real-Time Drum-Wise Volume Visualization System for Learning Volume-Balanced Drum Performance

Mitsuki Hosoya, Masanori Morise, Satoshi Nakamura, Kazuyoshi Yoshii

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

To improve drum performance, it is important to consider the volume balance of the bass drum, snare drum, and hi-hat. However, it is difficult for players to evaluate the balance of each volume of these instruments while playing. In addition, while it is possible to self-diagnose by recording drum performances, it is not always efficient to re-record and re-play drum performances based on the correction points. Therefore, we developed a system that uses semi-supervised non-negative matrix factorization (SSNMF) to separate a player’s drum performance, recorded with a unidirectional microphone installed in front of the drum kit, into the bass drum, snare drum, and hi-hat sound sources in real-time, and estimates each volume at the time of beating. In addition, the system also visualizes their volume balance and enables the player to control the power of beating. We experimented using this system for actual drum performance and clarified its usefulness and points for improvement based on the feedback obtained from the experiment participants.

Original languageEnglish
Title of host publicationEntertainment Computing – ICEC 2021 - 20th IFIP TC 14 International Conference, ICEC 2021, Proceedings
EditorsJannicke Baalsrud Hauge, Jannicke Baalsrud Hauge, Jorge C.S. Cardoso, Licínio Roque, Pedro A. Gonzalez-Calero
PublisherSpringer Science and Business Media Deutschland GmbH
Pages154-166
Number of pages13
ISBN (Print)9783030893934
DOIs
Publication statusPublished - 2021
Event20th IFIP TC 14 International Conference on Entertainment Computing, ICEC 2021 - Coimbra, Portugal
Duration: 2 Nov 20215 Nov 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13056 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th IFIP TC 14 International Conference on Entertainment Computing, ICEC 2021
Country/TerritoryPortugal
CityCoimbra
Period2/11/215/11/21

Keywords

  • Drum performance
  • Sound source separation
  • Volume balance

Fingerprint

Dive into the research topics of 'A Real-Time Drum-Wise Volume Visualization System for Learning Volume-Balanced Drum Performance'. Together they form a unique fingerprint.

Cite this