Sound and Music Computing

622 Pages·2017·11.07 MB·English

applied sciences
Sound and Music
Computing
Edited by
Tapio Lokki, Meinard Müller, Stefania Serafin and
Vesa Välimäki
Printed Edition of the Special Issue Published in Applied Sciences
www.mdpi.com/journal/applsci
Sound and Music Computing
Special Issue Editors
Tapio Lokki
Stefania Serafin
Meinard M ¨uller
Vesa Välimäki
MDPI•Basel•Beijing•Wuhan•Barcelona•Belgrade
Special Issue Editors
Tapio Lokki
Aalto University
Finland
Stefania Serafin
Aalborg University
Denmark
Meinard M u¨ller
Friedrich-Alexander Universita¨t Erlangen-Nu ¨rnberg
Germany
Vesa Välimäki
Aalto University
Finland
Editorial Office
MDPI
St. Alban-Anlage 66
Basel, Switzerland
This edition is a reprint of the Special Issue published online in the open access journal Applied Sciences
(ISSN 2076-3417) from 2017–2018 (available at: http://www.mdpi.com/journal/applsci/special
issues/Music Computing).
For citation purposes, cite each article independently as indicated on the article page online and as
indicated below:
Lastname,F.M.;Lastname,F.M.Articletitle.JournalNameYear,Articlenumber,pagerange.
First Editon 2018
Cover photo courtesy of Mattia Bernardi.
ISBN 978-3-03842-907-4 (Pbk)
ISBN 978-3-03842-908-1 (PDF)
ArticlesinthisvolumeareOpenAccessanddistributedundertheCreativeCommonsAttribution
(CCBY)license, whichallowsuserstodownload, copyandbuilduponpublishedarticleseven
forcommercialpurposes,aslongastheauthorandpublisherareproperlycredited,whichensures
maximum dissemination and a wider impact of our publications. The book taken as a whole is
(cid:2)c 2018MDPI,Basel,Switzerland,distributedunderthetermsandconditionsoftheCreativeCommons
licenseCCBY-NC-ND(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Table of Contents
AbouttheSpecialIssueEditors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
TapioLokki,MeinardMu¨ller,StefaniaSerafinandVesaVa¨lima¨ki
SpecialIssueon“SoundandMusicComputing”
doi:10.3390/app8040518 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
SebastianoVerde,Niccolo`Pretto,SimoneMilaniandSergioCanazza
StayTruetotheSoundofHistory:Philology,PhylogeneticsandInformationEngineering
inMusicology
doi:10.3390/app8020226 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
JongpilLee,JiyoungPark,KeunhyoungLukeKimandJuhanNam
SampleCNN:End-to-EndDeepConvolutionalNeuralNetworksUsingVerySmallFiltersfor
MusicClassification†
doi:10.3390/app8010150 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
TejaswineeKelkar,andAlexanderRefsumJensenius
AnalyzingFree-HandSound-TracingsofMelodicPhrases
doi:10.3390/app8010135 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
LaurenHayesandJulianStein
DesertandSonicEcosystems:IncorporatingEnvironmentalFactorswithinSite-Responsive
SonicArt
doi:10.3390/app8010111 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
MichaelLovedee-TurnerandDamianMurphy
ApplicationofMachineLearningfortheSpatialAnalysisofBinauralRoomImpulseResponses
doi:10.3390/app8010105 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
ØyvindBrandtsegg,SigurdSaueandVictorLazzarini
LiveConvolutionwithTime-VaryingFilters
doi:10.3390/app8010103 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Thibaud Necciari, Nicki Holighaus, Peter Balazs, Zdeneˇk Pru˚sˇa, Piotr Majdak and
OlivierDerrien
Audlet Filter Banks: A Versatile Analysis/Synthesis Framework Using Auditory
FrequencyScales
doi:10.3390/app8010096 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
TanYiyu,YasushiInoguchi,MakotoOtani,YukioIwayaandTakaoTsuchiya
AReal-TimeSoundFieldRenderingProcessor
doi:10.3390/app8010035 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
AlexWilsonandBrunoM.Fazenda
PopulatingtheMixSpace:ParametricMethodsforGeneratingMultitrackAudioMixtures
doi:10.3390/app7121329 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
Fabia´nEsqueda,HenriPo¨ntynen,JulianD.ParkerandStefanBilbao
VirtualAnalogModelsoftheLockhartandSergeWavefolders†
doi:10.3390/app7121328 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
iii
SimonSchaerlaeken,DidierGrandjeanandDonaldGlowinski
PlayingforaVirtualAudience: TheImpactofaSocialFactoronGestures, Soundsand
ExpressiveIntents
doi:10.3390/app7121321 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Romain Michon, Julius O. Smith, Matthew Wright, Chris Chafe, John Granzow and
GeWang
Mobile Music, Sensors, Physical Modeling, and Digital Fabrication:Articulating the
AugmentedMobileInstrument†
doi:10.3390/app7121311 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
MerlijnBlaauwandJordiBonada
A Neural Parametric Singing Synthesizer Modeling Timbre and Expression from
NaturalSongs†
doi:10.3390/app7121313 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
MaoshenJia,JiamingZhang,ChangchunBaoandXiguangZheng
APsychoacoustic-BasedMultipleAudioObjectCodingApproachviaIntra-ObjectSparsity
doi:10.3390/app7121301 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273
MeteYag˘anog˘luandCemalKo¨se
WearableVibrationBasedComputerInteractionandCommunicationSystemforDeaf
doi:10.3390/app7121296 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
Eero-PekkaDamska¨ggandVesaVa¨lima¨ki
AudioTimeStretchingUsingFuzzyClassificationofSpectralBins
doi:10.3390/app7121293 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312
AndrewMcLeod,RodrigoSchramm,MarkSteedmanandEmmanouilBenetos
AutomaticTranscriptionofPolyphonicVocalMusic†
doi:10.3390/app7121285 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326
KjetilFalkenbergHansenandRumiHiraga
TheEffectsofMusicalExperienceandHearingLossonSolvinganAudio-BasedGamingTask
doi:10.3390/app7121278 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347
OttoPuomio,JukkaPa¨tynenandTapioLokki
Optimization of Virtual Loudspeakers for Spatial Room Acoustics Reproduction
withHeadphones
doi:10.3390/app7121282 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 366
DimitriosBountouridis,DanG.Brown,FransWieringandRemcoC.Veltkamp
MelodicSimilarityandApplicationsUsingBiologically-InspiredTechniques
doi:10.3390/app7121242 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 382
JenniferMacRitchieandAndrewMilne
ExploringtheEffectsofPitchLayoutonLearningaNewMusicalInstrument†
doi:10.3390/app7121218 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
MarcCiufoGreenandDamianMurphy
EigenScape:ADatabaseofSpatialAcousticSceneRecordings
doi:10.3390/app7111204 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 430
iv
EduardoCarabez,MihoSugi,IsaoNambuandYasuhiroWada
IdentifyingSingleTrialEvent-RelatedPotentialsinanEarphone-BasedAuditory
Brain-ComputerInterface
doi:10.3390/app7111197 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444
RodSelfridge,DavidMoffatandJoshuaD.Reiss
SoundSynthesisofObjectsSwingingthroughAirUsingPhysicalModels†
doi:10.3390/app7111177 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 460
MatevzˇPesek,AlesˇLeonardisandMatijaMarolt
SymCHM—AnUnsupervisedApproachforPatternDiscoveryinSymbolicMusicwitha
CompositionalHierarchicalModel
doi:10.3390/app7111135 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 478
VictorLazzarini
SupportinganObject-OrientedApproachtoUnitGeneratorDevelopment: TheCsound
PluginOpcodeFramework†
doi:10.3390/app7100970 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 498
QiWang,RuohuaZhouandYonghongYan
ATwo-StageApproachtoNote-LevelTranscriptionofaSpecificPiano
doi:10.3390/app7090901 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 530
Miguel A. Quintana-Sua´rez, David Sa´nchez-Rodr´ıguez, Itziar Alonso-Gonza´lez and and
Jesu´sB.Alonso-Herna´ndez
ALowCostWirelessAcousticSensorforAmbientAssistedLivingSystems
doi:10.3390/app7090877 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 549
StefaniaCecchi,AlbertoCariniandSaschaSpors
RoomResponseEqualization—AReview
doi:10.3390/app8010016 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 564
v

About the Special Issue Editors
Tapio Lokki, associate professor, received his MSc and DSc(Tech.) degrees from the Helsinki University
of Technology. Since 2012, he has been an associate professor (tenured) at the Aalto University, Espoo,
Finland, where he leads the virtual acoustics team. The passion of Prof. Lokki is to understand
how rooms modify the sounds that we hear. To pursue the understanding of room acoustics,
his team is investigating auralization, spatial sound reproduction, binaural technology, and novel
objective and subjective evaluation methods, as well as physically based room acoustics modeling
methods. Particular interest has been devoted to concert halls, in which the team has developed new
measurement techniques, analysis methods for spatial impulse responses, and sensory evaluation
methods to understand perceptual differences between concert halls. Prof. Lokki has published
over 200 scientific articles and has received research funding from the European Research Council and
the Academy of Finland.
Stefania Serafin is Professor with special responsibilities in sound in multimodal environments at
Aalborg University in Copenhagen. She previously was Associate Professor (2006–2012) and Assistant
Professor (2003–2006) at Aalborg University Copenhagen. She received a Ph.D. in Computer-Based
Music Theory and Acoustics from Stanford University in 2004 and a Master in Acoustics, Computer
Science and Signal Processing Applied to Music from IRCAM (Paris) in 1997. She is currently principal
investigator for the Nordic Sound and Music Computing Nordic University Hub, supported by
Nordforsk. Her main research interests are sound models for interactive systems and multimodal
interfaces and sonic interaction design.
Meinard M ¨ulle,r Professor, received a Diploma degree in mathematics and a Ph.D. degree in computer
science from the University of Bonn, Germany. In 2007, he finished his habilitation in the field of
multimedia retrieval and became a member of the Saarland University and the Max-Planck Institut fu ¨r
Informatik. Since 2012, he holds a professorship for Semantic Audio Processing at the International
Audio Laboratories Erlangen. His recent research interests include music processing, music information
retrieval, audio signal processing, multimedia retrieval, and motion processing. He served in the
IEEE Audio and Acoustic Signal Processing Technical Committee from 2010 to 2015 and has been
a member of the Board of Directors of the International Society for Music Information Retrieval
since 2009. Meinard M u¨ller has coauthored more than 150 peer-reviewed scientific papers and wrote
the monograph “Information Retrieval for Music and Motion” (Springer, 2007) and the textbook
“Fundamentals of Music Processing” (Springer, 2015, www.music-processing.de).
Vesa Välimäki is Full Professor of audio signal processing and Vice Dean for research at the Aalto
University School of Electrical Engineering, Espoo, Finland. He received his Master of Science in
Technology and Doctor of Science in Technology degrees, both in electrical engineering, from the
Helsinki University of Technology, Espoo, Finland, in 1992 and 1995, respectively. In 1996, he was a
Postdoctoral Research Fellow at the University of Westminster, London, UK. In 2008–2009, he was
a Visiting Scholar at the Center for Computer Research in Music and Acoustics (CCRMA), Stanford
University, Stanford, CA, USA. He is a Fellow of the IEEE and a Fellow of the Audio Engineering
Society. Prof. Va¨lima¨ki was the General Chair of the International Conference on Digital Audio Effects,
DAFx-08, in 2008, and was the General Chair of the Sound and Music Computing Conference, SMC-17,
in 2017.
vii

applied
sciences
Editorial
Special Issue on “Sound and Music Computing”
TapioLokki1,∗,MeinardMüller2,StefaniaSerafin3andVesaVälimäki4
1 DepartmentofComputerScience,AaltoUniversity,02150Espoo,Finland
2 InternationalAudioLaboratoriesErlangen,Friedrich-AlexanderUniversitätErlangen-Nürnberg,
91058Erlangen,Germany;[e-mail]
3 DepartmentofArchitecture,DesignandMediaTechnology,AalborgUniversity,
2450CopenhagenSV,Denmark;[e-mail]
4 DepartmentofSignalProcessingandAcoustics,AaltoUniversity,02150Espoo,Finland;
vesa.valimaki@aalto.fi
* Correspondence:tapio.lokki@aalto.fi
Received:22March2018;Accepted:27March2018;Published:28March2018
1.Introduction
Soundandmusiccomputingisayoungandhighlymultidisciplinaryresearchfield.Itcombines
scientific,technological,andartisticmethodstoproduce,model,andunderstandaudioandsonic
artswiththehelpofcomputers.Soundandmusiccomputingborrowsmethods,forexample,from
computerscience,electricalengineering,mathematics,musicology,andpsychology.
For this special issue, 44 manuscripts were submitted and were carefully reviewed. Finally,
29 high-qualityarticleswerepublished,andweareverypleasedwiththeoutcome.Someofthearticles
arerevisedandextendedversionsofpaperspublishedearlierinrelatedinternationalconferences,
suchasinthe14thSoundandMusicComputingConferenceSMC-17(Espoo, Finland), the18th
InternationalSocietyforMusicInformationRetrievalConferenceISMIR-17(Suzhou,China),orthe
2017NewInterfacesforMusicalExpressionConferenceNIME-17(Copenhagen,Denmark).
Thiseditorialbrieflysummarizesthepublishedarticlesandguidesyoutoreadthemindetail.
Thearticlescouldbecategorizedinmanyways,assuchmultidisciplinaryfieldhasawidevarietyof
topics. Here,wehaveorganizedthearticlesbasedontheirapplicationareasorspecialtechniques
appliedinresearch.Wehopethatthesearticleswillinspireresearchersinsoundandmusiccomputing
toconductmoreexcellentresearchandspreadthewordaboutthisvibrant,multidisciplinaryfield.
2.SoundandMusicComputingTechniques
2.1.AudioSignalProcessing
Cecchietal.[1]havewrittentheonlyreviewarticleforthisspecialissue.Theirlongpapergivesa
completeoverviewofaudiosignalprocessingmethodsfortheequalizationoftheloudspeaker-room
response,whichisafundamentalprobleminsoundreproduction.Theincreasingpopularityofsmall
mobilespeakershavingnon-idealpropertiesmakesthistopicevermoreimportant.
Necciarietal.[2]proposeanimprovedauditoryfilterbankcalledAudlet,whichallowsperfect
reconstruction. Thenewfilterbankiscomparedwiththegammatonefilterbank,anditsusedina
single-channelaudiosourceseparationtaskisdemonstrated.
Brandtsegg et al. [3] discuss approaches to real-time convolution with time-varying filters,
whichextendstheconvolutionreverberationconcept. Forexample,thesoundsproducedbytwo
playerscanbeconvolvedwitheachothertoobtainexcitingaudioeffects.
DamskäggandVälimäki[4]addressaproblemknownastime-scalemodificationinwhichthe
objectiveistotemporallystretchorcompressagivenaudiosignalwhilepreservingpropertieslike
pitchandtimbre.Tohandledifferentsignalcharacteristics,themainideaofthepaperistomodify
Appl.Sci. 2018,8,518 1 www.mdpi.com/journal/applsci