Table Of Content

SPRINGER BRIEFS IN ELECTRICAL AND COMPUTER ENGINEERING Christoph Guger Brendan Z. Allison Aysegul Gunduz Editors Brain-Computer Interface Research A State-of-the-Art Summary 10 SpringerBriefs in Electrical and Computer Engineering SeriesEditors Woon-SengGan,SchoolofElectricalandElectronicEngineering,Nanyang TechnologicalUniversity,Singapore,Singapore C.-C.JayKuo,UniversityofSouthernCalifornia,LosAngeles,CA,USA ThomasFangZheng,ResearchInstituteofInformationTechnology,Tsinghua University,Beijing,China MauroBarni,DepartmentofInformationEngineeringandMathematics,University ofSiena,Siena,Italy SpringerBriefs present concise summaries of cutting-edge research and practical applicationsacrossawidespectrumoffields.Featuringcompactvolumesof50to 125 pages, the series covers a range of content from professional to academic. Typicaltopicsmightinclude:timelyreportofstate-of-theartanalyticaltechniques,a bridgebetweennewresearchresults,aspublishedinjournalarticles,andacontextual literature review, a snapshot of a hot or emerging topic, an in-depth case study or clinicalexampleandapresentationofcoreconceptsthatstudentsmustunderstand inordertomakeindependentcontributions. Moreinformationaboutthisseriesathttp://www.springer.com/series/10059 · · Christoph Guger Brendan Z. Allison Aysegul Gunduz Editors Brain-Computer Interface Research A State-of-the-Art Summary 10 Editors ChristophGuger BrendanZ.Allison g.tecmedicalengineeringGmbH DepartmentofCognitiveScience Schiedlberg,Oberösterreich,Austria UniversityofCaliforniaSanDiego SanDiego,CA,USA AysegulGunduz DepartmentofBiomedicalEngineering UniversityofFlorida Gainesville,FL,USA ISSN2191-8112 ISSN2191-8120 (electronic) SpringerBriefsinElectricalandComputerEngineering ISBN978-3-030-79286-2 ISBN978-3-030-79287-9 (eBook) https://doi.org/10.1007/978-3-030-79287-9 ©TheEditor(s)(ifapplicable)andTheAuthor(s),underexclusivelicensetoSpringerNature SwitzerlandAG2021 Thisworkissubjecttocopyright.AllrightsaresolelyandexclusivelylicensedbythePublisher,whether thewholeorpartofthematerialisconcerned,specificallytherightsoftranslation,reprinting,reuse ofillustrations,recitation,broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,and transmissionorinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilar ordissimilarmethodologynowknownorhereafterdeveloped. Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant protectivelawsandregulationsandthereforefreeforgeneraluse. Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbook arebelievedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsor theeditorsgiveawarranty,expressedorimplied,withrespecttothematerialcontainedhereinorforany errorsoromissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictional claimsinpublishedmapsandinstitutionalaffiliations. ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSwitzerlandAG Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland Contents Brain-ComputerInterfaceResearch:AState-of-the-ArtSummary 10 ................................................................ 1 ChristophGuger,BrendanZ.Allison,andAysegulGunduz Evaluation of Human Posterior Parietal Cortex in Gesture Decoding Performance Enhancement Using Stereoelectroencephalography(SEEG)Signals ....................... 13 GuangyeLi, MengWang, ShizeJiang, JieHu, LiangChen, andDingguoZhang SpeechDecodingasMachineTranslation ............................ 23 JosephG.Makin,DavidA.Moses,andEdwardF.Chang Optically Pumped Magnetometers for Practical MEG-Based Brain-ComputerInterfacing ........................................ 35 BenjaminWittevrongel, NiallHolmes, ElenaBoto, RyanHill, MollyRea, ArnoLibert, ElviraKhachatryan, RichardBowtell, MatthewJ.Brookes,andMarcM.VanHulle EEGDecodingofPainPerceptionforaReal-TimeReflexSystem inProstheses ...................................................... 47 ZiedTayeb, RohitBose, AndreiDragomir, LukeE.Osborn, NitishV.Thakor,andGordonCheng High-Dimensional (8D) Control of Complex Effectors Such asanExoskeleton .................................................. 59 AlexandreMoly A Computer-Brain Interface that Restores Lost Extremities’ TouchandMovementSensations .................................... 65 G.Valle,F.M.Petrini,P.Mijovic,B.Mijovic,andS.Raspopovic v vi Contents RestoringtheSenseofTouchUsingaSensorimotorDemultiplexing NeuralInterface:‘Disentangling’SensorimotorEventsDuring Brain-ComputerInterfaceControl .................................. 75 PatrickD.Ganzer,SamuelC.Colachis4th,MichaelA.Schwemmer, DavidA.Friedenberg, CollinF.Dunlap, CarlyE.Swiftney, AdamF.Jacobowitz, DougJ.Weber, MarciaA.Bockbrader, andGauravSharma ABrain-SpineInterfaceComplementsDeep-BrainStimulation ........ 87 TomislavMilekovic AutomaticSpeechSeparationEnablesBrain-ControlledHearable Technologies ...................................................... 95 CongHan,JamesO’Sullivan,YiLuo,JoseHerrero,AsheshD.Mehta, andNimaMesgarani AHigh-PerformanceHandwritingBCI .............................. 105 FrancisR.Willett A Neuromorphic Brain-Computer Interface for Real-Time DetectionofaNewBiomarkerforEpilepsySurgery .................. 111 KarlaBurelo Recent Advances in Brain-Computer Interface Research: ASummaryofthe2020BCIAward ................................. 119 ChristophGuger,BrendanZ.Allison,andAysegulGunduz Brain-Computer Interface Research: A State-of-the-Art Summary 10 ChristophGuger,BrendanZ.Allison,andAysegulGunduz Abstract Brain-computer interfaces (BCIs) enable users to send messages or commandsdirectlythroughbrainactivity,withoutanymovement.MostBCIsystems aimtohelppersonswithseriousmovementdisabilities,butBCIsforconsumerappli- cationsareincreasinglyprevalent.Eachyearsince2010,teamssubmittedtheirBCI projectstotheBCIResearchAwards,whereajurydecidesthebestprojectsofthe year.Weinvitethenomineesandwinnersoftheseawardstocontributechaptersto ourannualbookseries,andthisbookcoversthe2020BCIResearchAwards—the tenth year of this award series, and the tenth book about the awards. Most of this book consists of chapters in which the authors summarize these BCI projects or contributeinterviewsabouttheirwork.Inthischapter,weintroduceBCIs,describe theproceduresandpeopleinvolvedintheawardsandbooks,andpresentthetwelve projectsthatthejurynominatedforanaward. · · · · Keywords Brain-computerinterface EEG ECoG BCIresearchawards BCI foundation 1 Introduction Brain-computerinterface(BCI)systemsaregainingattention,withnewapplications to benefit patients and even healthy users. We started the Annual BCI Research Award in 2010, and have organized this award since then. These awards have had many beneficial outcomes, including: (1) identifying and rewarding the best BCI projectseachyear;(2)providingpositivepublicityfortopprojectsandtheoverall B C.Guger( ) G.TecMedicalEngineeringGmbH,Schiedlberg,Austria e-mail:[email protected] B.Z.Allison CognitiveScienceDepartment,UniversityofCaliforniaSanDiego,SanDiego,USA A.Gunduz BiomedicalEngineering,UniversityofFlorida,Gainesville,USA ©TheAuthor(s),underexclusivelicensetoSpringerNatureSwitzerlandAG2021 1 C.Gugeretal.(eds.),Brain-ComputerInterfaceResearch, SpringerBriefsinElectricalandComputerEngineering, https://doi.org/10.1007/978-3-030-79287-9_1 2 C.Gugeretal. field;(3)creatinganannualbookserieswithsummariesofthetopBCIprojectsand discussions of BCI trends; and (4) helping to “raise the bar” for high-quality BCI projects. ThisyearmarksthetenthanniversaryoftheBCIResearchAwardanditscorre- sponding books. This book, like earlier books in this series, presents articles from peoplebehindthisyear’stopBCIprojects.Mostofthechapterswerewrittenbythese BCIexpertsandpresentdetailsabouttheirBCIprojects,including:thecurrentstate- of-theart;whytheirworkisimportant;hardware,software,procedures,algorithms, andothermethods;results,usuallybasedonreal-worldtestingwithpatientsorother targetusers;anddiscussion,oftenwithfuturedirectionsandothercommentary.This introductorychapterintroducesBCIs,theannualawardsandbooks,andthetwelve projectsnominatedforaBCIResearchAwardin2020. 2 WhatIsaBCI? ThemostwidelycitedreviewofBCIsstates:“ABCIisacommunicationsystemin whichmessagesorcommandsthatanindividualsendstotheexternalworlddonot passthroughthebrain’snormaloutputpathwaysofperipheralnervesandmuscles. For example, in an EEG based BCI the messages are encoded in EEG activity. A BCIprovidesitsuserwithanalternativemethodforactingontheworld[7].”While differentauthorsusedifferentterms,mostpeopleagreewiththisgeneraldefinition. MostBCIshelppeoplewithseveremovementdisabilitybyreplacingorrestoring lostmovements[8].The“replace”functionincludesBCIsforcontrolofprosthetic limbsorspellingsystems[1,2].Thus,peoplewhocannolongerperformabilities likegrasping,typing,orspeakingcanreplacelostfunctionsbydirectlycontrollinga devicewithbrainactivity.OtherBCIshelprestorelostmovements,suchashelping people regain upper-limb control after a stroke [3, 4, 6]. In addition to improving voluntarymovementcontrol,manypatientswhoparticipateinstrokerehabilitation therapyusingBCIsreportreductionsinspasmsandpain. The“restore”and“replace”applicationsrequireusingtheBCIatdifferenttimes. A BCI system to replace lost functions should be available on-demand, even in the middle of the night, without a medical expert or technician. BCIs to restore functionsareinsteadtypicallyusedthroughtherapysessionswithalicensedtherapist. A common schedule would be 25 sessions with 2–3 sessions per week, typically duringregularbusinesshours.Whileboth“replace”and“restore”BCIsmustprovide real-time feedback to the user, as required by all BCIs, the immediate feedback is themaingoalofa“replace”BCI.Ina“restore”BCI,thegoalisinsteadtoproduce long-lastingchange. BCIsarealsobecomingmoreprominentasconsumerproductsratherthantoolsfor patients.Facebook,ElonMusk,andothershaveannouncedhigh-profileBCIprojects that primarily aim toward consumer devices. Many new companies have emerged thatnowsellBCIsmeantforconsumers.ThesenewdirectionscouldaccelerateBCI researchanddevelopment,butneedtobepresentedtothepublicaccuratelyandfairly. Brain-ComputerInterfaceResearch:AState-of-the-ArtSummary10 3 The BCI Research Awards have been informing readers about BCIs for a decade. Wehopetheawardsandbookshavealsoencouragedhigh-qualityBCIprojectsand publications. 3 TheAnnualBCIResearchAward The BCI Award Foundation organizes the Annual BCI Research Award. Drs. ChristophGugerandDeanKrusienskiarebothpresidentsoftheBCIAwardFoun- dation,whichwasfoundedin2017.Figure1showsthetwopresidentsandthefive otherBoardMembersoftheBCIAwardFoundation. TheBCIResearchAwardisopentoresearchersorteams(excludingmembersof the jury) around the world. Different projects have involved various combinations ofhardware,software,algorithms,methods,andothercomponents.Theprizeswere providedbytheAustriancompanyg.tecmedicalengineering(authorCGistheCEO), IEEEBrain,theBCISocietyandbytheGermancompanyCorTec. Theawardsprocedurethisyearfollowedaprocedurelikeprioryears: 1. TheBCIAwardFoundationselectsaChairpersonoftheJuryfromatopBCI researchinstitute. Fig.1 TheBCIAwardFoundationhassevenboardmembers.Alloftheboardmembershavebeen activeinBCIresearchforatleasttenyears