OpenSHMEM and Related Technologies. Big Compute and Big Data Convergence: 4th Workshop, OpenSHMEM 2017, Annapolis, MD, USA, August 7-9, 2017, Revised Selected Papers PDF
Preview OpenSHMEM and Related Technologies. Big Compute and Big Data Convergence: 4th Workshop, OpenSHMEM 2017, Annapolis, MD, USA, August 7-9, 2017, Revised Selected Papers
Manjunath Gorentla Venkata Neena Imam · Swaroop Pophale (Eds.) OpenSHMEM and 9 Related Technologies 7 6 0 1 S Big Compute C N and Big Data Convergence L 4th Workshop, OpenSHMEM 2017 Annapolis, MD, USA, August 7–9, 2017 Revised Selected Papers 123 Lecture Notes in Computer Science 10679 Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen Editorial Board David Hutchison Lancaster University, Lancaster, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Friedemann Mattern ETH Zurich, Zurich, Switzerland John C. Mitchell Stanford University, Stanford, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel C. Pandu Rangan Indian Institute of Technology, Madras, India Bernhard Steffen TU Dortmund University, Dortmund, Germany Demetri Terzopoulos University of California, Los Angeles, CA, USA Doug Tygar University of California, Berkeley, CA, USA Gerhard Weikum Max Planck Institute for Informatics, Saarbrücken, Germany More information about this series at http://www.springer.com/series/7408 Manjunath Gorentla Venkata Neena Imam (cid:129) Swaroop Pophale (Eds.) OpenSHMEM and Related Technologies Big Compute and Big Data Convergence 4th Workshop, OpenSHMEM 2017 – Annapolis, MD, USA, August 7 9, 2017 Revised Selected Papers 123 Editors Manjunath Gorentla Venkata SwaroopPophale Oak RidgeNational Laboratory Oak RidgeNational Laboratory Oak Ridge,TN Oak Ridge,TN USA USA Neena Imam Oak RidgeNational Laboratory Oak Ridge,TN USA ISSN 0302-9743 ISSN 1611-3349 (electronic) Lecture Notesin Computer Science ISBN 978-3-319-73813-0 ISBN978-3-319-73814-7 (eBook) https://doi.org/10.1007/978-3-319-73814-7 LibraryofCongressControlNumber:2017963768 LNCSSublibrary:SL2–ProgrammingandSoftwareEngineering ©SpringerInternationalPublishingAG2018 Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartofthe material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodologynow knownorhereafterdeveloped. Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant protectivelawsandregulationsandthereforefreeforgeneraluse. Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbookare believedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsortheeditors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictionalclaimsin publishedmapsandinstitutionalaffiliations. Printedonacid-freepaper ThisSpringerimprintispublishedbySpringerNature TheregisteredcompanyisSpringerInternationalPublishingAG Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland Preface OpenSHMEMisaPartitionedGlobalAddressSpace(PGAS)libraryspecification.The main abstractions of the programming model are execution contexts called processing elements(PEs)andsymmetricmemoryobjects.Theprogrammingmodelalsoprovides explicitmechanismstoaccessandtransferdatabetweenthesymmetricmemoryobjects of different PEs. The key factors that make OpenSHMEM an excellent choice for parallel, communicating HPC applications is its simple application programming interface (API), support for remote direct memory access (RDMA), and constant innovation in the library API to keep abreast with the current scientific and hardware changes. Over the past few years there is a growing momentum behind the develop- ment and usage of the OpenSHMEM programming model. The OpenSHMEM Workshop is the premier venue for presenting new and inno- vative PGAS research in the context of OpenSHMEM. OpenSHMEM 2017, held in Annapolis, Maryland, was the fourth event in the OpenSHMEM and Related Tech- nologies workshop series. The workshop was organized by Oak Ridge National Laboratory and sponsored by ORNL, DoD, Cray, Nvidia, Mellanox, ARM, and HPE. Theworkshopwasattendedbyparticipantsfromacrossacademia,industry,andprivate and federal research organizations. This year, the workshop focused on “OpenSHMEM and the Big Compute and Big Data Convergence.” The workshop included two days of technical presentations fol- lowed by one day dedicated to the OpenSHMEM Specification discussions and development. The technical segment commenced with a keynote from Dr. William Carlson. Apart from being a member of the research staff at the IDA Center for ComputingSciencessince1990,healsoleadstheUPClanguageeffort.Thetitleofhis talk was “Shared Memory HPC Programming: Past, Present, and Future?”. The paper session discussed a variety of concepts, including extending the OpenSHMEM API for future architectures, new applications using OpenSHMEM, evaluation and implementation of OpenSHMEM for new architectures, novel use of OpenSHMEM for theheterogeneous environments, and new development inthe tools eco-system for OpenSHMEM. All papers submitted to the workshop were peer-reviewed by the Program Committee (PC) which included members from uni- versities, industry, and research labs. Despite the short turnaround, each paper was reviewedbyatleastthreereviewers.Inall,11fullpaperswereselectedtobepresented at the workshop. This proceedings volume is a collection of papers presented at the workshop. The technical papers provided a variety of ideas for extending the OpenSHMEM specifi- cation and making it efficient for current and next-generation systems. This includes newresearchforcommunicationcontextsinOpenSHMEM,differentoptimizationsfor OpenSHMEM on shared memory machines, exploring the implementation of Open- SHMEM and its memory model on Intel’s KNL architecture, and implementing new applications and benchmarks with OpenSHMEM. VI Preface The third day of the workshop was focused on developing the OpenSHMEM specification.Thisyear,2017,liketheyearbefore,hasbeenaveryexcitingyearforthe OpenSHMEM committee. Thanks to the active participation at the workshop, the committee is in the process of ratifying OpenSHMEM Specification 1.4. The Open- SHMEM meeting at the workshop is an annual face-to-face OpenSHMEM committee meeting making it an important and impactful venue. The general and technical program Chairs would like to thank everyone who con- tributed to the organization of the workshop. Particularly, we would to thank all authors, PC members, reviewers, session chairs, participants, and sponsors. We are gratefulfortheexcellentsupportwereceivedfromourORNLadministrativestaffand Daniel Pack, who helped maintain and update our workshop website. December 2017 Neena Imam Manjunath Gorentla Venkata Swaroop Pophale Organization General Co-chairs Neena Imam Oak Ridge National Laboratory, USA Manjunath Gorentla Oak Ridge National Laboratory, USA Venkata Nick Park Department of Defense, USA Technical Program Co-chairs Manjunath Gorentla Oak Ridge National Laboratory, USA Venkata Swaroop Pophale Oak Ridge National Laboratory, USA Technical Program Committee Ferrol Aderholdt Oak Ridge National Laboratory, USA Matthew Baker Oak Ridge National Laboratory, USA Pavan Balaji Argonne National Laboratory, USA Swen Boehm Oak Ridge National Laboratory, USA Bob Cernohous Cray Inc., USA Zheng Cui VMWare, USA Tony Curtis Stony Brook University, USA James Dinan Intel Corporation, USA Jeff Hammond Intel Labs, USA Bryant Lam Department of Defense, USA Arthur Maccabe Oak Ridge National Laboratory, USA Dhabaleswar (DK) Panda Ohio State University, USA Nick Park Department of Defense, USA Stephen Poole OSSS, USA Sreeram Potluri NVIDIA, USA Michael Raymond SGI, USA Gilad Shainer Mellanox Technologies, USA Pavel Shamis ARM, USA Sameer Shende University of Oregon, USA Min Si Argonne National Laboratory, USA Weikuan Yu Florida State University, USA VIII Organization Sponsors Diamond Sponsors Silver Sponsors Bronze Sponsors Contents OpenSHMEM Extensions Symmetric Memory Partitions in OpenSHMEM: A Case Study with Intel KNL. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Naveen Namashivayam, Bob Cernohous, Krishna Kandalla, Dan Pou, Joseph Robichaux, James Dinan, and Mark Pagel Implementation and Evaluation of OpenSHMEM Contexts Using OFI Libfabric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Max Grossman, Joseph Doyle, James Dinan, Howard Pritchard, Kayla Seager, and Vivek Sarkar Merged Requests for Better Performance and Productivity in Multithreaded OpenSHMEM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Swen Boehm, Swaroop Pophale, Matthew B. Baker, and Manjunath Gorentla Venkata Evaluating Contexts in OpenSHMEM-X Reference Implementation. . . . . . . . 50 Aurelien Bouteiller, Swaroop Pophale, Swen Boehm, Matthew B. Baker, and Manjunath Gorentla Venkata OpenSHMEM Applications Parallelizing Single Source Shortest Path with OpenSHMEM. . . . . . . . . . . . 65 Ferrol Aderholdt, Jeffrey A. Graves, and Manjunath Gorentla Venkata Efficient Breadth First Search on Multi-GPU Systems Using GPU-Centric OpenSHMEM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82 Sreeram Potluri, Anshuman Goswami, Manjunath Gorentla Venkata, and Neena Imam Evaluation, Implementation and Novel use of OpenSHMEM Application-Level Optimization of On-Node Communication in OpenSHMEM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99 Md. Wasi-ur- Rahman, David Ozog, and James Dinan Portable SHMEMCache: A High-Performance Key-Value Store on OpenSHMEM and MPI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Huansong Fu, Manjunath Gorentla Venkata, Neena Imam, and Weikuan Yu
The list of books you might like
