Table Of ContentPARALLEL
C o M P UTAT I O NAL
FLUID
DYNAMICS
TRENDS AND APPLICATIONS
Proceedings of the Parallel CFD 2000 Conference
Trondheim, Norway (May z2-25, zooo)
Edited by
C,B, dENSSEN T, KVAMSDAI._
Statoil S INTEF
Trondheim, Norway Trondheim, Norway
H,I, ANDERSSON B. FIETTERSEN
NTNU NTNU
Trondheim, Norway Trondheim, Norway
A, ECER d, PERIAUX
I UP UI, Indianapolis Dassault-Aviation
Indiana, U.S.A. Saint-Cloud, France
N. SATD FU KA Assistant Editor
Kyoto Institute of Technology
Kyoto, Japan P, FOX
IUP UI, Indianapolis
Indiana, Japan
N
200I
ELSEVIER
Amsterdam - London - New York - Oxford- Paris - Shannon - Tokyo
ELSEVIER SCIENCE B.V.
Sara Burgerhartstraat 25
P.O. Box 211, 1000 AE Amsterdam, The Netherlands
(cid:14)9 2001 Elsevier Science B.V. All rights reserved.
This work is protected under copyright by Elsevier Science, and the following terms and conditions apply to its use:
Photocopying
Single photocopies of single chapters may be made for personal use as allowed by national copyright laws. Permission of the Publisher and payment of a fee
is required for all other photocopying, including multiple or systematic copying, copying for advertising or promotional purposes, resale, and all forms of
document delivery. Special rates are available for educational institutions that wish to make photocopies for non-profit educational classroom use.
Permissions may be sought directly from Elsevier Science Global Rights Department, PO Box 800, Oxford OX5 1DX, UK; phone: (+44) 1865 843830, fax:
(+44) 1865 853333, e-mail: permissions@elsevier.co.uk. You may also contact Global Rights directly through Elsevier's home page (http://www.elsevier.nl),
by selecting 'Obtaining Permissions'.
In the USA, users may clear permissions and make payments through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA;
phone: (+!) (978) 7508400, fax: (+1) (978) 7504744, and in the UK through the Copyright Licensing Agency Rapid Clearance Service (CLARCS), 90
Tottenham Court Road, London W I P 0LP, UK; phone: (+44) 207 631 5555; fax: (+44) 207 631 5500. Other countries may have a local reprographic rights
agency for payments.
Derivative Works
Tables of contents may be reproduced for internal circulation, but permission of Elsevier Science is required for external resale or distribution of such material.
Permission of the Publisher is required for all other derivative works, including compilations and translations.
Electronic Storage or Usage
Permission of the Publisher is required to store or use electronically any material contained in this work, including any chapter or part of a chapter.
Except as outlined above, no part of this work may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic,
mechanical, photocopying, recording or otherwise, without prior written permission of the Publisher.
Address permissions requests to: Elsevier Global Rights Department, at the mail, fax and e-mail addresses noted above.
Notice
No responsibility is assumed by the Publisher for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or
from any use or operation of any methods, products, instructions or ideas contained in the material herein. Because of rapid advances in the medical sciences,
in particular, independent verification of diagnoses and drug dosages should be made.
First edition 2001
Library of Congress Cataloging-in-Publication Data
Parallel CFD 2000 Conference (2000 : Trondheim, Norway)
Parallel computational fluid dynamics : trends and applications : proceedings of the
Parallel CFD 2000 Conference / edited by C.B. Jenssen ... let al.].
p. era.
ISBN 0-444-50673-X (hardcover)
I. Fluid dynamics--Data processing--Congresses 2. Parallel processing (Electronic
computers)--Congresses. I. Jenssen, C. B. (Carl B.) II. Title.
QA911 .P35 2000
5 3 2'.0028 5'4 3 5--dc21
2001023148
ISBN: 0-444-50673-X
G The paper used in this publication meets the requirements of ANSI/NISO Z39.48-1992 (Permanence of Paper).
Printed in The Netherlands.
PREFACE
Parallel CFD 2000, the twelfth in an international series of meetings featuring
computational fluid dynamics research on parallel computers, was held May 22-25, 2000 in
Trondheim, Norway, retuming to Europe for the first time since 1997. More than 125
participants from 22 countries converged for the conference which featured 9 invited lectures
and 70 contributed papers.
Following the trend of the past conferences, areas such as numerical schemes and
algorithms, tools and environments, load balancing, as well as interdisciplinary topics and
various kinds of industrial applications were all well represented in the work presented. In
addition, for the first time in the Parallel CFD conference series, the organizing committee
chose to draw special attention to certain subject areas by organizing a number of special
sessions. Particularly the special sessions devoted to affordable parallel computing, large eddy
simulation, and lattice Boltzmann methods attracted many participants.
We feel the emphasis of the papers presented at the conference reflect the direction of
the research within parallel CFD at the beginning of the new millennium. It seems to be a
clear tendency towards increased industrial exploitation of parallel CFD. Several presentations
also demonstrated how new insight is being achieved from complex simulations, and how
powerful parallel computers now make it possible to use CFD within a broader
interdisciplinary setting.
Obviously, successful application of parallel CFD still rests on the underlying
fundamental principles. Therefore, numerical algorithms, development tools, and
parallelization techniques are still as important as when parallel CFD was in is infancy.
Furthermore, the novel concepts of affordable parallel computing as well as metacomputing
show that exciting developments are still taking place.
As is often pointed out however, the real power of parallel CFD comes from the
combination of all the disciplines involved: Physics, mathematics, and computer science. This
is probably one of the principal reasons for the continued popularity of the Parallel CFD
Conferences series, as well as the inspiration behind much of the excellent work carried out
on the subject. We hope that the papers in this book, both on an individual basis and as a
whole, will contribute to that inspiration.
The Editors
This Page Intentionally Left Blank
vii
ACKNOWLEDGMENTS
Parallel CFD 2000 was organized by SINTEF, NTNU, and Statoil, and was sponsored
by Computational Dynamics, Compaq, Fluent, Fujitsu, Hitachi, HP, IBM, NEC, Platform,
Scali, and SGI.
The local organizers would like to thank the sponsors for their generous financial
support and active presence at the conference. We are also grateful for the help and guidance
received form Pat Fox and all the other members of the international organizing committee.
We would like to especially thank G~nther Brenner, Kjell Herfjord, and Isaac Lopez, for
proposing and organizing their own special sessions. Last, but not least, we would like to
thank the two conference secretaries, Marit Odeggtrd and Unn Erlien for their professional
attitude and devotion to making the conference a success.
Carl B. Jenssen
Chairman, Parallel CFD 2000
viii
INTERNATIONAL SCIENTIFIC ORGANIZING COMMITTEE
PARALLEL CFD 2000
R. K. Agarwal, Wichita State University, USA
B. Chetverushkin, Russian Academy of Sciences, Russia
A. Ecer, IUPUI, USA
D. R. Emerson, CLRC, Daresbury Laboratory, Great Britain
P. Fox, IUPUI, USA
M. Garbey, University of Lyon, France
A. Geiger, HLRS, Germany
C.B. Jenssen, Statoil, Norway
D. Keyes, Old Dominion University and ICASE, USA
C. A. Lin, Tsing Hua University, Taiwan
I. Lopez, NASA Lewis, USA
D. McCarthy, Boeing, USA
J. McDonough, U. of Kentucky, USA
J. Periaux, Dassault Aviation, France
N. Satofuka, Kyoto Institute of Technology, Japan
P. Schiano, CIRA, Italy
A. Sugavanam, IBM, USA
M. Vogels, NLR, The Netherlands
LOCAL ORGANIZING GROUP
PARALLEL CFD 2000
C.B. Jenssen, Statoil (Chair)
J. Amundsen, NTNU
H.I. Andersson, NTNU
S.T. Johansen, SINTEF
T. Kvamsdal, SINTEF
B. Owren, NTNU
B. Pettersen, NTNU
R. SkS.lin, DNMI
K. Sorli, SINTEF
ix
TABLE OF CONTENTS
1. Invited Papers
H. Echtle, H. Gildein, F. Otto, F. Wirbeleit, F. Kilmetzek
Perspectives and Limits of Parallel Computing for CFD Simulation in the
Automotive Industry
Y. Kallinderis, K. Schulz, W. Jester
Application of Navier-Stokes Methods to Predict Votex-Induced Vibrations of
Offshore Structures 13
R. Keppens
Dynamics Controlled by Magnetic Fields: Parallel Astrophysical Computations 31
H.P. Langtangen, X. Cai
A Software Framework for Easy Parallelization of PDE Solvers 43
Y. Matsumoto, H. Yamaguchi, N. Tsuboi
Parallel Computing of Non-equilibrium Hypersonic Rarefied Gas Flows 53
O. Mdtais
Large-Eddy Simulations of Turbulence" Towards Complex Flow Geometries 65
G. Tryggvason, B. Bunner
Direct Numerical Simulations of Multiphase Flows 77
P. Weinerfelt, O. Enoksson
Aerodynamic Shape Optimization and Parallel Computing Applied to Industrial
Problems 85
2. Affordable Parallel Computing
O. Galr V.O. Onal
Accurate Implicit Solution of 3-D Navier-Stokes Equations on Cluster of Work
Stations 99
P. Kaurinkoski, P. Rautaheimo, T. Siikonen, K. Koski
Performance of a Parallel CFD-Code on a Linux Cluster 107
R.A. Law, S.R. Turnock
Utilising Existing Computational Resources to Create a Commodity PC Network
Suitable for Fast CFD Computation 115
I. Lopez, T.J. Kollar, R.A. Mulac
Use of Commodity Based Cluster for Solving Aeropropulsion Applications 123
R.S. Silva, M.F.P. Rivello
Using a Cluster of PC's to Solve Convection Diffusion Problems 131
A. SoulaYmang T. Wong, Y. Azami
Building PC Clusters: An Object-oriented Approach 139
M.A. Woodgate, K.J. Badcock, B.E. Richards
The Solution of Pitching and Rolling Delta Wings on a Beowulf Cluster 147
3. Performance Issues
G. AmatL P. Gualtieri
Serial and Parallel Performance Using a Spectral Code 157
A. Ecer, M. Garbey, M. Hervin
On the Design of Robust and Efficient Algorithms that Combine Schwartz Method
and Multilevel Grids 165
J.M. McDonough, S.-J. Dong
2-D To 3-D Conversion for Navier-Stokes Codes: Parallelization Issues 173
4. Load Balancing
T. BOnisch, J.D. Chen, A. Ecer, Y.P. Chien, H. U. Akay
Dynamic Load Balancing in International Distributed Heterogeneous Workstation
Clusters 183
N. Gopalaswamy, K. Krishnan, T. Tysinger
Dynamic Load Balancing for Unstructured Fluent 191
H. U. Akay, A. Ecer, E. Yilmaz, L.P. Loo, R. U. Payli
Parallel Computing and Dynamic Load Balancing of ADPAC on a Heterogeneous
Cluster of Unix and NT Operating Systems 199
S. Nilsson
Efficient Techniques for Decomposing Composite Overlapping Grids 207
xi
5. Tools and Environments
Y.P. Chien, J.D. Chen, A. Ecer, H.U. Akay
Computer Load Measurement for Parallel Computing 217
M. Garbey, M. Hess, Ph. Piras, M. Resch, D. Tromeur-Dervout
Numerical Algorithms and Software Tools for Efficient Meta-computing 225
M. Ljunberg, M. Thun6
Mixed C++/Fortran 90 Implementation of Parallel Flow Solvers 233
M. Rudgyard, D. Lecomber, T. SchOnfeld
COUPL+: Progress Towards an Integrated Parallel PDE Solving Environment 241
P. Wang
Implementations of a Parallel 3D Thermal Convection Software Package 249
T. Yamane, K. Yamamoto, S. Enomoto, H. Yamazaki, R. Takaki, T. Iwamiya
Development of a Common CFD Platform-UPACS- 257
6. Numerical Schemes and Algorithms
A. V. Alexandrov, B.N. Chetverushkin, T.K. Kozubskaya
Numerical Investigation of Viscous Compressible Gas Flows by Means of Flow
Field Exposure to Acoustic Radiation 267
A. Averbuch, E. Braverman, M. Israeli
A New Low Communication Parallel Algorithm for Elliptic Partial Differential
Equations 275
M. Berger, M. Aftosm&, G. Adomavicius
Parallel Multigrid on Cartesian Meshes with Complex Geometry 283
E. Celledoni, G. Johannnessen, T. Kvamsdal
Parallelisation of a CFD Code: The Use of Aztec Library in the Parallel Numerical
Simulation of Extrusion of Aluminium 291
B. D&kin, I.M. Llorente, R.S. Montero
An Efficient Highly Parallel Multigrid Method for the Advection Operator 299
R.S. Montero, I.M. Llorente, M.D. Salas
A Parallel Robust Multigrid Algorithm for 3-D Boundary Layer Simulations 307
Description:Parallel CFD 2000, the Twelfth in an International series of meetings featuring computational fluid dynamics research on parallel computers, was held May 22-25, 2000 in Trondheim, Norway. Following the trend of the past conferences, areas such as numerical schemes and algorithms, tools and environme