dec :: dtj :: dtj v07-03 1995

100 Pages·1995·15.7 MB·English

I
HIGHP ERFORMANCFEO RTRAN
INP ARALLEELN VIRONMENTS
Digital SEQUOIA2 00R0E SEARCH
Technical
Journal
Volum7eN umbe3r
1995
Editorial TheD igitTaelc hnijcoaulr nails r eaf ereeDdo rieas r egisttreardeedmo afKr ukb ota
JanCe.B lakMea,n agEidnigt or jourpnuabll iqsuhaerdt beyDr ilgyi tal PaciCfiocm putIenrc .
HeleLn.P atteErdsiotno,r EquipmCeonrtp ora3t0P ioornt,Re ora d Exab ytieasr egisttreardeedom fa rk
KathlMe.Se tnes tno,E dtoir L)02/lDOL ,itt elotn,M assach0u1s4e60t.t Esx abCyorer poration.
Subscrirport hieojnosu ma$i40a.r0e0
Circulation (non-$U6.0S)f. o fro uisrsu easn $d7 5.00 Hewlett-PaanHcdP ka arrrede gistered
CatheMr.iP nhei lAldimpistn,ri astor (noUn.-.S$ 115f) oeri gihsts aunemdsu st trademoafr kHse wPlaectktCa-ormdp any
DorotBh.Ce aas dsyaS,e cretary bep repianUi. dS f.u ndUsn.i versity JaBnMa dn SdP 2a rree gisttreardeedm arks
collepgreot sesorasn Pdh .Ds.ru deimns ofn!t ernarionaMla cBhuisniense ss
Production theel ectircale ngineaenrcdi onmgp uter Corporation.
TerAruit riiPe,r oducEtdiiotno r scienficeles dr ececiovmep limesnutba­ry
AnnSe.K atzeff, Typographescrrp itinsou porne quOersdte.ir nsq,u ,i riIelIsu sitasrr ae gisttreardeedom faI rlkl ustra
lntormaTteicohnn olIongci.e s,
PetRe.rW oodbuIrlyl,u strator anda ddrecshsa ngsehso ublesd e nttot he
DigitTaelc hnica!journrahlpeau tb lisheIdn­tieaslt radeomfalrknC roreplo ration.
AdvisBoroya rd bya ddreIsnsqiri.ues c aanl sboes enetl ec­MCf iasr egisttreardeedom faM CrIk
SamuHe.lF ullCehra,i rman tronlilcyrao d [email protected] ngle coCpoimemsu nicaCtoiropnosr. a tion
RichWa rBde ane anbda cki ssuaersea vailafbol$re1 6.0e0a ch
DonaZl.dH arbert byc algl DiEnCdiraet1-c 8r0 0-DIGITAL MEMORY CHANNEL iast rademark
WilliRa.Hm a we (1-800-344-48)2.5R ecebnatci kss uesofrohefE ncoCroem putCeorr poration.
RichJaHr.od l lingsworth journaalra el saov ailoantb hlIeen e rtntea t Mosaiiasct radeomfaM roks aic
RichFa.Lr adr y hr rp:j/ww w.dig.ictoma/linfo/DT.J /ChoommmeuincatCioornpsoi roant.
AlaGn.N emeth hrm.Cl omplDeitgeal iI tnterlniesttc iann gs
Nerspceai as t radeomfaNrekr scape
RobeMr.tS upnik be obtaibnyse edn dainne gl ectmraoinli c
CommucnaitiCoonrsp oration.
messagreoi [email protected] ral.com
NewrorniSpicras t rademofaA rpkp le
Digietmapll oymeaeyos r dseurb spctriions
Computer,I nc.
throuRgeha dCehrosi bcyee n teringVTX
PROFIaLttE h sey stpermo mpt. NFSi asr e gisteredt radeomfaS rukn
Microrseymss,I nc.
Commenotnts h ceo ntoefan ntpy a paerre
welcomaenmdda yb es enttot hmea naginOgp enGiLas r egteirsetdr ademaarnkd
ediattot rhp eu bhsheodrn- ebtyw aodrdkr esOsp.e Inn venitas to rrda emarokfS ilicon
Graph,Ii nccs.
Copyrig19h9t5D© i giEtqauli pment
CoveDre sign CorporaCtoipoyniw.ni gt hfoeuietps e r­ PictTueirlase r egriestdtr eadeomfa rk
Thei magoents h fer oanntbd a ccko vers mittperdo vitdheasdtu ccho piaerse madPei cturCeoTrpcolr ation.
oft his airdseisf fueer venits ualizatifoonurss i ene ducatiintosintaultb iyfo ancsu ltPyo stSicasrr iepgti sttreardeedom far k
oft hsea mdea toau tpfurtoa m r geional membearnsad r neo dti strifbocurot me­d AdobSey stIenmcs.
climsaitmeu laptrioognrr aumbn y D r. mercaidavla ntAabgset.r awcittcihrn egd it
JohRno adosft hSec ripIpns stitouft ioonf D itgaiElq uipmCeonrtp oraatuitohno'rSsA­ ICi asr egisttreardeedom faS rcki ee nc
Oceanaopgh.rTy hed atdeap iecdtc on­ shpi isp ermitAtlrelid g.rh etsse rved. ApplicIatnitoenrsn aCtoiropnoarla tion.
tamiena suorfte esm peralqtiuuiraden ,d Thei nformiantt hijeoo nurn ali ssu bjectS iemie·nsras e gisttreardeedom fa rk
gasewoautsce orn teanntwd,i nvde ctorst;o c hanwgiet hnoouttia cnesd h ounlodt Siemens NixdorfSlynsftoeIrmn.msc a,t ion
thteo pogrraepphrye sbeynt thdeead t a
bec onstarsuac e odm mitmbeyDn itg italS oniyas e griesrtetdr adeomfaS rokn y
itsh wee stUe.rSni. nJ anu1a9r9y0P .r ­o
EquipmCeonrtp oraotrbi yto hnce o mpa­Corporation.
vidienagrs tchi enwtiittshht aesb iltiot y
niheesr erienp reseDnitgeiEdtq.au li pment
visuasluicdzhae ti aos n oef t hoeb jectives SPECi ast radeomfat rhSket andard
Corporaatsisounmn eors ep sonsifboirl ity
oft hSee qu2o0i0a0re searcphr oject- aneyr rtohrasm ta ya ppeiantrh Jeo urnal. PerformEavnacleu aCtoiuonincl .
aj oienftt oofrt thU en iveorfsC iatlyi fornia, Telesicasrt irpard eomfaG rekn eMraagil,c I nc.
governmeagnetn cieasn,di ndusttobr uyi ldJ SSN0 898-901X
ac omputign environfmogerln otbc ahla ngeD ocumentNautmiboeEnrY -T838E-TJ UNIXi asr egeiredst tradeimnathr ek
resecah.rT hiissps ruees peapneotrnsss e v­ UnitSetda arneodst hceoru ntlrciieenss,e d
ermaalj roa n:e:xaplso rbeydS equ2o0i0a0 Boopkr oducwtaidsoo nnb eyQ uantic exclusivelXy/ Otphreonu gChLo tmd.p any
CommunicaItnico.n s,
rese;uchienrcsl,u dainneg l ectrreopnoisci ­
tornyet,w roknig, ndav iusazlaition. Thef olloawritenr ga demoafDr ikgsi tal
Equipment CoDripgoirttaahlte,i on:
Theco vweards e sneigdb yL ucndiaO 'NeilDlI GITAL AllopgGhoea,n eration,
ofD itgailDe'ssi gGnr ouSpp.e lct ihaangkos A JphaServer, DAElCp,D hEaCS rarion,
toP etKeorc hefvoasrurp pilnygt hceo ver OSF/ 1D,E CstaGtIiGoAns,w irch,
imgae.s TURBOchaannndUeL lTl,U X.
Contents
Foreword )c anC .B onnev 3
HIGHP ERFORMANCFEO RTRANI N
PARALLEELN VIRONMENTS
CompiliHnigg hP erformaFnocret rfaonr JonathHaanr riJso,h nA .B ircsMa.kR ,e ginBao lduc, 5
Distributed-mSeymsotreym s JiAlnl nD iell'IaslrdaG,ea ll e!\,c iWl. J ohnson,
ShiLne eC,. A lexandKeerl so:nm,d C arDl. O ffner
Desigonf D igitaPla'rsa lSloeflt waErnev ironment EdwarGd .B ensonD,a viCd. P .La FrancLei-nden, 24
RichaAr.dW arn::ann,d S antW�i1r vaman
SEQUOIA2 000R ESEARCH
An Overvieowft heS equoi2a0 00P roject MichaSerlo ncbr,lker 39
TheS equoi2a0 00E lectroRneipco sitory Ra\R·. L arsoCnh,r istPiLalnu nr, 50
AllisGo.nW oodrufafn,dM JrrHie arst
TecatAe S:o ftwaPrlea tfofromrB rowsianngd PeteDr. K ochevaanrd L .eon�R1.Wr adn ger 66
VisualiDzaitnafg r omN etworkeDda taS ources
High-perform1a/n0acn edN etworkiSnogf tware josepPha squaElrei,Wc . A ndersoKne,v iFna laln,d 84
inS equoi2a0 00 JonathSa.nK av
Digital T)�ocuhnnLilcla l Vol.l'-:7o .3 1995
Editor's
Introduction
Scienhtaivlsenot gbs e emno ti,·atpoarrsa:1 lplpelli coantc ilounsosnfu : pr s �11L1edvn V anpgreers tehnketa tures
tct>hrde e velopomfpe onwte rt-l1tlo 2 56m achiTnheesa\.l' se ox amin:ten dh mctiotnhsir seo sfea prrcoht o­
computeinnvgi ronments. dTewsoid genc isreialotnitos v mee ssage­tl'apnocdf fdeert aitlhoseb ejcotf
sectiinto hniisss s oufteh .feounw/ p�lsssiunpg piondr its trisb1u·tsetdme omdse l tahrneod lo eft hiem erpre­
addrtehsrese quireomfsecnitesn rainnsdch ared-mseymsotrePvmS sE; tiAvbcs trVaicstu aliLaznagttiuogen
antde chnciocmaplu tTihnetgi .r sts,u pponrettsw omreks spaagses ing(,A VLt)c p)rro gramTmhiencvgo .n ­
froDni1g li'stH aigPhe rtonnancues iTnCgP/ 1P o rU DP/ ll'p rotococllsu,wd iete hx amapplpel ictJhtaito ns
TechnCiocmaplu ting lGorookusap n,sd h armeedm orv. browdsaets ap aces.
atc ompialnedrd e veloptmoeonlts MichSateoln ebrpaakpeoerpr'e sn s Thec halloefhn iggeh -snpeete­d
thata ccelepreartfeo rimnap nacrea ltlhesele ctrictoaun r iSnegq u2o0i0a0 workifonSrge qu2o0i0a0i tsh seu b­
environmTehnest se.c osnedc tionr ese�a1ri1cas1hn d o veveril ol'ft he jeocftt' hp ea pbeyrJ osePpahs quJie,
loorok tseh f utoufrc eo mputingp;r ojeocbtj'esca tnisdvt eastT hues . EriAcn derKseovnFi,an la ln,Jd o n
UniveorfsC iatlyi faonrDdni iigaatl objecetnicvoemsp assusppeotdri: t> rK alI'nd. e sigand iinsgt riSb\u'tSetde m
researpcrheestrehsne wtio rro kn a high-pertfi:/m0on nat necrea bvtteh aetf ticrieetnrtisletvvo erasen,sd ,
lardgies,t ricboumtpeudt ing ednavrsiaer tposln,a­ caildnlag ti ana D BlvlSt,r ::mlUsIfl'e arrosgb ej e(cietnxs c ess
mems uittoet dhn ee eodfes a rstchi ­anpdr m·indei1,n1·gi· s ualtiozoaltiosof tn e nosrh undroefmd esg al)w,t es
entissttusd vgilnogbc ahla nsguecsh anhdi gh-snpeetweodr kAif-tnegr. rhetvc >eounso epde raStIi'nSgt em
aso cedaynn amgilcosbw,aa lrm inga,d iscuosfst ihaoern c hitleac,t·uer1ra/s0lan ,d n etwosorfuk1 aTrhee.y
anodz ondee pleDtiigoinwt.:�a asln her eviseowmsle e ssloenJsrnl ewc l descrf\iVOb1 /e0 S\' Stem sofuv:li"C
early isnpdounsastnorpdrya rticippa:rmttir csi-hpci�oe1ffnwhiwcahts o soulroins-conirenarsh pipign and
int hjiosi rnets eparrocjhce acltl,e dv ietwhs ey staesam ne nd-to-endp eer-tIo/-Op-eteharav to i(db ta
Sequ2o0i0a0 . solutiocno-nacnldwu idte:1hls o okc opyiTnhgeT.iC rP/ IPn etwork
Tos upptohrwetr itoifpn agr allaethl1 t uerw ork. softwsaroel utcieonntosnea rv oiding
progrtaomcrso mputatiinotneanlslAeyn e ffimceianestn otlr ocatingo rr educcihnegc kcsoummp utation.
environDmiegnittsea,xl t ehansd eadn rde trideavtfi·iaon mgt hvea st Thee dittohrasJn eka Bno nnev,
DEC fort9r0ab nyi mplementisntgo irnte hsSe e quDoRiMaS \ \'as DigitDailr'esco tfEo xrt ernal
mosotfH igPhe rformFaonrcter ant htea asdkd rebsvst ehSdee quoia Reseatrochrehr , e hpli no btaining
( PHf v)e rs1i.o1A.nft erre viewin2g00 0E lectR.reopnosiict ponr·o jectth pea peonrS se qu2o0i0a0r esearch
thsey ntafecatturiecso fF ort9r0a n teaR.m�.lL lu'so nC,h rPilsa ,u nr �1t1i1l:dl>' rri tthiFnego rewroo trld1 is
andH PFJ,o natHhaanr reitas lf .c >eAulsl iWsooond raunfNdfb ,r Hteia rstIS SUC.
ont hHeP Fc ompidleesr iagnnd desctrhiLeb1 es steenixn dte nxgi Ourn exists uwei flela tpuarpee rs
expbtihnoe p timizaitptie orntso ramnsrd e trmieetvhaoldd nse !o�ledo nm ultimaendUdiN aI Xc lusters.
ro imprionvtee rprcoocmemsusnio­rt i:t>rh PeO STGREdSa tabsavsset em,
ctaioni nad istributeedn-vmie­tmhoer GyI sPSyYs tte(am>u rt omiantdiecx ­
ronmesnpte,c inicnwa olrlkys,t atiinogn ofursiegnxgt se ogr:c�opohri­c
clus(ttearrsbm sa)s oendD igital'dsi n�dlitsecsui snts hetede xatn,rd h e
64-bAiltpm hiac roprocessoTresxT.ti limnegt htoodar ut omt:i�c
Ther un-tsiumpepf oortrth diiss ­parriroifto enxitn gd ocro umems
tribeuntveidr onitmshe Pena tr alleenlh �1nce retrieval.) ;mC. eB lake
Mallrlt._rd�iitlolrg
SoftwaErnev iron(mPeSnEEt)d . Then eetdCt loro tlobs r owse
BensDoanv,Li ad france-Linthdroeunhg, � 1tnod1 ·isuSaelqiuzoei �1
RicWha rraennSd,a nvtVai n'ama2n0 00d at1a1as t hiem pebteuhsi nd
desctrhiPebS eEp roduwchti,ic sh Tecu:1e s,o frwpalraet foonwr hmic h
layeornte hdUe N IXo peratingb rsoywss­:�innvdgi su:1alpipzlaitciao­n
teamn idn cltuodoeflsosd r e veloptiinogcn 1sbn e b uiPlett.Ke orc he1·ar
2 Digit�l'lJ<:ocuhrnnailc tl Vol7. �o 13'19 S
Foreword
AlTerar igoropurso ceosfps r ­o • Supporrotar v artyio ferraditional
poS<lld evelpoment :mdr evibeyw databasesa ndfi lsey stems
expertsa tD igitaanldr heU nievrsit\• • Thea bilityto perfonremc essary
ofCalit(S.>renqiuao,2i 0a0 0b egan operationst i·coomm putngi
inJ une1 991T.h et (JCoufts h e environmtehnatatsr ic ntuitive
rcsean.:h wasa ihg-hspeed,b road­ andh avreh es amleo oakn dk cl;
h<11nledt wosrpkan ning Univerist'\ thei merfatcote h ee nvironment
ofC alif(c>amrnip<usles f roml krkelev shoulbdeg enerviecr,hy i glhe vel,
toS amaB arbaLrao,sA ngele,as nd and easitallioyr edt ot heus er
JeaCn. B onney SanD iegoam; : lssdiavtea b::�ssteo;r ­ :lf-1plicatin o
Dirc>Jc:i:!YJiNt'l"/cl:>l s!elmi· cb age;,·�isu': tliazrion syste�mm;de lce­ • High-sp eedd atmai gration
tronciocl laboraDtri,ii·nogn .hr e
bet\vseeeconn darya ndte rtiary
reserachr equirememsw erce1 rrh
storagew ihtt hea biltiyt oh andle
The lntonmUrtiiolnir thve, sciemiTshresc .o mpminngee dso f
veryl arged attar ansfers
Informatino Highw�l\'t,h eI nternet,t hess..ei.: enstrsip ush rhes taotfeth e
rheI nfi.>brahhenI ,n fmoartion an.C urrecnorm puting technologies • Net\vork bandcwaipdatbhl e
Eeonon-wrhes ounldw teosf rhe lactkh ec 1pabilierairetsschi enrists ofh andliinmga gter ansmission
1990Tso.1 11�t1hkeesc eo ncepts needro asimsilatea nd inrerpretr he acronsesr vvoirnak nsa cceptable
reality, oab urtst echnolo"b'i ntra­ ,·aqsuatn rirciso finri.>r..m.:aotli­on rimhea mew itqhu alityg uarantees
structiusnr eec essIanr1 y9.9 0, lccrterdo ms atellOintceers h.ed ata fct->hred a ra
Digi�1tl'sr eesarcho rganziatoin saw arcc ol..l.:et:1c1d1 odr ganiztehde,ri es • High-quarleimtoytv ei sualization
rbinse ed: mds eoru tt od evelaonp rhec halelngeo fm assives imulations,o fa nyre levantd atrae gardless
exl1erriamrlees nth edt hawto uld simulattihoant(t>sr ccastw orlcdl imate oftormatt;h eu semru sbte a ble
examianseus mptionsa ndp roviad e teno re veonn eh undreyde Jrtsi ·om to manpiulatet hevis uald ata
basti<sa> t rec hnolob"'e dgien t he' 90s.n owT.h eswee ree xactltyh ek inds interactively
There sultingp rojectw asS equoia ofc halelngest hec omputsecire tnists • Reliabgluaer,ant eed,d elivery
2000a,t h ree-vcarr eseacroclhl abornae­eded. ofd attaio ·m tertisatroyr atgoe
tiobne t\veDeingta il,c ampusoefst he Among them :1jroersl tuso fth ree rhede sktop
Univreistyo fCaliti.�>1rn1si1e�dvl e,r aly e�nosfw orko nS equo2i0a0 0w as
otheirn dusatnrdvg overnmemo rga­as eto fp rodu..t.:r equirememst (>r Sequo2i0a0 0w asa lsaoc a talyst
nizatiTohnesS e.q uoia2 000vi sion is laregd ataa plpciations.T hesreeq uire­ t(m>art uritnhegP OSTGRES research
l'c>!ahylie..s/!e. r i/ulji'huyilc>isS) memsh aveb eevna lidatthroeudg h databassoef t\vtaotr heep oinwth ere
oj'dalianu dislrilmolrecdh lic(. discusswiiotcnhus s tomienrt si n­an iwta sr eadtoyr o..m.:mercialization.
/runsparelm!al1i1ra ,t.;aJetdd. ciahle,a lthcaanrdce o,m municatioTnhsec ommercviearsilon ,I l us!tra,
lugicacllive tio'ueC'rad h l;t.;h-speul industJrnidie nsgo vernmenr.T he isa vailoanbA llep hpaal tformsa nd
nelnndu'· i!ihs uchmiicOaIpIaSh ililierse quin:miencnlurdse ise njoiyng succeisnts h eb anking
l'ai ah ous/ll oo/s industrya ndi ng eographici nforma­
• A comptuinegn vironmbeuinltt tiosny ste(mG ISa)p plicataiso ns,
-ino rhewro rdasb ,i gb,s te,a sy-ro­ ona no bjcetr elatidoantaalb ase,
welalsi n otghoevre rnmenatp plica­
uses ystem. i.ea.t ,h ta-cecnormrpiutcin g tionwsi tmha ssidvaet raeq uierments.
Althoughr hev isiiossn t inloltr elaity system IllusirsJr lasm oa kinign roaidnstt oh e
todaoyu,rm oreth ant hreyee ars • At btabaset hahta ndlaew si de Imernet whietir sue s ebdy o n-line
ofp artiicpaiton inS equoia2 000 varietyo fn ontraditlio obnjcaets services.
research gavues r hekn owledgeb ase sucahs t ora,u divoi,edo ,g rpah­ Yeta notherm ajorre suolfSt e quoia
wes ought. icasn, di nuges 2000w asa g ranfi-to m theN ational
DigiTtcacll mJiocu�rnl. 1l Vol.N o7. 3 1995 3
AeronauatnidSc psa cAed ministra8­ hculmne·m berasn ds tudepnmt­s lleccstso; ;Jlslts'hilIes'n r t (mnarion
tio(nl \:AStAod )e velaon;p l ltemar,e· idacddd itional Feoxuporef r tiTseec.h noliontd,u'silrn'ir tvqs u est
archiretc(ttJuhr1eE · aer tOhb sen·inDgi gital's weonrgkieondnes eirtse , t(tJhrue b iquidtiosutsr ibuted
Svstie)m; aunadl ntcmnaSr)i·osnt e;mm d;v la rioefsn u·p popretr sonneli ntcmnasr1i·osnr em.
(EOSDIESO)S.[ )wJiSlp lr octehses ti·ootmh eirn dusstprovn spo::�rrst ici­Ho1e1l saer\ c\ g'oCi ntgog et
pctJbvorfrees: �ld-atrit:mi�e· om p:-tteidn,c ludSiAnlgCt ,h Ce1 li�clrniin::�s iignhttto h cer itiiscs::�uolef bs u ild­
the EO:b�srtehr vSiynsgt (eE mO S) DepMtmeonfrv VaRteesro urces,i nagn dr elioapbelrva t:1 rionbgu st
sateltlobi etl easu ncahtet dh een d Hewlett-PaMcektarrudUm,n, i ted intcmlli;nHtii·oans rrwuictthuoruct
oft hdee c1dTeh.ea ltemianttc( Jr­StatCecso logSiucravJ(e UyS GS), build;ilL n1gr tgecsb te dw itrhc :e1nld
mari:o1nr chirpercorpuorsbeevt d h e HugheAsp plicaItnito(nm nationu sewrhso snee edpsu srhh set aotfe
Unive.r osfiCtavl itb(cJurn.li In:I·�' Js Sen·i::�cnedts h,Ae n nvC orposf th:eH atte acpho int ;tJhw[eoa nvg?
thSee quo2i0;0l;0 J rchirlerc rurEen.g ineers. \Ve belitehv;elH : 1prrgocj escitmsi lar
wilhla vaem ;ljionrt luoennt chee But; Jisst hce1 swei tshu c::�hm bi­ toS equoairanc u ciTahle.p ;lJKrs
EOSDIpSr oject. tiopurso jetchtes\r,\e ' telrlel :mtircliu­tr( JI;IHotwtc sotr h iem port;Jilt
fm thee; ustchi emisrs, g;pl:innc;sdl nddi fticulr tlc;el1sr1s 1o nsk nol1e1d gge; 1iWnech da.1 t·ccl cuscd
1\'mCardeei ns imul;snpieoen:d msd tol eamT.oe xperim1e1n·rtie tahl - spccitoinct ahleeln ld'- to-se1n·ds rem
111a ccetsoLs u gset oroefso rg:mizleidrte e sbte dmse ancso nsiderabh-­ti·otmh sec iiesnttdse's kttoopt sh e
datTah.e ssec iemuissetsdso moeF morre ha1n1 rriina gr igorsoeuts massst or;S1\g'cS ttchmce,h allenge
DigittailrA'slstp hwao rkst;EmHmi ono Fh1-porhienas p erso posMailc.ha elo fb uild:i�nnugds in;lgl; lLrhgtc; l
ands ottwp;rlorteo tti('tJJhrKe Sci lri ­Stonehri,nlh kipesa rp,e nro,t eas repositrhoreni ·m,c ainldf- iJsltJ OI'e­
matsei mulatAinoe nisg.h t-proclelslslolrol fclhb,clri l\e\nt:K"geCed sa nd menotf ,·elna·r ogbej emc·testr h e
Alph,:,�· orksbrr:mp� nrwiiodnae d thlee sslocn:s1 rnOendeo. f thies suesn etwo;rlklb,lr dc l\1;-1s1,i\·dni gs ualiz­
t\\'O-ptroi-coen/cp ed(Jmln;kmlclrelh ­::�ktq lstu rbcwiansgt h"eg rease indga ttai ·noemt worskoeudr ces.
tagoe1 ·tehrpe m 1·ermfuullt,i mill;imodgn l­uet"et lhlie.n ti·asttrhuactr ure,
dollCa:rRA CY9 0ma chiInne: .m otheirst ,h ien reroperoafpb iielcoiefns ·
earstchi eanpcJe) Iiusrciioenm,i srsso fna1r aen dh ard11·acroem ptolsuetd
usi1A1lgp haan dh icr;ucshtiourl; lgtch een d-to-Se\n'dS1 t'ehmri.esm ains
svstecmosu lsdi muir;1H1\e·' oc Hs' ,\c hal.ltehnangtee e drse se;iJfwr ec h
wortohf clidm,alottveJe t rh 1ec1 c k­ ;lgio'iCn tgoa chitehvpeer omised
endw ithooupte raitmocrn 'Cntiognc;d ost i'ntcrnct\Aln'ootrhkeirn g.
tcmlltc\rIhm''oO,n thwso'r tohh bt:-t sticpko\i·nw ta ss calabOinlt ihtey .
roookn ed avt os imui:-t;nHdre e quireodn eh andi,it sdi ffitcobu ulital l d' t:rv
considerablei mOeJn)·ecrn;tHioolrna .r ngeet worskvesdt tie·mo srnc ratch.
Thums: �nmyo rsei mul:�croiuolnds O nt hoer hchra nda,sw es lowbluvi lt
bep rocesisn;el t di xreidm :-ten d thmea ssst orsasvgree tmo t hep oint
"timteod iscovWe;rldvse" c rc1sedo Fm inimcarli tmiacsasll,i t T( nmd
considerablv. th:tlhtce u rreonftt �thc-shelftech­
Nowt haltl em' el oo;klS te quoi:-tn ologti(emJs.r 1 sstso rwaegrene o t
200i0nr etroswpoeucltId,I d 'oC I'CtJocb hep· u ut stec olurrp urposes.
sucahp roject Tahge;a 1i1n1ls wcrS ov,e s\,\b 'elC iet1h·peer ojlelc't; ls
isar esound'i'nlg·ti c·so;"m! oIfI 11·orth1l1l·s'iohrmihGel l el 'e\<VHes .
usi m·ohI·et\d \.'a c; olmsp lperxo j­ g;1icnreidr kincm1lli eadbgoeu tth e
ectth aitn clu1d2eUd n il'loTfs in·t cchnol;o1g1l,1l·Jd',[ e sG ol l:ll�loen g
Calitcbmc1uilmane ·m ber2s:1g, r ad­1a11i·n leatrnhiaenr got f d irecting
uatset ude;nmtd2s ,0s t:A1nfoft hera ndl eadtihnneg· pocfp rojtehc;til st
4 \(,].7:- (-:) ,)1 995
I
JonathHaanr ris
JohnA .B ircsak
CompilHiinggh M. ReginBao lduc
JilAnln Diewald
PerformFaonrcter an IsraGeall e
NeiWl. J o lmson
foDri stributed­ShinL ee
C.A lexandet· Nelson
memorSyy stems CarDl. O ffner
DiigtaDlE'CsF ortr9a0nc ompiliemrp lmeents HighP erformaFnocret r(aHnP F)i sa newp rogram­
mosto fH igPhe rfoarnmec Fortrvaensr io1n. 1, mingl anguafgoer w ritipnagr alplreolg ramIst.i s
baseodn theF ortr9a0n l anguagwei,t he xtensions
a languafgorew rintgi paalrlperolg ram.Ts he
thaetn ablteh ep rogrammreosr p ecih�orwa rraoyp er­
compilegre neartecso def ord itsriubted-memory
atiocnasn b ed ividaemdo ngm ultiple protcoers sors
machinesc onstiisnogf i nternceotcnedw ork­
increapseerdf ormanIcnHe P.F ,t hep rograsmp ecitles
staotnis soerr veprosw erebdy D iigtaAll'psh a onltyh ep atteirnnw hicthh ed atias d ividaemdo ng
micorporcessoTrhse.D ECF ortr9a0nc ompiler the procetshseoc rosm;p ilaeurr omattehsel ow-level
efficieinmtlplye mnetst hef eatrueosf F ortr9a0n detaoifls sy nchronizaantdci oomnm unicatoifdo ant a
benvecpnr ocessors.
andH PFt hastu poprtp aarlellisHmP.Fp rograms
DigitaDlE'Cs F ortr9a0nc ompiliestr h et irismrp le­
compidl weitDhi igtaclo'msp ileyrie lpdef ror­
mentatioofn t he fHu PlFl versioln. lla nguage
manec thastc allenise arolrye vens ueprnleiarly
(excefpotr t ranscriaprtgiuvmee npta ssindgy,n amic
ons igfniicaanptp laitcioonnsb othd itsritbeud­ remappinagn,dn esteFdO RALLa nd'NH ERE con­
memorya nds haerd-memyo arrcihetctures. strucTths)ec. o mpilwearsd esignteodar d istributed­
memorym achinmea deu p ofa clust(eorrf armo)f
workstataionnds/ or serpvoewresr ebdy Digital's
Alphmai croprocessors.
In distribuetmeodr-ymm achinceo,m munication
a
betweepnr ocessmoursstb ek eptto a na bsolumtien i­
mum,b ecaucsoem municataicorno tshse n envoriks
enormousmloyr et ime-consutmhianangn vo peration
donel ocalDliyg.i taDlE'Cs Fortra9n0 compiler
includae nsu mbeorf o ptimizattioom ninsi mitzhee
cosotf c ommunicatbieonnv eepnr ocessors.
Thipsa pebrr ierfleyv ietwhset eatuorfeF so rtr9a0n
andH PF thastu ppopratr alledleisscmr,i hboewst he
compiliemrp lementthse sfee atureefsf icieanntdl y,
concludweist hs omer ecenpte rformanrcees ults
showintgh aHtP tp rogracmosm pilweidt hD igital's
compilyeire lpde rt(xmatnhcaest c alleisn eaorrle yv en
superlineoanr sliyg nifiacpapnlti catoino nbso th
distributeodr-yam nedms hared-memaorrcyh itectures.
HistorBiaccaklg round
Thed esitroew ritpea ralplreolg radmast ebsa ctko t he
1950ast,l easatn,d probeaabrllyTi heerm .a thematician
Johnv onN eumannc,r ediwtietdth h ei nventoifot nh e
basiacr chitecotfut roed ays'esr icaolm puterasl,s o
inventceedl lualuatro mattah,ep recursooftr o day's
massively paralleTlh e cmoancthiinnueisn.g motiva­
tiotno rp aralleilspi rsomv idbeydt hen eedt os olve
computatioinnatlelnpysr eo bleimnsa r easonatbilmee
and<l ta na ffordapbrliecT eo.d ay'psa ralmlaeclh ines,
l)igTietc:lhln Jiocuarnla l Vol.N o7. 3 1995 5
whichr angte·i omc olelctioonfsw orksttiaoncso n­ • The neekde tepopr ocseosr�s1 bsu sJvS p ossilbe bv
:
nectbeyds tandtabiredr-o ptcin ewtorktso r ig�hctoluv­ balancithnegc omputation laoda cropsrosc csss o,
peldC PUsw itchu stomh ihg-speeidn etrconnction
It niost a lwayosb viowuhsi ccho mputJtionsi n
newtorksa,r ec heaptehra sni nlge-opcresssovrs tems
� J Fortrparno graamrc pa�rl:lliezaAblltchu.og h some
witehq uaielvntp erofrmanec.I nm any cas,e squiva­
DO loopesx preps<sall lrclabilzcco mpuattioontsh,e r
lenstm glper-ocesssvosrt edmos n ote xiasntd c ould
DO loopnsp rescso mputationisnw hihc ltaeiret ra­
notb ec onstruwcitteehdx insgtt iechnoolgv.
: tionosft helo op requier ther esusl otfe alrieiertr a­
Historlil,c yoaneo ft hed ififcuilets\\i thp arlaell
tions.T hifso rctehse coumtatpionto bed onie no rder
machmesh abse ewnr tiinpgaa rlleplr ogmrsa.T hew ork
(scrial)l,v r1:thctrh1 1�1 simualnetosu�\('i npa r�l1e)ll.
ofparl�eallizinga p rograw�m1 fsar f ·iomth eo ringail sci­
Alsow, hetheorr n otJ compuattioins} Xl 1L11ie:lzlblc
encbee nge xplorietrde ;uq riedp rogrmamerst o keep
somemteisd epenodnsu sedr: an rh1�rm av\ 'rJ'\t i·om
tracokfa greadtea lo fi ni:tm11atiuonenra lterdo t he
runto r unof t hep rogr<�m.A ccoirdnlgvH,P f c<.m>ains
actual caotmipounatsn;di tw asd oneu sinagd h oc
a news t�amteent( FORALL)t )(rd esrcibipn�lrg:ll lel
methotdhs awte rneo tp ortabloet htemora chnies.
computtaons,a nda n ewd iercti(vIeDN EPENDENT)
Thee xpieernegc ainfe·ido mt hiwso r'kh owevr'e led to1 dennh• adiditoln:lp :��rcl:llc ompuattionsro the
toa consnesuosn a bettweary t ow ritpeo ratble
compielrT.h estei t::uaraercsc qu:1ulsleyuf lt>( rd sitbr­i
Fortrparno gratmhsa t wopuclrtdo wreml oln a v arietv
; ute-dors haerd-memormy�K hincs.
of palremalal chniesT.h eH ihg Pcrxt<mancc Fort,r a
HPf's daat dsitbruitiodnie rcitevsa rc patricluarly
Formu,a n inetrnaticoonnaslo urmt oifm oret han �
imporntath >rd i srbruti e -dm emorym achinTehs.
100c ommercipaalar llme�1lc hiunsees r,a caedmcis,
H PF dierctivweesr ede signed pri1mir�;ltov nicrc::�sc
andc omputveern odrsc,a prteuda ndr dinetdh ese
perofrmancoen" computersw irh nonuli(mfn mem­
ideapsr,o udcintgh el agnuaeg nowk nowna sH igh
orya ccecsosss t."O'f ::1p1ar�J1ll lca crheictteusrd,si tbr­i
PerofrmancFeo ratnr.' 'H Pf progarmminsgv stcms
; utedm emoryi sth aer cheictutrei nw hicrhh cl ocation
arcno wb eign develpoedb ym ostv enodrso f� arlaell
ofd atah as theg reateesfktc to n accecsoss tO.n
machinaensds ofrvvarcH. P fi si ncldu adspe arotft he
dsitbruite-dmeomrym achines, inctrproscscocro m­
DECF ortr9a0nl naguage.'
municatiisov nc revxp ensicvoemp ared rot hec osotf
One obvioaunsd r eaosnablqeu setioins vVl:w
; rethcinlgco adla ta,t yipulblvyS C\'Cralo redsro fm ag­
invean t nelwna guagreat her thhaavnec o mpiles
niutdeT.h ust hec fkcotfs ubopmti�1lds itbruitioonf
auotmaticllayg enaetrep aarllceodle ; The awnesri s
daata cropsrso cescso1rnbs ec at:s�rrophci.H P td irec­
stratiotgrhwar:d iistg cncral�vl concedde thaatu ot­ tivteels tlh eco mpiler how to distribuet dat�alcr oss
matipcaa rlkaltiizotncc honl�oiv isn otv e�st utlfcienrlpvr ocessboarsseo;dn k nowledgeo frhacl ogrithm,p ro·
adavnce.d tAhlougphaa rllaerloinf zi:r> rptciulaarcrhi ·­
grammesrc hoosed i:nc\t'iCtSh <\l\it'l mli nimci c;:om­
tectu(ree.sg v.e,ct omrac hniesa nds h1�remde-morv
� muniCJtitoinm eT.h esedi recetsie vm Jlshoe lp
mutliopcressso)hr asb eens uccessufl, iti sn otf ul·l
� ach1egvoco dl oabda lnac:e lsp)re\a'di ngd aat :lppro­
auotmatibcu tre quiress ubstanarsiissta:lllc el fromt b
pnarclya crospsro csesors,r hcco mpuattioonnst hsoe
progmrmaert oo btagiono dp er(f>mranc.eT haats ss­i
daraw ilall sboe s pre::tacdro ssp rocessros.
tancues ulaycl omes ifn( mtnoh feh nittso tchomep ierl
Fi1nl�lva, n umbero Fi diomsth H� arci moprtainnt
andr ewritsteecnt ioofcn osde t haatr em orea rpalclilz­
pareallpl rog::trmmnige tihearr acw kw�r1dto expersisn
able. Thhitenss,e ianns dom ec astehsr ee writctoedne
� Fortroar:n 1 rgcr cadteh'p ednenotn n uchicn; rlchcicr­
arnc otu sulaypl ortbaltoe othearr cehcittrueosr c om
turteo tr heeifrcf iieinmtpl cinciHJtion.T o beu seufli n
pirlscA.g reemenwta sw ideesapdra tth eH PFf orum
a portablalnegu age,t hesiedi omsm usrb ec ast\o'
thaats eotf h itnsc oulbdes tm�dadri,;eadn dd onei n3
expreasnsdi m pelmentc fticitcl.nv PHI-' hasca pt�1red
portawbalyeA. u tomatpiaacrll e,Jait;itoenhc noolg.vi s
someo ft hesiedi oms:1s l biraryr ounteist> (rc fircite n
ana ctifveiel odf r eseha;rc consueeqnltyi,ti se xpcctcd ;
implemteaintono nv erdyi kfrc1t:J crheicttcusr.
thacto mpeirlwsi lbleco mei necarnsiglayd cp51t T.1h us,
Fore xamplcoen,sid er rhcF orr1r:1717 p rogram in
theshem tsa re cas�t1 cso mmens-tcaleld compiler .
F1gu1rc,w hicrhep etaedlyre palces eacchl emte onf
dicrteivesi-nth es orucceo deH.P fa cura;vl clonatins at wo-idmenisonaarlr wayi rrhh acv cr:o�fig srcn otrh,
verlyi unJecw l anugagbee yontdh iisct;o nsiptrsi mar­
southe,a satn,d w esnte igbohrTs.h iksi nodf ocmpu­
ilyo ft hecseo mpidlireerc tives.
tJtiaorins eisna numebro fp rogHLJ1iSn,c ludicircnlg­
TheH PF lanugagew ass hpaedb y cetr:likne. v tivseo lvetrosr pardtikifraclni taelq uati:omnds
cosnidaetrioinnps a arlleplr ogarmming:
imgae-iflertinagp plicnions.h gurc 2s hwosh owr his
• The needt oi dentif)•c omputationst hacta nb e codcea nb ee xpersseidnH Pf.
donei np aarllel On a machine fw)(ilrtlp hro csesor,s:1 snigle H)lF
diercivte CJusetsh ear ray A tob ed itsrbiuetd:� cross
• Then eedt om inmiizec ommunaitciobne tween
thep rocessaossr hso wn inf igure 3.T hep rogram
procesosonmr asc hniesw itnho nuonrimfm emorv
accecsoss ts
6 DigiTteachln ciajlo urnal Vol7. o:-.3-: 1995
i ntegern , numbe_rof_iteratinos,i ,j,k
paraemte(rn=16)
real A(n,n),T emp(n,n)
. . .( Iintialie zA, number_of_iteratinos)
do k=1, numbre_of_iteratinos
c
Update non-edgeel meentso nly
do i=2, n-1
do j=2, n-1
Temp(i ,j )=(A(i ,j -1)+A(i,j +1)+A(i1+, j )+A(i-1 ,j ))*0.25
enddo
endd o
do i=2, n-1
do j=2, n-1
A(i , j=T)emp(i , j )
endd o
enddo
endd o
Figeu 1r
A ComputatEixopnr esisnef do rtr7a7n
i ntegern , numbre_of_iteartinos,i , jk,
parameter( n=16)
real A<n, n)
! hpf$ distriubteA (blockb,l ock)
. .(.I in tialie zA, numbre_of_iteratinos). . .
do k=, 1number_of_iteratinos
forla l( iZ=:-n1, j=Z:n-1) 1 Update non-edgeel ementso nly
A(i,j )=(Ai(,j -1 )+iA,(j +1)+A(i1+,j )+A(i-1 ,j ))*0.52
endforlal
endd o
Figeu 2r
TheS �meC ompuattionp rEexssienHd P F
I'�- �.:·,·:1 exectuesi np aralolnet lh ef ouprr ocesswoirtseh,a ch
';' ��f:�: ' ·'J!'�, 1·.� procespseorrf ormtihnegu pdatteost hea rrya ele­
t:'t��J. 5'1 � �j t� mensti to wns.T hiusp date, howreevuqeierrs,i nter­
�-.
processor commun(iorc "adtiaotmnao tio"n.) To
, �-
' 0 computae newv alufeo rA (8 ,2 ) ,w hichl iveosn
2
�.2'
:'·i�'"" process0o,tr h ev aluoef A (9,2 ),w hichl iveosn
•:�.·r , ;r,� -�... spervoecvneas llsuoiA,ersn(s9 e ,2e d)Ae(d9.,3 ) I,.pn r. Ao.f(9c a,e8cs 0)tsf ,r ore roq mpu riotrcheeess ­
�·· �.r ·:'�b'•� . sor1 ,an dt hes evev,n a luAe(s2 9,) ,A (3 ,9 )., .A.8( ,9 )
fi·opmr oces2s.orE" a chp rocesstohern,n, e edsse ven
valuaepsi efciem· otwone igohrb.sB yk nowintgh eJ ay·
outo fth dea ata ndt hec omputatbieoinn pge rofrmed,
thec ompilcearn a utomaticgaelnleyr atthee i nter­
1 3 procescsoomrm unicatiinosnt rucnteieodnestdo e xe­
cutteh ec ode.
Evenf ors eeimnglsyi pmlec asetsh,ec ommunica­
4
tioinn sutcrtiocnasnb ec ompleFxi.g ures howtsh e
communicatiionns triuocnttsh aatr gee neraftoetrdh e
FORALL
codet baitm pleemnst the statemefnotra
distreidb-utmmeoryp arallel processor.
Figeu 3r
An Arr:�Dyi stribouvtererod u Prr ocersss o
DigiTreaclh njiocuarnla l Vol7. N o3. 1995 7
l'roocreOss Processor Proces2s or Proce3s sor
SEND SEND SEND SEND
A(82,) ..A (88,) A(92,) . A.( 98,) A(29,) ..9 )A (S, A(99,) .A(51,9)
roP rocesIs or toP roces0s or l'ocr·css0o r to ProceIs sor
to
SEND SE:'-JD SE:'-in SE:'-!D
A(28,) A(S8,) A(98,).. A (lS,8) A(89,). A.( S1,5 ) A(9, .A9.() 9 9,)
roP roces2 sor Proce3s sor Pmcesso3r Proce2s sor
ro ro ro
RECEIVE RECEIVE REC:EIV:� RECEVIE
A(92,) . A(89), A(82,). A.(.8, R ) A(28,) A.(8.,8 ) A(98,). A(51,8)
ti·Pormoc essorI form Proces0s or from Processo0r torrnl 'nsKscoIr
RECEIVE RECEIVE RECt-:IVE RECEIVE
A(29,). A.(.Il 9,) A(99,). A.(.I 5 ,9 ) A(99,) A{9I,S ) A(89,). .A(.8 1,5 )
form Proces2s or· ri·oPmr oces3s or fromP roces.sio r form Proce2s sor
Figeu 4r
Compri-lgeeneCroammteudina ctitoorn< 1F ORALL Srate111ent
Althougthh ec ommuniacjtonn eedeidnt hissi m­ lnaguagei,nw hicthh eradosf c omputatairode nsi tbr­i
plee xampilsen otd ififcutlotf giuer outb yh and, ute.dL ikteh set aanrddF ortr7a7nF, o rtr9a0n,a ndC
keepitnrga cokf thceo mmuincatinoende ed for modeltsh,eH PFp rogarmminmgo declo ntianass ni­
hihge-rdimseinoln aarra,y dssitbruitedo not more glteh reoafcd o ntrtohlel; a gnuagiest elfahsn on otion
processwoirtsmh,o rec ompilcatedp uctoaomtnisc,a n ofp roceosrts h era.d
bea v erdyi fifcublutg-,p rotnaes Ikn.a diditona, l1n!1­l Conceparlu,l tvhep rograemx ceuets oanl tlh e
bero f tohpet iimzatitohnacsta nb ep erofrmewdo uld processsoirmsua lnteoluysS.i nceeah c procescsoonr­
bee xrtemeltyei doutsofi guroeu tb yh adn.N e\'er­taionnsly subsoeftt hed istbruietdd atoac,c aosnially
�1
thleesdsi,s btureitdm-emoryp aarllter)lo cessaorres a procesmsaoyrn eedr oa ccedsast as toreidnt he
progarmmeda lmoesxtc ulsievltyo dabyyw riitnpgr o­ memoryo fa nothperro cessTohrec. o mpielrd eter­
gramtsh acto ntaeixnpc liihta nd-egreantcealdl tsot he minest haec tudaelat iolfst hien etrporcesscoormm u­
SENDa ndR ECEIVEc ommunicatriootunni esT.h e nciatinoene dd etos upportth iasc cestsht;ai sr,a ther
differencbee twetehnik sj ndp orofg mrmaing apnrdo ­ thabne insgp eficeide xpilci,tt lhyed eatialrsci mplicit
gramminign H PF isc ompaarblteo t hed ifference in tphreo garm.
between assleamnbgglueyap rogarmminga ndh ig­h Thec ompirl teranslHaPtFe psr ogarmsi tnol ow­
lveella nugagper ogarmming. lveelc odet hacto ntaeinxsp liccailttlo sS ENDa nd
This pacopnentrui sew itahn o verwv ioeft heH PF RECETVEm essa-gpeansgsr ioutineAsl.la drdessiens
lnaguagaed ,si cussoifot nh em achianrec hecitteu trar­ thitsr aantselcdo de maordci ifesdo t hatth erye efrt o
getebdyt hceo mpil,te hraecr heicttrueo ft hceo mpiler datlaco atlo procesAssop ra.r otf t hitsar nasltino,
a
istel�f anda dsicussioonf somoep tmiiaztiopnesr ­ adderssinegx pressiaonnds loboopun ds become
formedb yi stc omponesn.It tc oncluwdietsrh e cent expersosnisi vnolvitnhgep rocessnoumr beorn w hich
per()frmaen cresultss,h woingt haHtP Fp rograms thceo diees x ecjunrgT.h ust,h ceo mpilneere dtsog en­
compilweihdt D igitaclo'msp ilscearll neie arilnsy i g­ eraotne loyn ep rogarm:t hgee neractoeddie sp a arme­
nitlcacnats es. trizbeytd hper ocesnsumobr eran ds oc anb ee xeceudt
on all procsesorwsi thap rpopriarteesI ust on each
Overvioefwt heH igPhe frormance procesTshoirs. genecroadtee cdia sl leexdp lisciintg le­
Fortrlaanng uage programmu litlped-aat codeo,re xpilc-iStMPD code.
Ins omec asetsh,ep rogarmmerm ay fnidi tu seufl
HighP erofrmane cFortrcaonn sstiosf a smalls eotf tow ritcex pilcit-ScPoMdDae t t heso rucec odleve e.l
extenstioo nFso r9t0r.aI nti sad ataa-rplaleplro grma­ To accmomodatteh itsh,eH P F lanugagei nucdleasn
mingla nugagem,e aning tahlaetlls impi asmr adep os­ escaphea tcchal ledE XTRNISCI procuerdest haits
sibblyet hee xplidcsiittr ibuotfli aogrnea rraoyfds a ta used lteoa \d'atea -paalrlmeold ea nde nteerx plicit­
acropsrso cessorosp,p oasset do cao notlr-aprallel SPMDm ode.
8 DigiTtecahln ijcoaulrn al Vol7. ;\io3 1995