Essentials of Error-Control Coding

390 Pages·2006·6.001 MB·English

by  Jorge Castiñeira Moreira, Patrick Guy Farrell

OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
ESSENTIALS OF
ERROR-CONTROL
CODING
Jorge Castiñeira Moreira
UniversityofMardelPlata,Argentina
Patrick Guy Farrell
LancasterUniversity,UK
iii
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
ii
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
ESSENTIALS OF
ERROR-CONTROL
CODING
i
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
ii
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
ESSENTIALS OF
ERROR-CONTROL
CODING
Jorge Castiñeira Moreira
UniversityofMardelPlata,Argentina
Patrick Guy Farrell
LancasterUniversity,UK
iii
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
Copyright(cid:2)C 2006 JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,
WestSussexPO198SQ,England
Telephone [phone]
Email(forordersandcustomerserviceenquiries):[email protected]
Visit our Home Page on www.wiley.com
AllRightsReserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystemor
transmittedinanyformorbyanymeans,electronic,mechanical,photocopying,recording,scanningor
otherwise,exceptunderthetermsoftheCopyright,DesignsandPatentsAct1988orunderthetermsofa
licenceissuedbytheCopyrightLicensingAgencyLtd,90TottenhamCourtRoad,LondonW1T4LP,UK,
withoutthepermissioninwritingofthePublisher.RequeststothePublishershouldbeaddressedtothe
PermissionsDepartment,JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,WestSussexPO19
8SQ,England,[email protected],orfaxedto([phone].
Designationsusedbycompaniestodistinguishtheirproductsareoftenclaimedastrademarks.Allbrandnamesand
productnamesusedinthisbookaretradenames,servicemarks,trademarksorregisteredtrademarksoftheir
respectiveowners.ThePublisherisnotassociatedwithanyproductorvendormentionedinthisbook.
Thispublicationisdesignedtoprovideaccurateandauthoritativeinformationinregardtothesubjectmatter
covered.ItissoldontheunderstandingthatthePublisherisnotengagedinrenderingprofessionalservices.If
professionaladviceorotherexpertassistanceisrequired,theservicesofacompetentprofessionalshouldbesought.
OtherWileyEditorialOffices
JohnWiley&SonsInc.,111RiverStreet,Hoboken,NJ07030,USA
Jossey-Bass,989MarketStreet,SanFrancisco,CA94103-1741,USA
Wiley-VCHVerlagGmbH,Boschstr.12,D-69469Weinheim,Germany
JohnWiley&SonsAustraliaLtd,42McDougallStreet,Milton,Queensland4064,Australia
JohnWiley&Sons(Asia)PteLtd,2ClementiLoop#02-01,JinXingDistripark,Singapore129809
JohnWiley&SonsCanadaLtd,6045FreemontBlvd,Mississauga,ONT,L5R4J3,Canada
Wileyalsopublishesitsbooksinavarietyofelectronicformats.Somecontentthatappearsinprintmay
notbeavailableinelectronicbooks.
BritishLibraryCataloguinginPublicationData
AcataloguerecordforthisbookisavailablefromtheBritishLibrary
ISBN-13 978-0-470-02920-6(HB)
ISBN-10 0-470-02920-X(HB)
Typesetin10/12ptTimesbyTechBooks,NewDelhi,India.
PrintedandboundinGreatBritainbyAntonyRoweLtd,Chippenham,England.
Thisbookisprintedonacid-freepaperresponsiblymanufacturedfromsustainableforestryinwhichatleasttwo
treesareplantedforeachoneusedforpaperproduction.
iv
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
Wededicatethisbookto
mysonSantiagoJosé,
MelisaandBelén,
Maria,Isabel,AlejandraandDaniel,
andthememoryofmyFather.
J.C.M.
andtoallmyfamiliesandfriends.
P.G.F.
v
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
vi
OTE/SPH OTE/SPH
JWBK102-FM JWBK102-Farrell June19,2006 18:0 CharCount=0
Contents
Preface xiii
Acknowledgements xv
ListofSymbols xvii
Abbreviations xxv
1 InformationandCodingTheory 1
1.1 Information 3
1.1.1 AMeasureofInformation 3
1.2 EntropyandInformationRate 4
1.3 ExtendedDMSs 9
1.4 ChannelsandMutualInformation 10
1.4.1 InformationTransmissionoverDiscreteChannels 10
1.4.2 InformationChannels 10
1.5 ChannelProbabilityRelationships 13
1.6 TheAPrioriandAPosterioriEntropies 15
1.7 MutualInformation 16
1.7.1 MutualInformation:Definition 16
1.7.2 MutualInformation:Properties 17
1.8 CapacityofaDiscreteChannel 21
1.9 TheShannonTheorems 22
1.9.1 SourceCodingTheorem 22
1.9.2 ChannelCapacityandCoding 23
1.9.3 ChannelCodingTheorem 25
1.10 SignalSpacesandtheChannelCodingTheorem 27
1.10.1 CapacityoftheGaussianChannel 28
1.11 Error-ControlCoding 32
1.12 LimitstoCommunicationandtheirConsequences 34
BibliographyandReferences 38
Problems 38
vii