BSTJ 50: 1. January 1971: Exchange of Spatial and Temporal Resolution in Television Coding. (Pease, R.F.W.; Limb, J.O.)

5 MB·English

Exchange of Spatial and Temporal

Resolution in Telev

sion Coding

Ry RF W, PEASE. and J. 0. ETM

We describ is thin pape teen sytem ison a fration of
the pice elament 8 sanpled. A motenens daacting eens exasives the
Frenrsfrane difecs gnaie ane iden the pire kato "maving”
‘and takowary aces Te eatiory wea ik wow pd este ret
Geis salue fee ‘he potions frame: im macing ancee the wneanpled
dementa take émerplaced cues from te swzeat frame. Whew shai)
of the clement vs oanpla, te eenling picture ve dau fe eingnsh
rom the rein, aly snp yet. When Be Santon i ont one
fron, ie Wart ioe ru Asta, We naion aera
ane ieprosemen.

‘Television coders are ueually designed to mob simulinncouely the
worst contingenies with rxbect to conti, sbaroniee and mover
"het ie a fact moving exbjot eam he zepredced. ith the fal spatial
solution sifor'ed a ationary shjeot and. with the fall contrast
elution afforded ¢ low deiail subject. Uy contrast zealution we
teen the aseursey with whith the coded signsl seposeene the empli
tude of the input signsl fora partculr piature element

‘We want to reduee the chennel expasty required for transmitting
television signals by coding the eiqual so that full stil sesoution is
tly available in stationary arese of the piture and ‘ull temporal
‘wotution is only available in moving area of fhe pitane,

Exchinge of sale] te contrast reolutns Ins been appneisted
acd demonriratal for some tine! Orm nf le frat capes of = ender
thst exelienged spatial and coutcoetreecutio yee demonstrated by
BR. Rretamare; more quancizing levels wore sized Wo low Stee
Caieney signal enmponente nd fener levels wave ons to Bh eee
‘quency signal componente
192 mame nun exwinoe wens: ToURANy TANUART 11

Av. Saplas aa pointed ul Uc Ibis psingiplo oan be extended 10
‘exchanging temporal and ypiin’ risahiion beeease we can talcue
During, of moving ebjset. Wise evisent beeroco the ceevisin

eras the wen sgpal om te sagt fer 1/0 of seamd.
Thus, if the objec: being ingot on He large: moves ducing ‘his
pon, he iniage will be blazzed ad loon will bo destzoyed in
the diction im which tae objet moves, The arsount of blurring oan
bbe quite Lnsge. For exinple, Tie abject movee ab a spe which
would require two xooonds (eros the television seven, Un in ane
Fremectige a piclare element would average light from ol iferent
piefureclereats wn the objeet (az brondosat television ran). Conse-
‘qucaly, ifthe objet ie moving in th horivonal direston, the boi
Sonia) teolulion $e redueed spproximalely eightfold; chee i= even
more reston if chore eeamera

eis not clear whether ople talese wich Wiring beemuse of the
peyeho-phyrieal ligation of moving objeols* or because of long
Expose to television, bvt Ui fhet that we do tolerate thie Tore ia
"eclition meane that wa sll be able to reduc the spatial soxpling
‘aie in moving amos ofw llovision picture without degrading pictur
‘quility. We cefer to sampling at reduoed rate clong e ean line (or
‘long 8 veren] Tne} as spaial snbsamgling. Tho unsacple picture
CServenee ere aeplneed Ty in-expalatizg betwen “ho sample! element,

Tt wy objent mower clowhy enocgh, fonpocn! reeln‘ion ean Ue
oesty educed without “mpsiring piesae quabity. A simple method
(t achieving thie fe by “we repeeting in whieh exe now frome ef
Information out of # is teanemittes ani for Fe remaining (e — 1)
fame thie ore fame ia just septate” As would be expected IF the
fubject moves fase eno, the peroived olin i weey ‘erky, Ta
fliemnative, and moze plexi, melhis for redoing amporal resale
tion 1/4 nthe pois axe cerns in each Trame ina dob inane
laced fusion. ‘The type of pelare egeslaion for thew schemes
dies from frame repersing in that when x subject moves, ee edges
become blared and exis celerinand tartare, We refer to sample
ing a given picture element st the reduced frame roto as temporal
subsarpling

By temporally sobsaupling in latonary arees and spatially sub
sampling ia moving srese we should bo nblo to reduoe the channel
epacity: requir tw [wasnt a ssisascory television signal. We
have made « digital television system in which the plete i divided
Into slalionary and moving wre whih ote appropriately exbeempled.
esounion mxonanc 108

“This apparatus, the resulting pitucee and the eaving of required ehane
el capacity aze described below

An outing ecbnmati ie shown So Figure 1. The sean formar is 30
freeten per eee with ¢2:1 interne: Rah fetmo hae 271 Tis, och
fomprising 249 picture clamen(s, Th television igual eouses 38 =
vidison etmera; the video goalie digized to 8, aweuzaey in the
Pulse Cove Nnulation (PCAC) encoder ast slosed in tbe dita
ulimnsonie wire delay Ties of the frame memory. The output of the
frame menory ie eubtrected from tke PCM encoder auton to yield
‘Caen eilfowmns signal for eaeh pinsaze clemert, "These =gnale are
{xcmnined in the soovement ells whaea ong determines ether
‘the caren! slesens [entering che exea) 3 to be rogue as being in
Inosing uv sualionery area, ‘The expat changes from 2 *tationars
Hate? {a = 0} to ¢ "iaoving eave” (y = 1) when moze chan # fre
tiderenee wignuly out of x scyuenre of oe exeoed a threshold. Tuo oupal
vill return ¢o fle satiny sue when all sy samples exhbie asi
‘cant frame diereace sina

“Thu the movement detector cabbie hystarsis redusing the fre-
‘quenay of made changes so that the picture's women ile ree
Lively fos contiguous moving and stationurs aceas

[In secu jugs? to bo warionary, llamato elements in ened line are
sxnpled avaorting to the pati Fg. 2a where the elements tabu-
Iofod A ae tat in one frome aud te elements tabulated 1 nr
snpled in the taxt. The uneusplod elameste retain tia valve of

i. {Seer fo ec ck
‘he previous frome. In the moving arese the same sempling pattom
could be nan, bat we found thay the ptern shown in Fig. 2b gave
4 bellee plume; Use uraumpled elements (marked) ate yen the
rear. vilue of the tro reighboriagslements, Wien she eampling rate
faleng the Tne i rire, se r'y on the Dntring canted Ly the motion
ta baaclimic tho viseo signal. A Tuinelinising filler should #30 be
used on the eutput signel. However, with the eaxplingpatiom of Pg
2b incur intexpotion between the sampled elements gave satisfactory
piturs although aliasing pallens were jst visible when the subject
roved sta certain speed, Further Altering renewed those patterns Dut
feaused blurring whiel we judg to bu more objeto

Birekly penking, frome t-fone sora fone sbuuld be ww? ja
etetionary” aceae hecaute of He recueed kemseral ecampling ate Dut
seh Anes wom tavolve (rams delays a wore fell he patel
“The aforsmentianeleherkeriarl eh sn Im omen of tN
ges in tempora.y eubeempled crea is probably dus co the veeuting
‘lieing. ‘The experiments eatzied ont with thie anparatur and the
reculting pictures are deseribe! in the next tn sections.

Tn a seeond serie of exporineate only every fouréa clement was
samp acd the noling pallens for the stabonary end moving
feng are chow in Pipa, 2o ond 22, Qh'y ash masement or nox
uu buat che vio signal anc eo there cre switched Aare
Ibefoze and after th sbeamp

Some exporinsale were alearondulad with a 4-bit fre difernoe
‘quantized signal, The characteristics of the quaatisar se

INPUT LEVELS
01 26 G1 WAT ISAT BOT ae Sy oh255

OUTPUT LEVELS
4 ee ee ee)
ove ste ewe hy he teen ear Tea sulders

view of @ peteon talking the maven varied From ‘geile (only
hip moverant) ta ‘ory neces! (arm mavenent rd Me petan geting
up ead welsing ay)

‘We viawed the cvelting sivas on a telection enanitor, The
lublanad roster size woe 32 Inekee Yorizon‘a’ hy & Soehos verioal
‘Tae viewing distence was approsimalely 40 Inches ane Ube amb
rsonmrinn nxCRASE 195

ig 2-fyanling pllaus, DOD she fo smn Sas noes em
coro Sate RE en

‘Mhrsioetion ne sbon: che gveage oie Mminetion 0 toot=
excl

‘Fer cach serae ye frst viewed the psnne reeling from the 8c
POM inva at Phe the peoeesoad plane ithe fllaing
cersiniansty temporally subsimplol: coniouey spatially eub-
femp.cd: temporally sohewrple i etatenary amo ne spay eab-
Euipled in ving wrers. Ax © shen re semetiney ‘Pegged rhe aca
jndgod mooving by ho save ise act. Pe sost work the deel
wae adjusted to aniech to esi shearing when four out of eight
Pure elemeate (pels) cearinn? ret hied franeto-frame dierence
i's ecnding a thechold of four foil ui 238 levies Zara ebm
{o dhe era subeatoping code, vores af the eight examined pels
feebices 9 frame citer varvig Hee bscehel

‘or resording ill poeloprophe a modal head wae sang se
penis fk that the bes speed ll Freie, Oa alison
ine tell ak the bostem e: the eine? sem alo, eplayed
ontinuowsy wal photngsephed wit a. expose ice of | cece

"Tie pistnsrs whieh were cereale sewn thy 2 fects of
2) al aver, wore not only exellent for etatomsry seenes Pl vt
Eatinfulirg rnannes wh an ject (ee, = heed) spoed up iw ore pel
fer frame -rrval for ar. object? norma! census. Ae Digests
fc eheckerboned patter alresaly refers Uae covered ly tos?
lwoatue whillo; a oh'ae: speeds of wo pols por Lee dated
above is pusorn wae aunaing foe test scent.

Wasa fe pitune? ware eseGalls eubstpled by « laelor 0° (wn
allover, Vie ‘is ef tention sae jue: witb fur most sores; Ce
Togs we ner obvious wana viewing -ropbict! spate

"When che snp, enn wy ws Lee tanya Tly i alana
nega ie tainly sein arse, 9 oul lees ere
W6 va maa seenese mecremeay souRMaL, sas uaRY 16

sueial'y indistinguisheils for i ely eave pesos, The eves
where the difsscree res visble vonsinctl » cantasty edge soving
‘Sow foxe pel ner cucu interval ot ese); i this ese the wucity
cf the edge messin, Thi aft in erased by eo 'e rovement
“etoction an thar parte ofthe ecign ace ensaczzes til aulwarpe:
fue sometimes terpocelly smbearcpe:. Mo soil eae Tiovement
tection skoold calves this edge break by tac modes onl
‘rh the blurring se tn éeomoral ausearoling ie eotparaie wit
he bhrzing dne to spaticl anbearpling,

‘otco efi! ototegripte ero shonin Fig, 8. Hn Hig. du the whale
secre fp setientcy snd the piohurn ie uy sampled kn Hg. Bb the
Tend is meviag at bows, thnee pecs par feu satura) (eeimercd
ansnay if fale per fees imcerval; the yielure ally
fred end binwing Stzodseed oy sho uuven srt ens be cena
‘bp eorapieon wih Hig da, Hg. Be vows a rqnvaleak sone wih
12:1 exchenge of roeeixin, There de vary ull erence betwoon
this pies and hs fllp asinpled woe U's, Si), Tq BM shaw the
bedght tage indbesting thot pert of the aro: jade! In le moving
shurng one “rar

"Tee reali sng 421 snoamapng wee Loe enon Wiles ove
fall 4:1 tempera schounp ig Coerneey ta the patonn of Fg. 20)
the Blarice and chockerbuanl pailorie were abvectongble even a
ues elowiy anoving ave se uiee's ment ea be wae talkie
The the etaren noang fan 1 apatielaubsazmpling (aeoorcng to
Une peter fr Fig, 2°, the Murr aes again ebjectonabl, espe
‘ally i tala weer.

Tn abe pictures owl: “uw exrhanging rotation aeoonding #0
‘the movement detects, Une Iori edges was enach rove aphanene
fn tho mcremeut Zelvaion sue trey seu coma paca of the back
fruund urvelles scliorery arse wate judged moving, Theee enor
sce boone De digital Ag the lngp gives nee va Stace deren:
Satals wih tay intepected ge movemens by the mover
Turing his offeet keeps the gal Ber smivead in even in eee~
lionesy areas Autn, weve sophiteated suavemen: detertin sboald
ro Ue ffl

"The pote roded as «frome difference quaatired signs) (instead

fli POD wore usually similar #p hoce coded as 8-bit PUM. Te
‘uly ices mre with eoenen cortaining fa moventent (speed of
fone 923 per fume ‘ntorval o= mute) of costrsty abjecie; these
jects appeared somzwbut cuiscr bia i= Ghose setores eaded at
ett-bit POR,
mIOLUTION ExCRAXCE 1

Je 8) Ply wooed tue taviag lon ben, () ly amo
NaS a one Cay

121 Comparison of 21 and 41 Suimompng
Although the simple lshniquas decribed ubove yielded 3

‘heture when ue overall sampling oote waa haved, the

te Louies did ant give © salnfolory pieuare whan the
abe was quartered, Th spewarl eller he hater tee
fique uppers tsetiy the oundenies between areas teated di
nl. Homever, there are mang possiblities using ¢ 4:1 raliy esiaee
198 tam at ereinns wentest soumeAL, aaNUARY 187

Goa that remsin Wo be bls (f) Tee a internet mode in whl
the ota of The how: unsapll elemente is arsigued tha value fom
the previous ‘iam, aad the Sst aon ind are eSegnod the average
value of ice wrighbors, Ths ea size reduction by w fuer
St Ovo in both spatial ane temporal rseolation and ehould result in
Tos se Ionndary ntseen sreus encod! in due difrest modes,
{8 Modily sve sets sempling paterss ws vetica! and bos
tovial nweluiion i mluene agually. Av print te Rorizentl ose ie
tare than the vrtea! Io. (i) Use xa myprosed movement deveetr
‘hin is inoata the Joel zed of movement so that modes sat aot
‘rela! us the Blume ie ilar sa cach mode

2 Corsini uf Swlavonping with Cer Coating Pech

“Mush digital television exmploys coders whieh give either clement
siferncial POM in which the iatercment itfereace along a line
‘iuentibed or Fema difrenting POM in which the difenence betreea
fonsecuve frame i quantized"

Tr the fafornatiea dosenbize wher to switeh snes can be trans
anita during tie blaveing lero, Ur we oeuld vse a Abit fran
ferenoe PCAL sisal eohieed with 2:1 wesaluten exebunge for
‘monding tecvision igual. In ous eeu fora, aleh zosembiee sha:
fnvisaged [or Pickin servi, fie MOU require « chanel
oapacky of feur wogubiie per steunl, We have mecsured the nom
ber of spode cbnvgre go? Hae for x namie o: dierent comes end
find kas ib wae magsly som than ale. TE we ose a €bit word #0
desenbe vac rece ehange, Cher Ue Une tequied for trarsmtticg
the inform “en easly shore than six welosecomds, ‘This is cox
vlerably Tee thea the Ine Wuaking teres) of 10 ralerosceoads for
Sur egene enum form, Bush ater, akeugs coquiring a "ume

nono, ie eeewinly bullee a a terore, shirt Toxetoranfees ta
buf: tho abuwe inode ewiteing Salar. tin. Ayalyia spin ext
sampling teenies 19 erment difreabal PCM !3 not slzazhtfo:-
fran sseauee wh we belve the horixevtal sampling troqieney >
no longer i atch neat neighhore or yowliedng the vasa ef am
inpeomii clark ana therelare qusolismg role ieceases, Te pose
fsbo alcrmaives are

Ure verionly adjnceut clesicats for preisting tue, upcoming

cement. Hecture of inerae> such clement azo terrporally
Gispnced by one Feld tino from the corer Ting wed may be
Uumatststony for predicting val in Oho wirrent ig in moving
esoivino excuse i)

rcos. This problam would aot avize with a soquenit, son
intenaoed, soe formas.

(G8) Raduoe only vertoal refution by sampling lterante fines in
teach eld Buch m process may jvm ie nan unplessont rolling
etter inthe picture

We describe expeinents jn which sseoltion exchange i applied to
tn element difeensia) POM signal in » fortheaming publication

"A third for of coding which is being considered is eowlitinnal plex

tue element repleniiment? in whieh ly the nigral carzespending to
he moving pact of the pie i raid, Bich a apstem roqaires
f Tange Infor elore whith can Deanne erlondel whe Ube phate
fontain lage nee of sid mrversent, Tho we of spain’ aubaarmp ing,
either 2:1 or 4:1, in suck moving revs is oa way oF reducing ur pre=
veutig buller overfow.* If we exe tims for a bit mito of orz-bit
$e phar elemort oe seme we eon simrlta the worst posi case
Dy spatially suharpling hy 427 ths whole piture ened ne doit
‘ame efferan‘iel POM. The rerlling piture hes sau bee Coan
‘ho picture “zarup wees aceara ken a lies overloads * and, henea,
‘hin mode can be used whenever the buffer apprentice ove" Tow,

‘We would like o wekcnowledge tae reap simulating ditnesione with
Ad. Sosler of the Resour Enbocatorce of the Acatelian Post OMe
tnd With J.C. Candy, B.C. se ane JW, onnts,

rele fe Hedase, Cha

© Senta roe eh fa Eo GNC AE eeher a

Belgian, Reamerien of Telriss nee”

Boh HAE ge Nos 7 Gesinater Tah ype ages Ot Tees
seh iy Sei ty Pen Con ut EEE ee Fy yap
fe Bilge Huadply Comptes don en neat ®

sig, Brake Me Ay tel, Ha Moti FW, oh le
200 am MED aYOFERE SROMSTOAE JOURNAL, SANTCARE OTL

10. Mont FWA Wit, Enetng Senn Ting Cengage Ee
Sina Rapietaet Waly Nox eqtamber

uu, Maley PRC Re eat al Naaman Ber Deb te eluety
‘Dak Gonpreme SLL nee Comm Tec, CONC, Na Gey