ERIC EJ924075: Selecting and Using Computer-Based Language Tests (CBLTs) to Assess Language Proficiency: Guidelines for Educators

2004·0.79 MB·English

by  ERIC

and Using Commuse-Bas
Languase Tests (CEL) fo A
language Proficiency: Culdel:nes for

IPE he growing
nese cad foro gh

ith rapes

Boca! ie oes

cbse ka

pe pvsdiae sa ele
emacs, Cnaiy. ie pat “CLS

Peteigoumtetion de ba Anata

asl lange tse BENE Sets

pw er kw ig 8
qusaldTevselgnverentaypronieg

Bago tna nea

a ds aagog es nap Seal ie tenes age

in doer a eres “Saragesent Use
Sou decsntins ont
feo. Le fs
opie es ete,

inteaduction
inion Avatience

“This sot of erieta snd accensnweut piven ie inland be serve as a
[ulteline for east seoeing a sparseviale corspetcbaved emai
foot (CHILL) to anzessanguawe profceney a ne sassecit. Alto gil
eveually aadversties and colieges ‘hol have te Fane In intial eva he
resouons timp emant langeage labs ar rullinedis coters, thes dose net
august hal He gions pavedied une wxclastee CELT decision-making,
Dy portcondary edveatora Eft hiv sat of pide Saeg mae be «sell
Jmalemwriet ty clucatoas al any kevel wud for many types uf asesment

purposes ue a ahivernent ar place

Ration
2stechrologs imareer.ccucatorsene eeveasingly lncuinglCBLisen fat,
Isable, an mere acura seedeuces UF shun leamiang, eB
salvxtoges bu ceving,saptiton to student aby,
asad or tem response theory and expert agalam mode's ane! yeaa se
‘rolivalion {Lindhiad, V8; Zara, 1995, hd SSL: Meal. 2
dre prowing Gcmund fur and rat of CULES comes te need arc re
‘gaclinet to relp ecucatens ce they lamp! ln cell 30 appreptbite et Sor
sal secend-language toxca ngeleaning corpentr (Chapelle,
ap) Thal Ths aes ingen so teen adequsts met heeame clear diving,
four oven exper aes concreting reviers ol nen prised ara silly ase
ized language leas, He Compuler aa LUBEL-CL {21 Mar
iL 2091) aed he Levels of Lntinh #raliierey-t4><P (Nisley, 2098,
“chile cancucring these cestews, we
ine Fk, wrath was compere by one one retain
CL evalua, Bish nr eombined conepten a
wit ach dieu, hogs ach de: one te
average evento wll alieaxaoeioace Se Blt Cue goal fe te alae:
Jing CBLT gudeliews and proveczes & twoiold: we would Uke te gave
ceduearois appeapriace ere nailt whi Ia.aiege 8 paclcular UBLE, cd
‘weld like in si Theo tina Fey dt

ieee

‘Dunkel, 199; “eles, N08, ee sented fae relevant cern lo osx
In CRIT avainaton scone helo and categorie thera nlsta eens
oF iogvee. Our objective i fo help edacatace ela ude sien sw kes

nd determine hovr ley adaivens the assem oe prven CHI, Nee
apply the criteria ita “CRU Saletin and Ts Gaiden

The Iabie consists of quaations i ate ands axcompanyag checiin. Poe
unatinns ames ag 9 issue oF pruning elie, 4 we sleve-culace
‘duct consis of ys nn ana sew, Wor tras tha hie

in na were mace tn rake the Geciion fe Bre educa:nt, Baran serge
ceillhave diferent uses ana circumatanees whe frst appreacaing aC

tweed ne fnpractica to suggest bat y prsdeterutnas emis els
the ye columa auiaratically patios Ho use views

* ete HPL AIMEE ALE
_Acupluble Thad, the purpose ol thw aecdistia ss help educators naar
Then sleseah aad Bape Wash sf Dae fiense they ness) rene slave
faking thei final escinon, hor extort, wae the suse: Ao 4 partic
asa io, alucelors ate assed Le-aop ane celernine hae important
tw: parte cater is to tein assocomen! purposes. A case fn pain!
seet ne a lovescles CDi, which may not reel tke lea doselop
met uk! poking Inala igh-siler ne eon requir, ls tesiluatcn, a9
ance NY Reape gna estan ep loing wad rol Aeressaiy 3
problem, Clasnly educator ci fo Tin all hal ny see testing bt
they go through she chosklist besa Buse assent ponds wl skeet aie
ns (9 Ihe queationa. It is ur bape, noveeser, that che cries ee
roeide will gute hem us qu.chy ane afi ial’y as pera

pros

Divenssicr

Disensson of Assesment Coiteria
Sesessment cur can he wouees i
Aenea, Sooring lessen, Design eres

o Bye este grits Hae Anevscseat
ricisative ses. and lice

nse Ghardseote ahd Covovane. Relevant criteria inconcder ne Fe
Taisanencne ints
The yoga of Se aon, Boe cap, a8 Ase Kea Chai a Fea

tion stat Shat CSIs eam be wad for a wide varisty of gungeaes, each
pasar sereel by aaperiie CBLT whose “eal int ien mig ba rs
Praline, ue orent empleo ethene, TBO). At Pw seams, is
Inaportant toensnne bese heron fatiosk el eager sane acl
tn be anensed According to Grea etal. (196). ei gnilcant tha. ETc
rowhteadequalaassesnmen’ ler hee tive ange elias nea Ia eh
ruprestnd ay oe mala,

Senki. Nelibiity moles fo fie possi gad cenabstarcy of scones
sfesivad from he Slizs, Facts thet atiect relay ave gee llnaio el
ans ingivisual unt, 59,

Valiiy. Waligite varwoona 14m dagen ty waar Cue CBLE seals
auicurcs iba It purpose fe avoasre, Its uften divaded imo Biater
comic, ciara, annum, rd comeegnertin,valcity {Dune 1
As will any seoolonguige aeseesaerl ieleument vagy eof anes
are (Wachman. 02% Comming. Vk. tlawever, nett aecsst
min Ul eae conelerii, Ubete sb: have an wadesstanling
bof the inierzices male feom wears on computer nt Web-based ar -pe

‘awe end snioeenting of pubic pennies ths mpoutacr sat
there be asetve te pebinned spsctection ‘ables im order ta awe + le
sanding ol las scores, the eene, “aru a" Ibo be -y warsert ae tepe of

besarte
loaguage tae. as el] 23 dhe maslery lower sce sith vecteapansling, oot
penis (xml, F9),

Scryers
‘Te pytionit adel wed, Ldacakor shot d wneud the mssuraptines
teulerlsing the prychometie model Pom Seszaae Uncen ant others.
jk the corseraction of Ihe CBT. Suck waderstansing helps ical “9
elec he ea hal hes hy lft wih the parpors ol I asecucet ad the
vwsneries arable ferteallng.
metals Depending cn Ure paspore of the CHET and the type of
et rt lgbedstespretal ftom the feoven, severlsuuting euetsi2s cb
Tnckie aw arora (a suns of the saraperat corse ets
devin! ay scores Gin eh, rome ders hun, ance tem other"), tee
see STORFT,wehihis aed acres fares} oP Fa oe
quer ast a arch ino IY,

Tea no, Ca CEL ths esue ean be proba for aval reso

sonra, est Pansat ich emu,
tn Ter puuialun cg res: lebanese
dod ensuing Ie sary fy emierion patlens cl he linked 3 lane
gllege po nny as meson ue auch a bs: a weld boca ea

secret vr own, 54?

Cut pets atareza catty Sew tewunes ate pronnsed lo delenesine
cu paints asian cde sctfing, and each perlirisanee ie pusprne doped
fing onthe objective ofthe CBLT. roms inc ele the sequel postablty
abo teal (SPRT) lar encking pase Cecio ih adaptive wher rela
Neale not fre Kayesian decision they Rory
Gexscimes cea cemnpuiecized sald mtory wet ree

rr bang itm sorta al sexputdent perfarmaey a wre tetera be
famsisien eit potfoynacice un another ee, Pisin test i aejelly
invprvian in conipuc adegtive lees heconse ae tare amie very
Hine (Reon, 19874, Consistency san beaded remgh lel lon ects. Phe
fistage and calegaiza in oftatitema in? CBUTear 9d dimaneon
amal Lal syst, for axonal thi important inthe urn of ost
sf hatcan be cron rons, 1982),
Secon'y, Civon We retire of 9 CHT, apcia! atten ma be pi to

it ng of He wom Theae les use tobe apart
ate fo tha sinsat th kat WEE adaptive lass she wonrpaier progam lec
leat lms zee tober the teatiaker hasoge an te pravions etfs
Firosblogth eam Bawe a pasdelerminud neater of lems, elencis open
fasts will have as many items as une csded ta cltereine le profi awe
shetenbiaker Liowaver there isa gas ine im epes steward stasous
who wal up wits chon nat vensons, Acrorting iy bop. 158%) His ae
ncaa ta he iaestiyaie more ite, Self pcg ste ale the tela
le wrork a fae cum pace, whores ned isla pe tater eso ead
OF tame da fish, Dover (1993) stggests tht Bie “speed a sem uatee me
sporos can arally bo mel a8 al

ane, gins ud pantod” 29

mal induration in sessing pe

fet. the paysical ur psy
135, Dum, $95),
Stile facors, Tas mofese othe mespordant’s expernce, either wath
simciarsemptertaeat ‘angunge teste famine wi comtputm a gel
‘aul. Cohen (1998; reports slidy shurning the! CREA eeaule art uxloed
inttweced fw past expanse. Bros (87. pny s Lo stay shay wih
pion eal TOLL tes, bat sy refers coal i tet indica tether
sunlevs pura ina eartc-baved is iy lexi tet se sear
Int relationship serares compater lamilgelty sind Sediileds: LORE

al Inlth oF the ses promis

ie, Feetmolngrall acwsstas in duction has “twat
pt Teamers wha a aw? caaketahle wth: sig romputers ave ee
perv fa rat Miexe. Iie cage, wy mo om 8 Rule being se
Towed fo eorputers, hut of boing velielont te er ave of aking te
feo pusersnviety vr chm

Jeanie site. AN tess, wcwrher tad Tena ve vompete ce. used
ln ioke fay eunsidoraton ang special needs stucantraey have Computers
‘nse laguoge els muy have some evra charges.

sna ea of ee. Ina COLT, layout aad proventaliac cm sr2ke all Exe

ditemen nos ty me unclear on maotee ate eee

Taagiteremeaete atstoe Aeguising asa vomgrtar equipaut extn
bia. as ov bavlogy adeancr, eexiemem cat when bacome sui

sadatel Those 2 vo pole! in icing 4 le! thet bas “arcane see
iat te tage! tbactional Srila cannot oq

jncator need ts Ahink shout i ether Pray shave

thal inca

1 problees, era sa festa,

Deng sysiers, Rraelars icerested in sun CSL $ than take into ar
ration the seivery systern a Aho tok An utslnon #42 very oyster
ule atad-2 an {9 syst in which epee stew ie last hres da
and prowides ira videal rests indspendenay al hy oles netarse

an 7 Soma
systqe that ia reste, teres date ed proisin sealls Ion 9 eval ance
fed Webster (a ayales: teat accasied,stors
Ha etter

lev flowy intajone au Alpin, “hin raters to the dees of ens
siwplicey, and comfort th oehieh The tees able ivan ith
CRIT Fev the axerinces, shi duzactrustic u! dv CRLT ean influeece
bility Fort f9 0 1 Yin the mise eanefortsbe manner poh,
shuns lsseniny exauss gyal porlive
friable est ese ufthe
ote etinval and anaiysia

‘syed, Educa shor be awace of essential anc! acelablesugavrt
vceded fosmnsiee elicit ae and proper mamterance of the CBLi. made
‘quately sapporred ancl sintsinesaltssae wil quickly negate aay pasate
Atibotee of He CLLT, kink fa ca sf emgalivly infu the CET
reputation

st iaeenanrg‘be pal

Condusion

th gees cena a bis tile ac ol sab Fe (aL abe iL
quidkls become cud a! c1s ae new lechaologicl aev2nves move the har
highar in tran of vl Klas of wes, cae be doen es, ed ele,
“This dnwe net mana our alterapla bo team guidelines bave basen Zak,
leskeed, nalts case the elerie ae prooasunes prestaled here 4
usefl statang pant Pee fasmg Ge rainstorms hemp slag, se aelogr
that BCLs have the poteatin f9 todas Iden of ssarstrvent whe
heiping us t esp our eves on Cx main geal: valid and volo testing of
‘auGenl‘ang.oge compolenoe und prefisimey. We developed “aie se: ol
ipovmli vet tn show the nee thal Dea ia Se considered wen cope 4
ERT bat we vetoentelye that our chet ee nat yor hoor pl SHE
is ear nope that ens asssarment ih a oct gothare Se ween to Use
‘forint the main ipaas ene quantous io cetlec on when ceoorng 9 CULT,
TBA mans aenaioad lang (eompularssaplee aki lela ays
terns). CULis canine ured to prummate uta and mums Hectic 9
range of ail, knowledge, and vndestanding, Uelece this happen, sone
‘eh 12/ FF aucaoon wil ned ie deena anne ie Hae

fend hon bust konep ra! faounation CBU aacosment
‘amnately, a we a

inthe Held ol

met! Hern
thoes Unfor
learned frum Cvs projec there's ta Jog way to go
7 assersnans, suc! anang of he Raut hae yo bo ee

® et oh CANE
CIT Selection arsi Use: Guide’nen Summary Pebir:
Rosie Ascesonirit tse
Ceatostonet dene
Thess the COLT leaker pore othe eae
‘perused 5y trodes
2s heCBIT creaprad yack away a 0 peor
slagnarsaxenensn 20 he we ager in
rom lwo pe, says rth eae
poplin ean 2h eae tg ly sth
ern in ts pool coves vr isle heig
inves ae al avevsuiry ot Fong fake

A Gene
Tet Doce ta CBLT he pur sep otha
icin?

{85 Hea Levan eseahigwyninterptag2

4. Siualione. Ts the ste gerremmenten aban
Selita tothe scons malt tes hae

(Cig tresiced se hax posible? ee
Aaiinisriveun

f_Bhsrmarsh some iol dtanntsprvisas
Ine oke deeper aos eigenen rte ee

( Sameot msi: doen mo CLT asegeaiy sve pi
Unseenmarten he set ate

Casa vatine Shue CLT sakes pit
seowsscinevones out Ui emerge meg

‘oer wake woes tht onvress

pevtrrnonccor ypc tof eerie ke

BLE water mee peteenre nthe

{Ei Camerrman vsti Is ee eve that om eee!
fovtattance os dheCBL: poraiele ra on lhe:
ire

fe Comets vik Are hase pi
fernaguenest tne ALT? Nera inet cone dee
Srotse ahi ol the wanirenon sated? Arle
al obs ego ies a ned feb pale
art sariern ste Yue rst ee
iuussof te laity atl

7. Dnscureallspub'sbe reiteation able
ecempeay Cre HE?

-s.cxeumn cameuncryr rt aucsinDs,
Sonning boues
‘Grins oat ee Me tess
PP ednesrk beeen he pater ands!
fran hw CELT an se eanitel bea ante?
a owathsCBi sed?
A. ctcsurmplesaplenatininoseeer np esoning
chats nasrierhrics teres eer sori 30
(oanure cas animate ie abe?
4. Abe itt naieen pened?
1 bee laa arocecie fr dary lh CRT tem
(rise gy Sor mes haere eb
arsclorincecel?
calimsiioe of the iene Fai Sto0'l fellow consusotod?
2. Dues thectt plat meta help win cen: ale,
Salinegaato tee Bhi!

Design snes
qucmencar ot Yee Na Umine

(Anthems approgranso thea? fe fon
rescingsorprtensn ete engrsot terrae
Povagesereprsbinand tate pve ke ans
ntl strode demeanisets%

(6 otberean cays rage olenke, ai see ot

2 Memerpmare

{8 Galante: Patten pation vou peort

fc) Mas tts est a ec?

(Bi. ack is Rereeridercenndapuanssser
‘ee and Romche ng?

Teirwrn ser

‘Sas Dn eam iter on thay he shy

egal cand ehatye a ae?

{Mv ge she appenpeae te De ego?

Arsene enn ple ayer an|ocrprtit
luvkrestem eas aad ob aftigthn aed?

Amer plein he cee (a thea the
thnoree“e HIGULD have ave?

2. Weegee Ls theater sie acute

A. Adapdve ep: thea eneppaarias oping ule?

2% et veo 2M rel
8. Page perso tein het tas son

Wo BA stowdogt ote

UW. Team apart
1 fewlpeaing?

Autminisbrauve lose

Breen and

2 Datel | aeminisnstien pose pride
Aururehaviriee ond bat ee Bacto
cert patton 18 aan een
lire eigen per, permanente at ese
orlea?|

2% ess the CULT equi speci’ rrp ape?

3 Mit etidenteoaho tee amaatne tras ng
Eornputns hovew Five aecprge OF oe

4. be dic fie oto st ne nae 9
Tm arse hen geustersed (Demat dae Bt?

5. hth sites th iy ere
snatcaions i meade

4 Teese CHEF legacy cig 2 eons ne
Chirac, berks anh ne the saline
sored?

% Vise de etndnttlon punuan peony
saleste¢ enh estar he or ence
foes seen nae hone compute arly
Ie epindty ther by prance language sh
seems enmpoter seen au3poil aldo?

A. Iuthow an eqeeaien pes-acd-sogerbartip cam
sresle?

8 Canapesinsedh vem inde, sigatetalenged
Edt kets Cel turgor
felsiatelardvare ondiethsnfomaan ast
fringed?

1. Dues thet. magus aatmnesuse of

boi il
Dy Aewapeter mens?
{e) Alig mditmyiech benscen acne

11. yes is ths appcepiet sors

12. he ee CHL sean elegy wide

lis guna o.amsmmucrea. sci
al suse (Handwerel
ae Ye fe Maser

Apel empties: Ateaadnce el ple

replarsene tly bene?

2, Smaps racing lca sty ole
Tlitncnsndcsingoan ils, crops son
pecan sok?

3 aypmorinieprfgheats HE Linea ars
InenIpae? he phones? Arey oll?

4. Gllerea DOG ee pet eon?

‘S teihereapenand-papertaccupt

6. Iethaimang penn rn ae

tecloten! issues {Softtonre!
Grezinatt Yo
1. eeL2 CPTasandalece?
1B toe 2 DT natwerk?
12 a COT Webiven?
eran conprunace basen the haces aa
fan lushdveny nye v attire’ CATT
a. Those Teafacass rs
gobi an fev ad
8. Temithive sonst opm ov?
5. esshocofssare sont rss ee same?
5 ees irhave seagate student catcall
3. Dreinaless rend ering dae

dy ira,

cysiesad

ML. uthvontwansermneamd asset oP
TL fetheCab Toone acaqestly enticed ety
isn sete spn. any aed eo?

Note

SOLARIS Sree TNS esc ae ems

ve lerarpoln, AREA SALA