1、英語測驗命題：概念、原則與分析,中正大學外文系陳玉美,中正程玉美,2009/02/25,大綱,測驗評量的基本概念測驗命題原則與範例試題分析分數解釋演練及討論,中正程玉美,2009/02/25,疑難問題,_1.Im taking acting (1) class (2) classes to be more confident on stage._2.Nelly was kicked out of (1) dance class (2) the dance class (3) dance classes because she never practiced._3.I have (1) math
2、 and Chinese (2) math and Chinese classes this morning._4.May goes to (1) math class (2) a math class (3) math classes (4) class on Mondays._5.In (1) geography class (2) the geography class, we learned capitals of all countries._6.(1)The Chinese (2) Chinese people (3) Chinese believe red is a lucky
3、color._7.He (1) has been dead (2) has died since last night._8.Pour (1) two thirds (2) two-thirds (3) two-third cup of water in the mixture._9.The music makes me (1) happy (2) feel happy._10.(1)With (2) Because of Dr. Lis help, I got well soon.,中正程玉美,2009/02/25,網路資源,ESL Help D National Corpushttp:/w
4、ww.natcorp.ox.ac.uk/Google Searchhttp:/.tw/webhp?sourceid=navclient&hl=zh-TW&ie=UTF,中正程玉美,2009/02/25,基本概念,考試(Test): 指的是測量一個人在某一特定領域的知識或能力之工具。 測驗(Testing):強調過程包括測驗的編製、施測、測驗分數解釋等。,中正程玉美,2009/02/25,基本概念,評量(Assessment):意義與測驗大同小異;只是評量對蒐集的資料進行價值判斷(evaluation)，測驗比較強調客觀的蒐集與分析資料。,中正程玉美,2009/02/25,基本概念,回沖效應 (
5、Backwash) 課堂測驗 (Class Progress Test)效標參照測驗 (Criterion-referenced Test)常模參照測驗 (Norm-referenced Test),中正程玉美,2009/02/25,要素,效度(Validity):表面效度、內容效度、建構效度 (測驗是否正確)信度(Reliability):測驗內部一致性、評分一致性(測驗是否精準)適用可行性(Practicability):經費、時間、施測行政、評分,中正程玉美,2009/02/25,確定效度的方法,利用雙向細目表諮詢專家、同仁施行預測尋求反饋參考文獻,中正程玉美,2009/02/25,確定
6、信度的方法,測驗信度(統計概念)重測(同樣測驗不同時間重複施測兩次)複本信度(題目不同但內容相似)折半信度(奇偶數試題得分相關)KR20, KR21, Cronbach 評分者信度積差相關、等級相關,中正程玉美,2009/02/25,命題流程,決定評量目標及內容(參閱課程綱要及教材)設計比較變化試題方式設計雙向細目表編制測驗題目及草稿 校正、修訂、確定測驗題目 使用命題檢核表最後檢查試題是否符合命題原則與格式規定,中正程玉美,2009/02/25,題型種類,閱讀寫作聽力口說,中正程玉美,2009/02/25,命題原則-詞彙與慣用語,命題所用之詞以國中高中常用之字詞為原則所測詞彙的詞類應適當的分
7、配(3-3-2-2或4-3-2-1)題幹的上下文意明確，提供充分的解題線索題幹長度適中(以15-20字或不超過一行為原則)正答與其它選項之長短及難易度接近(詞類、音節數、拼字)選項應具有適度的誘答力,中正程玉美,2009/02/25,命題原則-詞彙,詞彙種類：active (speaking and writing) and passive (listening and reading)參考詞彙表大考中心公佈之高中英文參考詞彙表教育部公佈之九年一貫英語課程常用2000個字詞表(畫底線者為基本1200個字彙 )課本重點單字,中正程玉美,2009/02/25,命題原則-詞彙,定義詞彙範圍大學學測詞
8、彙範圍約4000-5000個高中常用詞彙詞類有適當比例，共有10題，名詞3個、動詞3個、形容詞2個、副詞2個 (或是4321)大考中心高中英文參考詞彙表六級難度標準(每級1,080個詞彙)：第二級3個、第三級3個、第四級4個。(第五及六級適合指定科目考試使用。),中正程玉美,2009/02/25,命題原則-詞彙,題幹必須語意明確，並提供充份的解題線索題幹提供線索的方法 定義或同義詞 常識 推理或聯想 提供因果關係 主題、評論關係,中正程玉美,2009/02/25,命題原則-詞彙,題幹長度儘量在一行或20字以內選項音節數及難易度接近 選項詞類相同 誘答之誘答力平均,中正程玉美,2009/02/2
9、5,詞彙題範例,After the heavy rain, many parts of the city were _. A. flooded B. washed C. drowned D. wateredAt last the climbers reached the s_ of the mountain.We could see the place _ she had the accident.A. which B. where C. whether D. what We s_ for many places but could not find traces of our dog.,A.
10、 flooded,summit,C. where,考文法?考詞彙?連接詞不是實詞,searched,sought,既考單字又考文法過去式沒有提供字尾可能不只一個答案,中正程玉美,2009/02/25,詞彙題範例,She is very f_e from sickness.He has been very feeble since his illness.A. unwell B. thin C. foolish D. weakThe old woman was too _ to push open the heavy door.A. feeble B. sincere C. deaf D. ha
11、rsh,feeble,拼寫運用詞彙,辨讀選用同義詞彙,辨讀運用適當詞彙,第一題最節省版面、比較容易命題第二題直接呈現詞彙的語境第三題答題可能較費時,中正程玉美,2009/02/25,詞彙題範例,A. completely B. heavily C. ably D. politely E. deliberately F. busily G. hastily H. carefully I. quickly J. hardly K. angrily L. suitably Write (1)_, the teacher shouted (2)_, but dont waste time. You m
12、ust get used to working (3)_. Please, sir, a student said (4)_, Ive finished. No, you havent, answered the teacher. You havent (5)_ finished until youve ruled a line at the end. Meanwhile, the boy sitting next to him was(6) _ engaged in drawing a map.,單項詞彙選擇題命題不容易；詞彙取樣有限；學生可能以消去法答對、也可能僅知道評量字詞的其他意義，而
13、不是評量針對的意義；字彙命題漸漸朝向提供篇章語境,中正程玉美,2009/02/25,詞彙題範例 -篇章導向,In a 1democratic society suspected persons are presumed innocent until proven guilty. The 2establishment of guilt is often a difficult task. One consideration is whether or not there remains a 3reasonable doubt that the suspected persons committe
14、d the acts in questions. Another consideration is whether or not the acts were committed 4deliberately.4. A. both B. noticeably C. intentionally D. absolutely,提供篇章語境評量字彙能力,中正程玉美,2009/02/25,命題原則克漏字,包含綜合測驗及文意選填主要在測驗考生對選文之文意、句構及章法的全面了解，即實詞、虛詞、慣用語及轉折詞等在篇章結構中的用法選文應多元，涵蓋不同之主題及題材,中正程玉美,2009/02/25,命題原則克漏字,內
15、容符合學生的生活體驗及認知能力 內容具教育性、知識性及趣味性語言難易適中題目數配合長度，約15-20字1題 上下文提供充分的解題線索避免以首尾句命題,中正程玉美,2009/02/25,命題原則克漏字,測試的內容項目：章法、詞彙、語意、語法要平均分配選項避免拼字、用詞或文法錯誤以及爭議性誘答 選項詞類一致，避免根據文法常識即可作答 誘答之誘答力要平均,中正程玉美,2009/02/25,克漏字題組範例,Hundreds of scientists around the world are researching how birds learn to speak. They (1) that mos
16、t birds learn new sound when they are young. The learning time for (2) sparrows is the first two-and-a-half months after they are hatched. Newly hatched birds are quiet, (3) they hear a rich variety of sounds from the adult birds around them. Soon they start to practice those songs at once, (4) thei
17、r songs crystallize and are set in their memory for life. If the birds make a “mistake” (5) , they might start a new dialect. (about 100 words),中正程玉美,2009/02/25,克漏字題組範例,1. (A) found (B) have found (C) are finding (D) had found2. (A) whitely-crowned (B) crowned whitely (C) white-crowned (D) crowned w
18、hite3. (A) therefore (B) and (C) however (D) but4. (A) when (B) since (C) until (D) before5. (A) while practicing (B) upon practicing (C) for practice (D) without practice,中正程玉美,2009/02/25,Yesterday while my family were watching TV, we felt the house 43 . It was a quake. All of us 44 , and Daddy tol
19、d us to 45 the house. When it finally stopped, we came back to the house and 46 the TV. We were so sad to learn that hundreds of people 47 . It was a terrible experience.,43. (A) shaked (B) shook (C) shaken (D) shaking44. (A) are scared (B) were scared (C) scared (D) scaring45. (A) run out of (B) ra
20、n out of (C) running out (D) run out46. (A) turn on (B) turned off (C) turned on (D) turn off47. (A) hurts (B) were hurt (C) get hurt (D) got hurted,選項錯誤,選項錯誤,沒有正答, was shaking?,選文60-70字，但是題組卻有5題,克漏字題組範例,中正程玉美,2009/02/25,(1) the food “bagel”? In fact, a bagel is becoming more and more popular now. P
21、eople can buy it at the snack bars, fast-food restaurants, and even Starbucks. But do you know its story? The earliest story about bagels (2) in 1610. It says women could get bagels when they had a baby.,1. (A) Are you eating (B) Are you eaten (C) Have you ever eaten (D) Have you ever eat2. (A) was
22、written (B) wrote (C) is writing (D) has written,選文第一句開頭就是題目，不恰當,選文約60字，但是題組只有2題,克漏字題組範例,中正程玉美,2009/02/25,命題原則閱讀測驗,選文應多元，涵蓋不同之主題及題材選文內容及語言難易適中選文內容符合學生的生活體驗及認知能力選文應具教育性、知識性及趣味性問題數目配合選文長度，約60字一題,中正程玉美,2009/02/25,命題原則閱讀測驗,避免學生不用閱讀即可作答 評量學生對選文的理解、引申及推理能力兼顧整體（global）理解及(local)理解避免使用與選文完全相同之字詞及句型平均涵蓋選文的重要
23、內容各選項之長短及難易度相當各選項具有適度的誘答力,中正程玉美,2009/02/25,閱讀測驗範例,One day Nasreddin borrowed a big pot from his neighbor Ali. The next day he returned the pot with a small pot inside. “Thats not mine,” said Ali. “Yes, it is,” said Nasreddin. “While your pot was staying with me, it had a baby.”One week later Nasredd
24、in asked Ali to lend him the pot again. Ali gladly agreed and waited to see if Nasreddin would again give him back two pots. One week passed. Then another. In the end, Ali lost patience and went to demand his pot. “Im sorry, your pot has died,” said Nasreddin. “Died!” said Ali. “How can a pot die?”
25、“Well, you believed me when I told you that your pot had a baby, didnt you?” (89SAET) (140 words),中正程玉美,2009/02/25,閱讀測驗範例,41-43題組，篇章文類屬敘事，其實不難理解，但43題鑑別度偏低(P=.33, D= .17, Ph= .44, Pl=.27)(41題D= .58，42題D= .53)，試題題意容易誤導，建議修改。43. It can be inferred that Ali had _ at the end of the story. (A) neither of
26、the pots (B) the big pot (C) the small pot (D) both pots,43. It can be inferred that Ali (A) got both pots (B) lost the big pot C) lost both pots (D) got the big pot,中正程玉美,2009/02/25,試題分析指標,試題難度(答對率)試題鑑別度試題誘答力,中正程玉美,2009/02/25,測驗難度,試題難度指數(答對率，P值)：即所有參加考試者答對試題的比率，難度指數= 答對人數 / 受測總人數 難度指數(P值)範圍個別試題：0.3
27、0.7。 整體試題：平均0.5左右,中正程玉美,2009/02/25,試題鑑別度,試題鑑別度指數(D值)：即試題分辨參加考試者能力高低的程度，鑑別度指數 = 高分組答對率減去低分組答對率試題鑑別指數(D值)的評鑑標準(Ebel, 1979)0.40 以上 極佳的試題 0.30-0.39 尚可的試題，可能需要稍加改進 0.20-0.29 不佳的試題，必須加以改進0.19 以下 極差的試題，應修改或刪除,中正程玉美,2009/02/25,試題誘答力,誘答力評鑑原則： 至少有一位以上低分組受試者選擇任何一個不正確選項。選擇不正確選項的低分組受試者應比高分組多。,中正程玉美,2009/02/25,試題
28、分析,試題分析解釋步驟如下:先看試題鑑別指數及難易度指數。如果一題試題難易度指數高，即多數人答對此題，試題鑑別度指數可能不高，無法鑑別能力高低，但是一份試卷也需要兩三題這樣的題目，讓能力差的學生不至於成績掛零，所以這樣的試題可考慮安置於試卷的最前面。再看高分組及低分組選答情形及選項是否恰當。如果選項誘答錯誤，即引誘高分組的學生選答，宜考慮修改試題選項。有些選項無人選答也應該修改。,中正程玉美,2009/02/25,分數相關名詞,平均數(Mean) 中位數(Median)眾數(Mode)全距(Range)標準差(Standard Deviation),中正程玉美,2009/02/25,分數相關名
29、詞,原始分數 (Raw Score)標準分數 (Standardized Score)百分等級 (Percentile Rank) z score T score,中正程玉美,2009/02/25,常態分配,常態曲線所有常態曲線都有相同的外型具有對稱、單峰及鐘形的特性。常態曲線所代表的分配即為常態分配(normal distribution)每一常態分配都有其平均值M (mean)與標準差SD(standard deviaton) 。,中正程玉美,2009/02/25,常態曲線SD較小,Mean,SD,中正程玉美,2009/02/25,常態曲線SD較大,Mean,SD,中正程玉美,2009/0
30、2/25,常態分配的68-95-99.7規則,常態分配有其特定的資料分佈規則：平均值為M (mean) , 標準差為 SD(standard deviaton)的常態分配68%的觀察資料落在M 的1SD 之內95%的觀察資料落在M 的2SD之內99.7%的觀察資料落在M 的3SD之內,中正程玉美,2009/02/25,68%-95%-99.7%分布圖,0,1,2,3,-1,-2,-3,M,M+1SD,M+2SD,M+3SD,M-1SD,M02SD,M-3SD,68% 的資料,95% 的資料,99.7% 的資料,常態分配的68-95-99.7規則,中正程玉美,2009/02/25,分組試題分析演
31、練及討論,以試題難易度、鑑別度、誘答力分析5個試題。 試題分析解釋， 請參考網路教材中之範例。請根據下列題項提供之難易度及鑑別度、高分低分選答人數，分析各試題。,中正程玉美,2009/02/25,演練與討論,If I were rich, I _ work. (A) shant (B) wont (C) wouldnt (D) didnt. 正答為(C)答對率（難度）.45鑑別度.5高分選答人數低分選答人數1 4 2 5 14 43 7,中正程玉美,2009/02/25,演練與討論,Mr. Watson wants to meet a friend in Singapore this year
32、. He _ him for ten years. (A) knew (B) had known (C) knows (D) has known. 正答為(D) 答對率（難度）.325 鑑別度.15 高分選答人數低分選答人數 7 3 4 3 1 9 8 5,中正程玉美,2009/02/25,演練與討論,We bought our plane tickets at a travel _, not a counter. (A) salesman (B) dealer (C) tourist (D) agency. 正答為(D) 答對率（難度）.625 鑑別度.05 高分選答人數低分選答人數 0 2
33、 0 3 13 12 10 7,中正程玉美,2009/02/25,演練與討論,He complained that he _ the same bad film the night before. (A) had seen (B) was seeing (C) has seen (D) would see. 正答為(A) 答對率（難度）.55 鑑別度.30 高分選答人數低分選答人數 14 8 4 7 2 5 0 0,中正程玉美,2009/02/25,演練與討論,Wasnt that your father over there? (A) Yes, he was (B) Yes, it was (C) Yes, was he (D) Yes, was it. 正答為(B) 答對率（難度）.50 鑑別度.30 高分選答人數低分選答人數 7 13 13 7 0 0 0 0,中正程玉美,2009/02/25,利用測驗提昇教學,老師聯合命題分擔編製各課複習測驗討論試題品質學生共同命題分組討論重點共同命題（字彙、文法、句子重組、插入、刪除等),中正程玉美,2009/02/25,教學評量明析不足再精進,共勉之,祝福大家,
