1、ConstructMapCalibration ExerciseIn this exercise you will practice importing project data, calibrating the instrument from that data, and producing IRT and traditional psychometric reports. We will use sample data included with ConstructMap for this purpose. Once you practice using the sample data,
2、you should try the same steps with your project data.Import the projectIf you already have your own data saved in ConstructMap, export it first:Create folder icon1. Select System Export Model Specification. Create a new folder within ConstructMaps project folder to store your project data in.2. Clic
3、king on the create folder icon brings up a new folder icon in the list of folders. It will be named New Folder by default. You can change the name of that folder by double-clicking on the name of the folder and typing a new name. 3. Open the new project folder by double-clicking on the folder icon i
4、n front of the name.4. Click the Save button to save your model specification data in the items.txt file.5. Select File Export Student Data. This will automatically place you in the folder created in step 2 above.6. Click the Save button to save your data in the students.txt file.You will be able to
5、 import your project data after the exercise is completed by following steps 7 - 12 with your data.After exporting your project, or if you do not have a project created yet:7. Decide which demonstration project most closely parallels the instrument for your project:a. Ex 1 Dichotomous is a unidimens
6、ional dichotomous instrument.b. Ex 2 Partial Credit is a unidimensional partial credit instrument (items have different maximum scores).c. Ex 3 Rating Scale is a unidimensional rating scale instrument (items have the same maximum scores).d. Ex 4 Dichotomous MD is a two-dimensional dichotomous instru
7、ment. Use this example if you have any kind of multidimensional instrument. (You may want to try two demonstration projects to both see how multidimensional data is reported and to see how your item type is reported if it is not dichotomous).8. Select File New Project. This will clear the data for y
8、our previous project from the screen display.9. Select System Import Model Specification. 10. Browse to the appropriate folder within ConstructMaps projects folder. Click on the items.txt file and then click the Open button.11. Select File Import Student Data. Click on the students.txt file and then
9、 click the Open button.12. Select File Save to make the currently displayed project available the next time you start ConstructMap.Calibrate the InstrumentThis is a two-step process: First, you will set the calibration options, and then you will calibrate the instrument.1. Select Estimation Tasks Ca
10、libration Options. A dialog window will be displayed. Enter values appropriate for your instrument and click on the OK button to continue. See the ConstructMap Lite v4.2 Users Guide pages 55 to 57 for a complete description of the options. The Users Guide can be downloaded from http:/bearcenter.berk
11、eley.edu/GradeMap/docs/UserGuideLite_v4_2.pdf 2. Select Estimation Tasks Compute Item Parameters. A dialog window will be displayed asking if you want to reset the item parameters. Select Yes to ensure that any preliminary values are cleared, then click on the OK button to continue.An “EM Update” wi
12、ndow will be displayed showing progress of the estimation procedure. See the ConstructMap Lite v4.2 Users Guide pages 57 to 59 for a complete description of the how ConstructMap reports progress on the estimation.When estimation is complete, a dialog window will be displayed asking if you would like
13、 to accept the parameters. Click Yes for ConstructMap to store the values for further processing.3. Select File Save to store the calibrated parameters as part of the current project.Produce ReportsA variety of psychometric reports can be generated by ConstructMap. Try each report to ensure that you
14、 understand what is being reported and how that information can be used to validate the quality of your instrument. See the ConstructMap Lite v4.2 Users Guide pages 22 to 28 and 62 to 83 for complete descriptions of the psychometric reports generated by ConstructMap and for descriptions of the repor
15、t options you may define.The following are the most important reports:1. Select Estimation Tasks Results Wright Map. 2. Select Estimation Tasks Results Graphical Wright Map. 3. Select Estimation Tasks Results Item Estimates & Fit Graph. 4. Select Estimation Tasks Results Classical Item Statistics. 5
16、. Select Estimation Tasks Results Test Information Curve. 6. Select Estimation Tasks Results Full Ability Estimates. Test Your InstrumentYou should be ready now to test your instrument with the data you have gathered. 1. If you have not already done so, create a single text file for the simple import, or create two text files for the standard import. Store the file(s) in a project folder you created within ConstructMaps projects folder.2. Import your data following steps 7 12 on page 2 of this exercise.3. Calibrate your instrument.4. Analyze your instrument using the reports described above.3
