Course evaluation

This article or section is a stub. It does not yet contain enough information to be considered a real article. In other words, it is a short or insufficient piece of information and requires additions.

Draft

## Contents

* 1 Definition
* 2 Types of evaluations
* 3 Guidelines for evaluation
* 3.1 Merrill's first principles of instruction
* 3.2 Dick and Carey (1996) guidelines
* 3.3 IPSRT
* 3.4 Reeves and Hedberg
* 4 Evaluation materials
* 4.1 Things to download
* 4.2 On-line tools
* 4.3 Lists for practionners
* 5 References

## Definition[edit | edit source]

Course evaluation can take different forms:

* Formative evaluation by an expert
* Evaluation by students
* Self-evaluation that includes feedback from students

See also: e-benchmarking

## Types of evaluations[edit | edit source]

Kirkpatrick’s Four Levels of Evaluation (according to Terry Anderson, retrieved 18:15, 11 September 2006 (MEST))

1. Reaction is a measure of learners’ reactions.
2. Learning is a measure of what they learned.
3. Transfer is a measure of changes in their behaviour upon completion of the program.
4. Results is a measure of the business outcomes attributable to the learning which occurred in the program.
5. Return on investment (ROI) - added by Anderson.

## Guidelines for evaluation[edit | edit source]

### Merrill's first principles of instruction[edit | edit source]

* This framework is descibed in the  Instructional design article

### Dick and Carey (1996) guidelines[edit | edit source]

1. Are motivational concerns addressed?
2. Is the appropriate/relevant content included?
3. Is the presentation sequence of the content correct?
4. Is all of the required information available to the student?
5. Do appropriate and ample practice exercises exist?
6. Is adequate feedback included for these exercises?
7. Are appropriate tests provided to assess student progress?
8. Are sufficient follow through activities provided?
9. Is the student presented with a clear path/navigational guide to move them through the course material and components?
10. Are aides to assist the student with memorization and facilitate transfer of learning provided?

### IPSRT[edit | edit source]

Baylor, Kitsanas, and Chung (2001) developed a similar reflective question tool called, Instructional Planning Self-Reflective Tool (IPSRT). The IPSRT is designed to facilitate self-reflective thinking through the lesson planning process for a traditional or online course.

### Reeves and Hedberg[edit | edit source]

This model encompasses six functions or levels of evaluation that are keyed to the major stages involved in the design, development, and implementation of interactive learning systems or products such as multimedia DVD's, Web-based training, electronic performance support systems, and e-learning solutions.

## Evaluation materials[edit | edit source]

### Things to download[edit | edit source]

* Reeves and Hedberg forms and protocols

### On-line tools[edit | edit source]

* IQAT - Interactive quality assessment tool \- this is commercial $500/year benchmarking tool, demo available.

### Lists for practionners[edit | edit source]

* A compact Instructional Design Review Checklist, elearningindustry.com (added 4/2013).
* Checklist for strong elearning

5 July 2011 By Cathy Moore (added 4/2013).

## References[edit | edit source]

* Cooley, W. W., and Lohnes, P. R. (1976). Evaluation research in education. New York: Irvington.

* Dick, W., & Carey, L. (1996). The Systematic Design of Instruction, (4th Ed.). New York: Haper Collins College Publishers.

* Dick, W., Carey, L., & Carey, J. O., (2001). The systematic design of instruction (5th ed.). New York: Addison-Wesley, Longman.

* Flagg, B. N. (1990). Formative evaluation for educational technologies. Hillsdale, NJ: Lawrence Erlbaum.

* Kemp, J. E., Morrison, G. R., & Ross, S. M. (1998). Designing Effective Instruction, (2nd Ed.). Upper Saddle River, NJ: Prentice Hall.

* Kirkpatrick, D. (1979). Techniques for evaluating training programs. Training and Development Journal. 33(6), p. 78-92.

* Naidu, Som (ed). eLearning_Guidebook. Commonwealth Education Media Center for Asia (CEMCA) and the Commonwealth of Learning (COL). There is a chapter on evaluation

* National Research Council (2003). Evaluating and improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics, GoogleBook link

* Reeves, Thomas, C. and John G. Hedberg (2003), Interactive Learning Systems Evaluation, Englewood Cliffs: Educational Technology Publications. ISBN 0-87778-304-7. The companion web site makes available a full set of evaluation tools (forms and protocol)

* Scriven, M. (1993). Hard-won lessons in program evaluation. San Francisco, CA: Jossey-Bass.