analysis

Evaluation

The developers often consider the completed elearning material as a result of their work, but it is not so. We should know its efficiency, for two reasons. First of all, we always have the chance to improve and personalize the material, on the other hand, it can be a good lesson to see the shortcomings and not to make the same mistakes at the following production.  
Our evaluation process is based on the Kirpatrick’s model, which has been used successfully for decades, not only in education but in other areas, too. The original model has four levels, and the educational version has added one more. Those levels measure the performance from various aspects. During the evaluation process we collect and analyse statistics.
The questions to answer on the five levels are:
1. Did/do the students like the method and the lessons?
2. What did they learn (what is the progress)?
3. What has changed due to the learning process?
4. What are the measurable achievements?
5. How durable are they?

Reaction

We have to ask every participant (not only the students) about their opinion. Questions for teachers who have used the learning material: what are their attitudes to it (support/indifference/rejection)? What do the students think? By applying blended elearning we should separate the questions about the learning material from the teaching method. The attitude test we employed earlier can be used again, but now we concentrate on the material instead of students. In this case the open ended questions are more suitable.

General question to students:

  • What did you like during the lessons?
  • What didn’t you like?
  • What would you do in a different way?
  • What did you learn?
  • What didn’t you learn what you miss?
  • Do you like this kind of learning method?
  • Have you achieved your learning objectives?
  • Did you have sufficient support?
  • Do you think it will have any influence to your subsequent studies/exams/work?

The teacher can add his or her personal experience to these answers:

  • Were the students active/initiative/satisfied?
  • To what extend is the teacher satisfied?
  • Was there enough time for each topic? (timing)
  •  Is the teacher satisfied with communication?
  • What about the atmosphere?
  • Did the program give any extra experience in addition to the objectives?