Title Innovative Peer Learning Assessment System for Evaluation of trainers and Quality VET professional programs
Project Number 2012-1-NO1-LEO05-04776
Project Type Innovationstransfer
Kirkpatricks Evaluationsmodell wird seit etwa 50 Jahren in der Ausbildung von Fachleuten verwendet, ohne dabei wesentliche Neuerungen auf technischer Seite einzuführen.
iQVET führt eine große Neuerung für Kirkpatricks Modell ein. Es erlaubt, den Effekt der Lernhandlung über die eigenen Mobilgeräte der Lernenden zu messen.
Das Vier-Ebenen-Modell von Kirkpatrick misst im Wesentlichen folgendes:
Reaktion - Wie reagieren die Lernenden auf die Trainingsmaßnahme?
Lernen - Haben sich die Kenntnisse und Fähigkeiten der Lernenden verbessert?
Verhalten - Hat sich das Verhalten am Arbeitsplatz verändert/verbessert?
Ergebnisse - Welche Ergebnisse erzielt die Maßnahme für das Unternehmen/die Arbeitsumgebung insgesamt?
Diese vier Ebenen werden empfohlen, um eine vollständige Evaluierung des Lernprozesses in Unternehmen zu gewährleisten. iQVET bietet eine schnelle und effiziente Lösung für diesen Evaluierungsprozess.
VET teachers are currently unable to judge and assess on the fly professionals trainer`s reproduction, demonstration and performance of learning. During short VET courses addressing the World of Work, instructors can't answer questions like
- How successful is/was my teaching?
- How well do/did the students learn the subject taught?
- How much do/did the students learn of the subject taught?
In class communication, interaction and collaboration processes that may enhance effective peer learning processes, where students learn from their peers, are difficult to measure by use of existing ICT technologies
KA3 Done-IT (11-12) project: The brand new Peer Learning Assessment Service (PeLE) system for Smartphones, PAD, PC and Mac gives the teacher a new tool, allowing him/her to either give verification or elaborative feedback to individual students or groups of students immediately after a test. When they still remember the questions in the test, students will learn why the answers are correct or incorrect.Thus, mobile technology provides new evaluation, assessment and testing criteria within education and training
Provide instant evaluation in industry oriented short, intense 2-3 days VET professionals courses, by adapting, testing and validating the new online service "PeLe Professional". Extend Kirkpatrick`s learning outcome evaluation model by using modern, easy to use, cheap mobile response technology, to include Assessment for Learning in competence based systems
The consortium has a strong industrial presence with ties to VET providers, mobile learning and mobile response system technologies (HCR) and manufacturing industry (DOM, HiST, CCI, UTH) leading to identification of inadequacies in current training and evaluation systems and standards for effective instructor training delivery. The partnership has complementary expertise and tasks. HiST, HCR, CCI and UTH have cooperated successfully previously. HCR personnel were key development partners in the KA3 ICT mobile technology EduMecca (09-10) and Done-IT projects
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, provides:
- reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
- learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
- behavior evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
- result evaluation: investigate the effects on the business or environment resulting from the trainee's performance
VET organizations start using Assessment for Learning and the extended Kirkpatrick`s learning evaluation model
Methodology of Kirkpatrick for evaluation
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, by used of the extended PELE tool.
It is going to provide:
Reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
Learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
Behaviour evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
Result evaluation: investigate the effects on the business or environment resulting from the trainee's performance, and try to assess and validate the Return of Investment in VET programs by using the extended Kirkpatrick`s evaluation model
PELE Professional is going be used to measure pre-knowledge just before the course starts, and these data will be collated with immediate feedback from tests offered towards the end of the course. The data gathered before and after the couse are then merged into an interactive learning activity. The learning approach targets short, intense training courses and applies the pedagogical method to business, economy and agricultural courses. The new learning and evaluation process is going to include four disruptive evaluation-learning activities: pretests, learning, posttests and comparison.
Erbringung von Freiberuflichen, Wissenschaftlichen und Technischen Dienstleistungen
Erziehung und Unterricht
Erbringung von Finanz- und Versicherungsdienstleistungen
Information und Kommunikation
Unterlagen für offenen Unterricht
The new PELE Proffesional tool is going to provide:
Pretest of attitude and behaviour - to improve the learning phase
Pretest of knowledge before the learning starts - to improve the learning phase
Evaluate satisfaction during learning phase
Perform posttest of knowledge during learning phase
Some time after finishing learning, provide posttest in attitude and behaviour and use these results to compare and improve the effect of training for participants and companies.
Finally, the project will investiagte if Kirkpatricks evaluation method may be adapted and applied for use in higher education courses.
For instance, use of mobile technology dont require any reconstructon of classrooms or other infrastructure at the campus, due to the portabillity and availabillity of handheld tools (smartphones, tabletts and laptops) among the students. Due to this, it is possible to apply this evaluation method in any classroom that is connected to the WI-FI network, thus reducing the costs for carrying out advanced and improved evaluations in large scale training environments with thousands of students.