Title Innovative Peer Learning Assessment System for Evaluation of trainers and Quality VET professional programs
Project Number 2012-1-NO1-LEO05-04776
Project Type Projets de transfert d'innovation
Le modèle d'évaluation de la formation de Kirkpatrick est utilisé depuis bientôt 50 ans dans le domaine de la formation professionnelle sans réel changement dans le domaine de la technologie. Le projet IQVET amène une innovation majeure à ce modèle en introduisant l’évaluation de l'apprentissage et l'utilisation des appareils mobiles des apprenants.
Les quatre niveaux du modèle d'évaluation de la formation de Kirkpatrick sont les suivants :
Réactions des apprenants : ce qu'ils ont pensé et comment ils ont réagi
Apprentissage : l’amélioration des connaissances, habiletés et capacité des apprenants
Comportement : étendue de l’évolution des comportements professionnels sur le lieu de travail
Résultats : l'impact de la formation sur les résultats ou l'environnement de l'entreprise
Il est recommandé de compléter ces quatre niveaux afin d'obtenir une évaluation complète et significative de l'apprentissage en entreprise.
VET teachers are currently unable to judge and assess on the fly professionals trainer`s reproduction, demonstration and performance of learning. During short VET courses addressing the World of Work, instructors can't answer questions like
- How successful is/was my teaching?
- How well do/did the students learn the subject taught?
- How much do/did the students learn of the subject taught?
In class communication, interaction and collaboration processes that may enhance effective peer learning processes, where students learn from their peers, are difficult to measure by use of existing ICT technologies
KA3 Done-IT (11-12) project: The brand new Peer Learning Assessment Service (PeLE) system for Smartphones, PAD, PC and Mac gives the teacher a new tool, allowing him/her to either give verification or elaborative feedback to individual students or groups of students immediately after a test. When they still remember the questions in the test, students will learn why the answers are correct or incorrect.Thus, mobile technology provides new evaluation, assessment and testing criteria within education and training
Provide instant evaluation in industry oriented short, intense 2-3 days VET professionals courses, by adapting, testing and validating the new online service "PeLe Professional". Extend Kirkpatrick`s learning outcome evaluation model by using modern, easy to use, cheap mobile response technology, to include Assessment for Learning in competence based systems
The consortium has a strong industrial presence with ties to VET providers, mobile learning and mobile response system technologies (HCR) and manufacturing industry (DOM, HiST, CCI, UTH) leading to identification of inadequacies in current training and evaluation systems and standards for effective instructor training delivery. The partnership has complementary expertise and tasks. HiST, HCR, CCI and UTH have cooperated successfully previously. HCR personnel were key development partners in the KA3 ICT mobile technology EduMecca (09-10) and Done-IT projects
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, provides:
- reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
- learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
- behavior evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
- result evaluation: investigate the effects on the business or environment resulting from the trainee's performance
VET organizations start using Assessment for Learning and the extended Kirkpatrick`s learning evaluation model
Methodology of Kirkpatrick for evaluation
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, by used of the extended PELE tool.
It is going to provide:
Reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
Learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
Behaviour evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
Result evaluation: investigate the effects on the business or environment resulting from the trainee's performance, and try to assess and validate the Return of Investment in VET programs by using the extended Kirkpatrick`s evaluation model
PELE Professional is going be used to measure pre-knowledge just before the course starts, and these data will be collated with immediate feedback from tests offered towards the end of the course. The data gathered before and after the couse are then merged into an interactive learning activity. The learning approach targets short, intense training courses and applies the pedagogical method to business, economy and agricultural courses. The new learning and evaluation process is going to include four disruptive evaluation-learning activities: pretests, learning, posttests and comparison.
Formation tout au long de la vie
Entreprise, TPE, PME
Égalité des chances
Formation ouverte et à distance
Activités Spécialisées, Scientifiques Et Techniques
Activités Financières et d`Assurance
Information et Communication
Matériel pour l'enseignement
The new PELE Proffesional tool is going to provide:
Pretest of attitude and behaviour - to improve the learning phase
Pretest of knowledge before the learning starts - to improve the learning phase
Evaluate satisfaction during learning phase
Perform posttest of knowledge during learning phase
Some time after finishing learning, provide posttest in attitude and behaviour and use these results to compare and improve the effect of training for participants and companies.
Finally, the project will investiagte if Kirkpatricks evaluation method may be adapted and applied for use in higher education courses.
For instance, use of mobile technology dont require any reconstructon of classrooms or other infrastructure at the campus, due to the portabillity and availabillity of handheld tools (smartphones, tabletts and laptops) among the students. Due to this, it is possible to apply this evaluation method in any classroom that is connected to the WI-FI network, thus reducing the costs for carrying out advanced and improved evaluations in large scale training environments with thousands of students.