Title Adaptive Medical Profession Assessor (Med-Assess)
Project Number DE/12/LLP-LdV/TOI/147557
Project Type Transfer of Innovation
Marketing Text The core idea of Med-Assess is to measure knowledge of employees in the medical field especially nurses, regarding certain work related topics and also to provide learning content based on the assessment results. The developed solution is declared adaptive as it facilitates modeling different job roles and thus fulfills the requirements of standard and specialized clinics alike. Beside the assessment of the employed staff, the solution may be provided for hospitals and clinics for evaluating and comparing the skills of new job candidates. With regard to the international context, Med-Assess can be used for determining whether a foreign applicant holds similar knowledge and qualifications than a local applicant. Med-Assess test platform, thus, consists of “Knowledge Test” for measuring domain knowledge of nurses, and General Mental Ability (GMA) test for estimating the competence of the examinees. The solution provides a web interface and an ontological back-end for modification of content and job roles.
The project Adaptive Medical Profession Assessor (Med-Assess) has been funded as an innovation transfer project in the context of the LEONARDO DA VINCI call Lifelong Learning Programme (2012-2014). The developed solution of OntoHR (www.ontohr.eu) has been transferred from the IT domain to the health domain as well as from the Netherlands and Hungary to Germany, while still staying as a multi-lingual solution.
Health sectors across Europe demand highly qualified nurses. The key to determine quality of nursing performance is determined as the ability and skills for applying domain specific knowledge in various situations properly. Nursing education is strongly tailored to on-the-job training and learning by doing. To fill existing knowledge gaps, nurses need to participate in (continual) vocational education and training (e.g. workshops or online courses). Med-Assess, supports (i) assessing of work-based competences and job knowledge of nurses, (ii) indicating existing knowledge gaps, and (iii) ultimately providing recommendations for improving nursing competences. The ontological approach of Med-Assess reinforces analysis and assessment of nursing job knowledge. It matches the nursing requirements and domain specific knowledge, and provides the logic for assessment of the end-users i.e. job applicants, nurses and care-givers. The solution is adaptable for different medical qualification areas. This way each potential clinic will be able to create individual Med-Assess measuring Knowledge-Bases i.e. neuroscience, internal medicine, sport medicine, etc.
The project lifetime has been separated into 8 different workpackages. The project management (WP1) has been initialized in October 2012. The activities of WP1 have been successfully done throughout the project lifetime, which ended at 30th of September 2014. Next to organizing and monitoring the project progress, the homepage and different social network channels have been created for establishing a direct link to the target group and other interested persons. The kick-off and a first medical workshop have been organized in Siegen, while two technical/working meetings took place at Beta Klinik in Bonn and the annual meeting at Corvinno in Budapest.
In WP2 nursing material like educational guidelines, literature and references including nursing curriculum and tasks have been gathered. In March 2013, a technical meeting took place at Beta Klinik, where all partners worked collaboratively for three days. The nursing tasks have been extracted and modeled using findings of literature survey, investigation on international databases and job vacancies as well as interviews with nurses. The tasks have been structured in form of a master list and validated by the domain experts i.e. nurses and physicians. The Domain Ontology (Knowledge-Base) has been designed and developed based on the master list. It has been validated by the nurses too.
In WP3, learning material has been gathered in EN&DE languages, and the test questions in four languages of EN, DE, NL & HU with support of domain experts (e.g. nurses, physicians and medical managers of Beta Klinik). Iteratively the learning materials and test questions have been integrated in the Domain Ontology (Knowledge-Base).
In WP4 the design, implementation and usability test of the GUI have been the main tasks. The first step had been a design and paper prototyping phase, followed by the implementation and connection between the Med-Assess homepage and the development platform STUDIO. Additionally to the nursing test, a general mental ability test and a user feedback form have been integrated into the system.
Followed by WP4, the pilot testing has been the focus of WP5. This required identifying the testing methodology, identifying and encouraging enough test candidates, executing the pilot, analyzing feedback and improving the Med-Assess system. In this way the consortium contacted different medical institutions, presented Med-Assess at the “Junge Pflege Kongress 2014” in Germany and involved the nurses and associated partners of Beta Klinik. At the end a pilot test evaluation document has been created.
In WP6, the quality management (with indicators) has been established to monitor and control fulfilling of the project objectives. The QM document has been a part of the work plan for the whole of project time. In addition, the external evaluator (DEIS Department of Education Development, Cork Institute of Technology) has prepared an interim report in October 2013 and a final report at the end of the project time.
In WP7, different dissemination activities took place, such as attending conferences and publishing scientific papers/posters in peer reviewed conferences, contacting potential European/national/regional/local stakeholders through distribution of leaflet/poster and establishing of associated partnerships with interested organizations. At the end of the project time University of Siegen published a news article about the results achieved in Med-Assess.
The final work package 8 targeted the exploitation and commercialization activities of Med-Assess. In this context an intellectual property rights agreement has been signed by all partners. Additionally a commercialization plan in EN and DE has been created during the second year of the project. The consortium will continue its collaboration for exploitation of "Med-Assess as a Service" for associated partners and interested parties in the network of Med-Assess in Germany, the Netherlands and Hungary. The partners will also collaborate for further research activities. Especially, KBS, UvA and Corvinno have established a research partnership on further research on Job Knowledge Assessment and Adaptive Testing.
The project homepage will continue to operate as a means of posting information on new Med-Assess development and testing the system. The project homepage itself is a tool for management of subsequent European projects and will remain as a point of reference for partners when planning and delivering other projects.
A tremendous success for Med-Assess is that a follow up project, Professional Nursing Education and Training (Pro-Nursing), in the context of ERASMUS+ program has been granted, starting in September 2014 (www.pro-nursing.eu).
Since the destination of innovation transfer was Germany, German medical and nursing institutions have been addressed and could benefit from Med-Assess system. Especially, most of the contacted organizations (as a hospital, clinic and nursing school) have expressed serious interest in using or testing Med-Assess system. The clinical partners and associated partners of the project in Germany are currently aware of the details of the system and can benefit in a long run.
Within the exploitation and also in the context of the continual project, the quality of existing services of Med-Assess will be improved and the system will be further developed.
Utilization and distribution of results
Recognition, transparency, certification
Human Health and Social Work Activities
Information and Communication
description of new occupation profiles
procedure for the analysis and prognosis of the vocational training requirement
- Creation of a web based interface for assessment of medical knowledge, based on different job ontologies for nurses in general and neuroscience nurses in particular
- Identification of job knowledge elements and development of a medical profession knowledge base for learning content
- Customization of Med-Assess for Multi-languages
- Med-Assess commercialization plan
- Med-Assess External Evaluation Report
- Med-Assess leaflets and posters in EN, DE, NL and HU
- Med-Assess scientific publications
- Med-Assess project media presence (press articles and social media)