Image
Evaluation tools applied to innovation policy-mixes
Published on 16 May 2018
Lithuania
This is the good practice's implementation level. It can be national, regional or local.
About this good practice
How to measure large-scale policy mix in innovation (especially, advanced manufacturing) field? How to incorporate large data to specific policy analysis and trace innovation policy-mixes in meaningful policy cycles? Lithuania has a good example of innovation evaluation system
and its tools that are being applied to the large-scale innovation policy-mixes, as RIS3 of Lithuania. It is dedicated to ensuring traceability among strategic level of the policy, RIS3 priorities, concrete policy-mix (instruments) and the results, impact obtained.
The evaluation system consists of 3 stages: monitoring, mid-term evaluation of progress and impact assessment. The goal of monitoring is to determine the state of implementation of the policy-mix (as RIS3). The goal of mid-term evaluation is to measure the relevance, efficiency, effectiveness of the policy-mix (as RIS3) and to determine whether RIS3 priorities remain relevant. Final evaluation is dedicated to assessing the benefits and impact of the intervention.
Evaluation system and its tools are being implemented in collaboration between MOSTA and the Ministry of Economy. The results of evaluations are being reported to the inter-ministry Coordination Group that has the role of assessing the progress and suggest changes on policies.
Besides, monitoring, evaluation results are widely disseminated. Monitoring of allocation of funds and degree of implementation of individual instruments is open to the public on the web.
and its tools that are being applied to the large-scale innovation policy-mixes, as RIS3 of Lithuania. It is dedicated to ensuring traceability among strategic level of the policy, RIS3 priorities, concrete policy-mix (instruments) and the results, impact obtained.
The evaluation system consists of 3 stages: monitoring, mid-term evaluation of progress and impact assessment. The goal of monitoring is to determine the state of implementation of the policy-mix (as RIS3). The goal of mid-term evaluation is to measure the relevance, efficiency, effectiveness of the policy-mix (as RIS3) and to determine whether RIS3 priorities remain relevant. Final evaluation is dedicated to assessing the benefits and impact of the intervention.
Evaluation system and its tools are being implemented in collaboration between MOSTA and the Ministry of Economy. The results of evaluations are being reported to the inter-ministry Coordination Group that has the role of assessing the progress and suggest changes on policies.
Besides, monitoring, evaluation results are widely disseminated. Monitoring of allocation of funds and degree of implementation of individual instruments is open to the public on the web.
Resources needed
MOSTA, in collaboration with the Ministry of Economy, oversee evaluation system implementation. 11 policy analysts work in this area. The set up and testing of the whole system is going to cost 1,230,792.95 Euros overall. The price includes wages, expert services, surveys, and administrative costs
Evidence of success
Monitoring is currently being implemented (2 monitoring reports are already done); an interim evaluation has been executed in August-October 2018; the impact assessment will be done at the end of 2020. In the MANUMIX project, Lithuanian Good Practice has been presented as an effective way to measure a wide-range innovation policy-mix, in the field of advanced manufactory, where the measurement of the impact of a specific intervention needs to be combined with a wider macroeconomic context.
Potential for learning or transfer
This system establishes the tools (methods and processes) that currently are being used for monitoring and evaluation of the RIS3. The evaluation system has a holistic approach and establishes the traceability among whole innovation policy, RIS3 priorities, policy instruments and their results, impact obtained. Also, the system is conceived as a policy learning strategy that goes beyond accountability purposes, since it includes mechanisms for the introduction of evaluation results in the policymaking process.
In the MANUMIX project, Lithuania's example is highlighted as an effective way to measure a broad-based policy mix, linking specific policy instruments to a broader macroeconomic context, incorporating aspects of investment return and impact assessment. The holistic vision, adaptation to each policy level (projects, policy instruments, RIS3 priorities and innovation policy in general) and the policy learning strategy are also aspect with potential to be transferred
In the MANUMIX project, Lithuania's example is highlighted as an effective way to measure a broad-based policy mix, linking specific policy instruments to a broader macroeconomic context, incorporating aspects of investment return and impact assessment. The holistic vision, adaptation to each policy level (projects, policy instruments, RIS3 priorities and innovation policy in general) and the policy learning strategy are also aspect with potential to be transferred
Further information
Website
Good practice owner
You can contact the good practice owner below for more detailed information.
Organisation
Research and Higher Education Monitoring and Analysis Centre (MOSTA)
Lithuania