(The Working Group was active between 2013 and 2018)
The ERC Scientific Council is entrusted by the legislation establishing Horizon 2020 – among others - with the task to monitor quality of operations and evaluate programme implementation and achievements and make recommendations for corrective or future actions.
The main role of the Scientific Council’s Working Group on Key Performance Indicators is to develop a roadmap for monitoring and evaluating ERC’s accomplishment of its mission, beyond indicators and targets, to support the short, medium and long term policies of the Scientific Council.
During 2018 the Working Group worked on the revision of the ERC Monitoring and Evaluation Strategy of June 2009, mainly refining objectives and indicators, listing explicitly the key principles of ERC monitoring and evaluation and broadening the perspective in the understanding and measurement of ERC impact, considering different levels and time horizons. The Scientific Council approved the revised ERC Monitoring and Evaluation Strategy in October 2018.
The Monitoring and Evaluation Strategy has five objectives: the core objective "Knowledge" corresponding to the ERC mission as defined by legislation (which has at its core the creation of radically new knowledge) and four more objectives corresponding to the ERC expectations related to impact on researchers, structural impact, socio-economic impact and operational performance. Each objective has three dimensions as depicted below:
ERC EXPERT GROUP ON PROGRAMME MONITORING AND EVALUATION
In March 2014 ERC appointed an Expert Group for Programme Monitoring and Evaluation with the following tasks:
- to advise the ERC in the further development of its Monitoring and Evaluation Strategy in view of Horizon 2020;
- to assist the ERC in the design of studies and analysis which could be commissioned externally or undertaken internally by ERC;
- to conduct small scale analysis and studies on selected topics based mainly on the ERC's Monitoring and Evaluation strategy, but also taking into account good practice and experience from monitoring and evaluation activities of national research systems, in particular regarding the ERC's complementarity and added value.
The Expert Group was active until 31 October 2015 and worked under the guidance of the Working Group on Key Performance Indicators.
The Expert Group consisted of 10 persons with broad experience in science evaluation: Paula Stephan Amis, Ghislaine Filliatreau, Christine Kosmopoulos, Terttu Luukkonen, Patrice Laget, Félix de Moya-Anegón, Gunnar Öquist, Michael Stampfer, Otto Toivanen, Anthony Van Raan.