Evaluation is used to examine the effectiveness (outcomes) and efficiency of research and S&T programs, initiatives and activities. Without becoming experts themselves in the type of activities they are assessing, evaluators working in this area need to understand the context in which these activities take place, not only to adequately interpret their findings but also to design and implement studies using appropriate research methods.
Evaluators can be responsible for one or several steps in an evaluation process, such as:
- determining the need, scope and resources for an evaluation
- engaging with the organization and stakeholders
- developing the program theory and conceptual/analytical framework
- assessing the quality and availability of information and data
- conducting an evaluation assessment (also called evaluability assessment)
- designing the evaluation framework and evaluation plan
- implementation of research methods
- analysis and integration of findings
- reporting and communicating the results and actionable recommendations
Common questions for S&T evaluation
- What are the best indicators, data sources and research methods to evaluate the effectiveness and efficiency of S&T activities, given the evaluation need, scope and budget?
- How can we demonstrate value for money of S&T and R&D activities?
- How do we assess the prevalence and impact of collaborative R&D, both within and between different sectors (academic, industry, government, etc.)?
- How can the evaluation integrate quantitative and qualitative data in a cost-effective manner?
- How do we compare or position nationally and internationally?
- What can the evaluation provide in terms of best practice?
- How do we best leverage our staff with other key actors?
- Who are the best collaborators and/or receptors for us?
How we can help you
Science-Metrix helps evaluators at each step of the evaluation process in a way that is adapted to the needs and preferred model of the client. For example, we can provide analytical and practical expertise to support in-house evaluators for one or more steps, we can work in a mixed team approach to perform customized studies that inform the evaluation findings, or we can conduct turnkey evaluations of S&T programs, initiatives and activities.
As evaluation practice continues to mature and grow, innovative new approaches, standards and guidelines have been emerging from several countries.
We not only follow the evolution of the field, but also work to develop and implement leading-edge methods and best practices in evaluation. These are then shared with the evaluation community via presentations, papers and tools.