Client: European Commission, Directorate-General for Research & Innovation
Published: August 2017
In the midst of the big data revolution, the public and private sectors must be proactive in finding new ways to exploit novel data sources and underutilized administrative data. Within a governmental context, a global transition is presently underway towards establishing a greater role for evidence to play in the policymaking process; in tandem, the processes for gathering, analyzing and interpreting evidence are also undergoing profound changes, with the increasing interest in using data mining and big data analysis techniques as a prime example of these shifts.
Within this context, Science-Metrix undertook a two-year study for the European Commission’s Directorate-General for Research and Innovation (DG RTD). The goals of the project, titled Data mining: Knowledge and technology flows in priority domains within the private sector and between the public and private sectors, were to
The study was performed in two sequential phases, each taking place over a period of one year. The steps conducted in the first phase aimed at fulfilling the first two goals of the project. This included a literature review as well as interviews with key informants; these provided the basis for developing a novel framework to shape the conduct of data mining projects to inform R&I policy. This framework was then validated at a workshop bringing together experts in the data mining field, concluding the first half of the project.
The steps taken in the second phase of the project covered the two last objectives listed above. The most important step in this part of the project consisted in the application of this framework to six case studies to derive policy-relevant and process-based findings that would be instrumental in laying out recommendations to DG RTD for their potential implementation of data mining approaches. Toward the end of the second phase of the project, these recommendations, the findings upon which they are based and a revised version of the framework were again presented to a group of subject-matter experts. Their feedback was then integrated to produce the final report.
Data Mining. Knowledge and technology flows in priority domains within the private sector and between the public and private sectors. (2017). Prepared by Science-Metrix for the European Commission. ISBN978-92-79-68029-8; DOI 10.2777/089
Image credit: iStock Photo