Draft:Research Intelligence

Research Intelligence

Research Intelligence (RI) is a multifaceted discipline and strategic framework that serves as a vital bridge between information specialists—librarians, data scientists, and programmers—and institutional policy-makers, such as university boards, provosts, and research directors. Based on the foundational definition by Iping et al. (2026) and institutional frameworks from the University of Wisconsin-Madison, RI involves the systematic collection, enrichment, analysis, and interpretation of research-related information. Crucially, this goes beyond automated metrics to include qualitative content such as surveys, interviews, and focus groups, ensuring that findings are anchored in the social and disciplinary contexts of the institution.

By transforming raw metadata into actionable insights, Research Intelligence enables academic organizations to shift from reactive reporting to proactive, evidence-based decision-making. Its strategic importance lies in its ability to build organizational resilience; unlike traditional bibliometrics, which is often a theoretical study of citation patterns, RI is inherently practical and question-driven. It provides the "So What?" layer necessary to convert performance data into a professional narrative that informs institutional positioning and talent management. This discipline is the culmination of over a century of evolution in how scientific output is measured, curated, and valued.

History and Evolutionary Milestones

The historical necessity of measuring scientific impact has evolved from 19th-century statistical bibliography into the modern era of digital analytics, reflecting a shift from narrative-based quality assessments to a quantified model driven by economic pressures.

• Early Foundations: The quantitative roots of the field lie in the work of Edward W. Hulme (1923), who explored statistical bibliography, and Alfred J. Lotka (1926), who defined the frequency distribution of scientific productivity.
• The Citation Revolution: Eugene Garfield’s 1950s innovations led to the founding of the Institute for Scientific Information (ISI) and the 1964 launch of the Science Citation Index (SCI). In this same era, Derek J. de Solla Price published his seminal Science since Babylon (1961), providing the theoretical weight that solidified "scientometrics" as a field covering productivity and collaboration patterns.
• The 1970s Shift: The oil crisis and subsequent economic austerity triggered a move away from narrative-based peer review. Performance-based funding models emerged, and citation indexes were increasingly adopted as proxy indicators for research quality to justify the allocation of scarce resources.
• Digital and Social Turn: The launch of Google Scholar (2004) and the proliferation of platforms like Scopus and Web of Science decentralized analytics. In the 2010s, the "Altmetrics" movement expanded the scope of impact to include online engagement, policy mentions, and societal uptake.

These tools established the infrastructure required for the modern theoretical frameworks that now define the Research Intelligence landscape.

Theoretical Foundations and Bordering Concepts

Research Intelligence is not an isolated silo but a "bridge" concept that links science studies with organizational management and data science. It is an applied discipline that operationalizes quantitative and qualitative insights to address real-world strategic questions.

Bordering Concepts in Research Intelligence

Concept	Core Definition	RI Integration/Application
Bibliometrics / Scientometrics	Quantitative study of scientific communication and citation patterns.	Operationalizes indicators for practical questions regarding institutional research focus and impact.
Research Evaluation	Assessment of research quality and impact for funding or accountability.	Implements responsible evaluation practices, ensuring multi-dimensional insights are used in assessment.
Public Administration	Study of institutional policies and organizational behavior.	Incorporates financing systems and institutional context as drivers for strategic analysis.
Management Studies	Focus on leadership and organizational strategy.	Aligns data analysis with mission statements, leadership goals, and institutional strategy.
Political Science	Analysis of power relations and institutional politics.	Accounts for power dynamics and institutional politics in the delivery of advice.
Metascience	Research on the research process itself.	Uses insights into scientific processes to contextualize the application of RI tools.
Data Science	Extraction of knowledge from large data sets.	Provides the technical layer for data acquisition, cleaning, curation, and advanced visualization.

In the university context, RI serves as a "super-discipline" that allows a Provost or Dean to view the intersection of internal talent (Business Intelligence), competitor movements (Competitive Intelligence), and external socio-economic trends (Market Intelligence). By synthesizing these, RI creates organizational resilience, allowing institutions to pivot their strategy based on external shifts while knowing exactly what internal capacities are available to deploy.

The Research Intelligence Expert

The Research Intelligence professional is a "knowledge broker" who must navigate the complex intersection of academic culture and institutional strategy. This role is best defined as that of an Honest Broker (Pielke, 2007), a specialist who provides alternatives and evidence without being co-opted by institutional politics.

• Hybrid Competency Model: The expert must possess advanced bibliometric literacy and data management skills, but these must be paired with strategic thinking and policy awareness. They must understand disciplinary nuances—such as the difference between the citation cycles of clinical medicine and the narrative output of the humanities—to ensure fair assessment.
• Organizational Role: Effectiveness is maximized when the expert is embedded internally. This proximity allows them to maintain trust and understand the social relations and specific culture of the organization, which external consultants often lack.

The RI expert operates under a "Neutrality vs. Integrity" paradox. While absolute neutrality is rarely possible in a political institutional setting, the expert prioritizes methodological transparency and ethical accountability. By serving as an honest broker, the expert ensures that the framing of an analysis is reflexively considered and not unduly biased by management pressures.

Applications in Institutional Strategy

RI functions as a descriptive tool to support institutional narratives and provide evidence for strategic claims. It represents a shift from "counting publications" to "evidencing research traction" and identifying the actual application of knowledge in society.

• Performance and Capacity Analysis: Assessing the strengths, weaknesses, and internal talent capacity at the team and institute levels to inform resource allocation.
• Trend and Foresight Analysis: Mapping "hot topics" and emerging fields to allow for long-term strategic planning and aligning institutional goals with future demands.
• Collaboration Networks: Identifying potential interdisciplinary partners and benchmarking performance against international peer groups.
• Funding and Societal Impact: Strengthening grant bids by utilizing impact data, including Altmetrics and mentions in clinical guidelines or policy documents.
• Reputational Management: Using research intelligence to support evidence-based claims regarding an institution's global standing and research excellence.

Data Sources and Infrastructure

A robust RI practice relies on a layered ecosystem of proprietary databases, internal systems, and open data standards.

• External Databases: Foundations are built on citation databases (Web of Science, Scopus, PubMed), analytics platforms (InCites, SciVal, Dimensions), and impact tracking tools (Altmetric Explorer, Overton). Emerging open sources like OpenAlex are increasingly used to support transparency.
• Internal Systems: Institutional data is drawn from PhD monitoring systems, HR systems (career tracking), and Current Research Information Systems (CRIS).
• Architectural Backbone: Since 1988, the CERIF (Common European Research Information Format) has served as the vital information model for the management and interchange of research information, allowing different systems to speak the same language.

A significant systemic barrier remains the "unlinked data" challenge. This architectural failure occurs when internal HR and Finance data are siloed from CRIS and external publication metadata. This prevents true "Input vs. Output" analysis, making it difficult for an institution to correlate specific funding and personnel investments with eventual scientific and societal impact.

Responsible Metrics and Criticisms

The RI field is increasingly defined by the movement toward "Responsible Research Assessment," which critiques oversimplified, purely quantitative approaches.

• Frameworks for Responsibility: RI experts adhere to global standards such as the San Francisco Declaration on Research Assessment (DORA), the Leiden Manifesto, and the Coalition for Advancing Research Assessment (CoARA). These advocate for the qualitative use of metrics and the avoidance of reductive university rankings.
• Bias and Systemic Risk: Practitioners must mitigate the inherent biases of major databases, which favor English-language and Western-produced knowledge. Furthermore, an over-reliance on metrics can lead to "gaming the system" and publication bias (the "positive results" problem).
• Expert Judgment: Qualitative "expert judgment" must always accompany RI metrics. The metrics provide the map, but the human expert provides the context necessary to prevent oversimplified and potentially harmful evaluations.

Recent Advances and Future Prospects

The transition toward Artificial Research Intelligence (ARI) marks the next phase of the discipline, driven by the integration of Artificial Intelligence and Machine Learning.

• AI and Automation: Large Language Models (LLMs) and Natural Language Processing (NLP) are automating data curation and thematic extraction. This has transformative potential for underserved disciplines like law and the humanities, where advanced text analysis can provide coverage that traditional citation metrics cannot.
• Human-in-the-Loop: AI will not replace the RI expert. Instead, the expert’s role will shift to that of a "prompt creator" and "results validator," ensuring the integrity of algorithmically generated insights.
• Professional Communities: The Research Intelligence Network Netherlands (RINN), founded in 2017, serves as a model for professional communities that maintain technical standards, share best practices, and keep the "broker" in check through peer accountability.
  

References

• Iping, R., Chan, T. T., van Leeuwen, T., & Cohen, A. (2026). Research Intelligence: An emerging concept. Quantitative Science Studies.
• Cox, A., Gadd, E., Petersohn, S., & Sbaffi, L. (2019). Competencies for bibliometrics. Journal of Librarianship and Information Science.
• Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature.
• Hulme, E. W. (1923). Statistical bibliography in relation to the growth of modern civilization. Self-published.
• Lotka, A. J. (1926). The frequency distribution of scientific productivity. Journal of the Washington Academy of Sciences.
• Pielke, R. A. (2007). The Honest Broker: Making Sense of Science in Policy and Politics. Cambridge University Press.
• Price, D. J. de Solla. (1961). Science since Babylon. Yale University Press.