Gå till huvudinnehållet

Using AI to identify and review research

Different search types

"As researchers, we must start understanding the basic types of searching we engage in and how the objectives behind each search type (why we search) should determine the search methods—that is, system choice (where we search) and search heuristics (how we search)."

Lookup search

"Lookup searches - also called "known item searches" or "navigational searches" - are conducted with a clear goal in mind and "yield precise results with a minimal need for result set examination and item comparison"."

Exploratory search

"Exploratory searching is a process characterized by learning where users aim to be exposed to a multitude of different, sometimes contradicting knowledge sources to build their mental models on a topic."

Systematic search

"Systematic reviews (including meta-analyses) and systematic maps, has introduced many disciplines to the concept of systematic searches, with the goal to (a) identify all relevant records (within the resource constraints) in a (b) transparent and (c) reproducible manner."

Gusenbauer & Haddaway. (2021). What every researcher should know about searching–clarified concepts, search advice, and an agenda to improve finding in academia. Research Synthesis Methods, 12(2), 136-147. https://doi.org/10.1002/jrsm.1457

AI-aided search tools and search types

"AI-aided search tools  are tuned for high precision rather than high recall searches, which while good for explorary searches, isn't ideal when you want to do a deep thorough literature review much less an evidence synthesis where the aim is to find as many relevant articles as possible."

From Aaron Tay "A conceptual view of information retrieval - Can we do better with AI?"

Precision

What fraction of the returned results are relevant to the information need?

Recall

What fraction of the relevant documents in the collection were returned by the system?

Manning, C.D., Raghavan, P. & Schütze, H. (2008). Introduction to information retrieval. Cambridge: Cambridge University Press.

Search types: Goals, uses cases, heuristics & search system requirements

Search types

Goals

Use cases

Heuristics (how)

Search system requirements

Lookup

Find specific information quickly.

Fact retrieval, verification, re-finding.

Direct search, minimal filtering.

Simple interface, high recall.

Exploratory

Learn about a topic, refine questions.

Research discovery, learning, evaluation, keeping up-to-date.

Iterative search, snowballing, filtering.

Flexible navigation, varied options.

Systematic

Identify all relevant records on a topic, transparent & repdoducible search strategy, multiple databases are searched.

Systematic reviews, meta-analyses, scoping reviews.

Boolean operators (AND/OR), snowballing, handsearching (manual screening of journals), inclusion/exclusion criteria.

Comprehensive, transparent, reproducible. Searching multiple databases. Download entire search results.

Gusenbauer & Haddaway. (2021). What every researcher should know about searching–clarified concepts, search advice, and an agenda to improve finding in academia. Research Synthesis Methods, 12(2), 136-147. https://doi.org/10.1002/jrsm.1457