Delphi technique

Modifying the Delphi method with continuous real-time data analysis

By Benedikt Steiner.

benedikt-steiner
Benedikt Steiner (biography)

How can the Delphi method be modified to provide data aggregation and visualisation in real time? Which aspects of the Delphi method are preserved and which are changed? How does such a modified method work best?

A brief overview of the Delphi method

The Delphi method is a structured elicitation process that invites experts to explore complex, uncertain or contested topics. It aims to make the assumptions, expectations, and uncertainties of the experts involved explicit.

Key characteristics include:

  • anonymity of participants, reducing social pressure and dominance effects
  • iterative assessment, allowing experts to reflect and revise their judgments
  • controlled feedback, showing aggregated group responses
  • aggregation, rather than forced agreement.

Read more

Generating evidence using the Delphi method

By Dmitry Khodyakov

dmitry-khodyakov
Dmitry Khodyakov (biography)

What is Delphi? How has the Delphi method stood up over time? How can the best of Delphi be adapted to new circumstances and problems?

The Delphi method is a group-based process for eliciting and aggregating opinion on a topic with a goal of exploring the existence of consensus among a diverse group of handpicked experts. The Delphi method was developed at the RAND Corporation in the early 1950s to obtain a reliable expert consensus, which is often used as a substitute for empirical evidence when it does not exist.

The four key characteristics of the Delphi method are:

  1. anonymity, 
  2. iterative data collection,
  3. participant feedback, and
  4. statistical determination of group response.

As a result, Delphi has become best practice for quantifying the results of group elicitation processes.

Read more

Co-producing knowledge: Phases, issues and the td-net toolbox

By Sibylle Studer and Theres Paulsen

authors_sibylle-studer_theres-paulsen
1. Sibylle Studer (biography)
2. Theres Paulsen (biography)

What are the steps involved in co-producing knowledge in transdisciplinary research? What tools are available to help knowledge co-production and for what purpose should they be used?

Based on our experiences with the td-net (Network for Transdisciplinary Research) toolbox, we discuss how knowledge co-production can be organized along an ideal type of a transdisciplinary research process.

Phases and key issues of co-production

In developing the td-net toolbox, we used the following four phases of knowledge co-production, which require an iterative, rather than linear, approach:

Read more

Ten dialogue methods for integrating judgments

By David McDonald, Gabriele Bammer and Peter Deane

authors_david-mcdonald_gabriele-bammer_peter-deane
1. David McDonald (biography)
2. Gabriele Bammer (biography)
3. Peter Deane (biography)

What formal dialogue methods can assist researchers in synthesising judgments about a complex societal or environmental issue when a range of parties with different perspectives are involved? How can researchers decide which methods will be most suitable for their purposes?

We review ten dialogue methods. Our purpose is not to describe the dialogue methods in detail, but instead to review the circumstances in which each method is likely to be most useful in a research context, bearing in mind that most methods a) were not developed for research, b) can be applied flexibly and c) have evolved into different variations. The methods are clustered into six groups:

Read more