Developing a ‘capabilities approach’ for measuring social impact

Community member post by Daniel J. Hicks

Daniel J. Hicks (biography)

Why do familiar metrics of impact often seem “thin” or to miss the point of research designed to address real-world problems? Is there a better way to measure the social impact of research?

In a recent paper (Hicks et al., 2018), my coauthors and I identified a key limitation with current metrics and started to look at how concepts from philosophy — specifically, ethics — can help us explain the goals of our research, and potentially lead to better metrics.

What’s the problem?

To understand the limitations of current metrics for measuring the social impact of research, it is useful to understand two distinctions, between resources and goals and between inward-facing and outward-facing goals for research. Continue reading

Research impact in government – three crucial elements you will need for success

Community member post by Anthony Boxshall

Anthony Boxshall (biography)

What is the less visible ‘stuff’ that helps (or hinders) the uptake of research findings into government policy?

As a researcher it can be frustrating to have a great idea, connected to a seemingly important need, and even good networks, and yet still not be able to help your research have impact in the daily life of the relevant public sector decision-makers.

From more than 20 years of being involved in and with the senior decision-making levels of public sector environment agencies and running a business all about increasing the impact of science into public sector decision-making, I offer three insights that you should look for to see if the time and place are right for the uptake of your research. If these three elements exist, your research stands a good chance for uptake. Continue reading

Four strategies for improving knowledge exchange among scientists and decision-makers

Community member post by Chris Cvitanovic

Chris Cvitanovic (biography)

How can we improve knowledge exchange among scientists and decision-makers to facilitate evidence informed decision-making? Of course there is no one size fits all approach, but here I outline four strategies that could be adapted and implemented across different contexts: (i) knowledge co-production, (ii) embedding, (iii) knowledge brokers, and (iv) boundary organisations. These are illustrated in the figure below.

Knowledge co-production

Perhaps the most widely advocated approach to achieving improved knowledge exchange, knowledge co-production refers to the process whereby decision-makers actively participate in scientific research programs from the onset, collaborating with researchers throughout every aspect of the study including design, implementation and analysis. Continue reading

Twelve ways to kill research translation

Community member post by Lewis Atkinson

Lewis Atkinson (biography)

Want to reduce the likelihood that your research will produce policy and practice change? Here are 12 anti-rules to prevent research translation.

Anti-rule #1: ONLY FOCUS ON YOUR PART OF THE PROBLEM. Avoid seeing the problem as a whole to limit the intervention possibilities. Acknowledge the translational “gap” but be ambivalent about who owns it. Contest it with others and perpetuate confusion with a range of definitions for what research translation means.

Anti-rule #2: CLOSE OFF THE FLOW OF INFORMATION AND KNOWLEDGE. Keep a tight lid on who is involved and what knowledge is seen to be relevant. Do not share your data or allow access to your sources of data. Minimise the rate of data exchange within and among various research and non-research partners. Continue reading

Maximizing use of research evidence – how can funders help?

Community member post by Bev Holmes

Bev Holmes (biography)

What is the role of funders in maximizing the use of research evidence?

The Michael Smith Foundation for Health Research is actively considering this question. An important influence on the Foundation’s thinking is the 2014 Lancet special issue Research: Increasing Value, Reducing Waste, which explores roles for funders, regulators, journals, academic institutions and researchers. Funders have a part to play in each of the five recommendations made in the special issue and these are reviewed first. Also examined is an additional area where funders have a role, namely creating the conditions for effective knowledge translation. Continue reading

Assessing research contribution claims: The “what else test”

Community member post by Jess Dart

Jess Dart (biography)

In situations where multiple factors, in addition to your research, are likely to have caused an observed policy or practice change, how can you measure your contribution? How can you be sure that the changes would not have happened anyway?

In making contribution claims there are three levels of rigour, each requiring more evaluation expertise and resourcing. These are summarised in the table below. The focus in this blog post is on the basic or minimum level of evaluation and specifically on the “what else test.” Continue reading