By Pete Barbrook-Johnson
How can we improve the often poor interaction and lack of genuine discussions between policy makers, experts, and those affected by policy?
As a social scientist who makes and uses models, an idea from Daniel Dennett’s (2013) book ‘Intuition Pumps and Other Tools for Thinking’ struck a chord with me. Dennett introduces the idea of using lay audiences to aid and improve understanding between experts. Dennett suggests that including lay audiences (which he calls ‘curious nonexperts’) in discussions can entice experts to err on the side of over-explaining their thoughts and positions. When experts are talking only to other experts, Dennett suggests they under-explain, not wanting to insult others or look stupid by going over basic assumptions. This means they can fail to identify areas of disagreement, or to reach consensus, understanding, or conclusions that may be constructive.
For Dennett, the ‘curious nonexperts’ are undergraduate philosophy students, to be included in debates between professors. For me, the book sparked the idea that models could be ‘curious nonexperts’ in policy debates and processes. I prefer and use the term ‘interested amateurs’ over ‘curious nonexperts’, simply because the word ‘amateur’ seems slightly more insulting towards models!
In this role, models are not intended to provide answers to policy makers’ questions, or tell them what might happen in the future. Instead, models aim to help policy makers, experts, and those affected by policy – all ‘experts’ on the policy topic at hand – improve their interaction and discussion, as well as their own thinking.
Models therefore become not ‘truth’ for policy makers to accept and take on board, but objects for everyone involved in making or advising or affected by the policy to consider and ‘wrestle’ with – even to attack. Let me provide two examples.
An agent-based model of farmer decision making
A group of local and regional policy stakeholders working on natural resource management and agricultural policy in Ethiopia was presented with an agent-based model of farmers’ decision making related to investing in soil conservation measures. The model set out decision and interaction rules for farmers based on theory developed from empirical work with farmers in the developing world.
The simple but specific model was quickly attacked by the stakeholders – they called it out on what they thought was missing or what was represented incorrectly. However, on some points, others jumped to the model’s defence, and stated that they agreed with it. The model’s detail helped to structure and focus conversation on specific issues, providing discipline to the discussions. The willingness of participants to attack the (unfeeling) model also brought out sensitive topics for discussion that might otherwise have remained untouched.
A fuzzy cognitive map of a river catchment
A varied group of local stakeholders discussing management of a river in the north of England aimed to explore future options for the operation of a large and ageing barrage on the river. In this process, stakeholders developed a fuzzy cognitive map of the river and the surrounding area. Building the map made clear the sheer number of factors important in the area, and the complexity of their interaction.
Of most value perhaps, was the fact that building the map helped stakeholders to realise themselves, in a non-confrontational manner, what they didn’t know, and/or which of their assumptions may be wrong. This happened because the mapping process forced them to agree collaboratively the links between key factors in the river system. Participants concluded some gaps in their knowledge could be filled easily with better interaction with other stakeholders, whereas others required primary research on the processes of the river.
Both of these projects benefited from the use of intuitive and accessible modelling techniques, used not to give answers or forecasts, but to structure a discussion and ‘ask’ potentially ‘stupid’ questions – just like Dennett’s philosophy undergrads. Like much participatory modelling work, the real value was in the process, not the model itself. However, the models’ specificity, intuitive appeal, and neutrality aided discussions in a way other methods or facilitation may not have. I, for one, am looking forward to building more models in the future for policy stakeholders to attack with relish!
What do you think? Do you agree models can act as ‘interested amateurs’? What types of models might work best in this way? What types of policy processes might find most value in using models in this way?
To find out more:
Johnson, P. (2015). Agent-Based Models as “Interested Amateurs”. Land, 4, 2, 281- 299. Online (DOI): 10.3390/land4020281
Dennett, D. (2013). Intuition Pumps and Other Tools for Thinking. Allen Lane: London, United Kingdom.
Thanks to Dr Alexandra Penn (University of Surrey) who leads the second case study.
Biography: Pete Barbrook-Johnson is a Research Associate at the Policy Studies Institute at the University of Westminster, UK, and a Visiting Research Fellow at the Centre for Research in Social Simulation at the University of Surrey, UK. His research interests fall at the crossroads between environmental policy, social and behavioural science, and complexity science. He has experience in a range of research methods including agent-based modelling of social and policy systems, stakeholder causal mapping, and qualitative and quantitative social research methods. He is on Twitter @bapeterj.
2 thoughts on “Models as ‘interested amateurs’”
Thanks Neil. The facilitation skills to read people well-enough to find the areas to dig into, whilst still holding together a group, is something I am still developing! In the meantime, I try to rely on the specificity of the models I use to help!
The carrying capacity tool looks great…as long as the assumptions behind it are also up for discussion – wouldn’t want it to be a shiny black box. NetLogo – the agent-based modelling software I use – is quite ugly sometimes, but I think this is a strength, in that people don’t assume the model is more than it is just because it has a slick interface etc!
Thanks Pete – nice insights. I use both models and myself as the ‘interested amateur/ non-expert’. By NOT pitching my expertise against those closer to the action (whether in community or in academia, or govenment) I can ask ‘the dumb questions’ on behalf of those that wouldn’t ask them, and those that would not otherwise seek to mention the missing details. I find the key is the body language – sensing when a quizzical look on many faces is an unexpressed/unexpressable question, and seeking permission to ask it on their behalf.
In this way I switch from hero (expert/ monologue/ control) to host (non-expert/ dialogue/ service).
My friend Murray Lane developed a Carrying Capacity Dashboard to ‘map’ the likely populations that can be supported by each of the 56 Natural Resource Management areas in Australia – I often have to explain that it is an interactive map, NOT the territory – and that it generates questions (about preferences/ values/ contested evidence) that lead to refinements and collective intelligence. http://www.carryingcapacity.com.au/
I sense we might be on similar paths. Travel well, and keep refining the map/s 🙂
KInd regards, Neil