By Graham Hubbs, Michael O’Rourke, Steven Hecht Orzack
2. Michael O’Rourke (biography)
3. Steven Hecht Orzack (biography)
Have you collaborated with people on a complex project and wondered why it is so difficult? Perhaps you’ve asked yourself, “Do my collaborators even conceive of the project and its goals in the way I do?” Projects involving collaborators from different disciplines or professions seem almost ready made to generate this kind of bewilderment. Collaborators on cross-disciplinary projects like these often ask different kinds of questions and pursue different kinds of answers.
This confusion can bedevil cross-disciplinary research. The allure of such research is its promise of solving complex problems by bringing together a variety of perspectives that when combined lead to solutions that any one perspective would fail to find. But combining different disciplinary perspectives also requires undertaking the tasks of translating different technical languages, reconciling different methodological preferences, and coordinating different ways of carving up the world. These tasks are difficult and it’s no wonder that cross-disciplinary research often fails to be truly cross-disciplinary.
Why disciplinary differences occur
These challenges are not surprising. Members of different disciplines read different literatures, acquire different skill sets, and learn to value different ways of knowing the world. However, we usually aren’t trained to understand and communicate with experts from other disciplines. The resulting failures of communication often produce what we call the “Problem of Unacknowledged Differences.” Collaborators from different disciplines often don’t really know how they are different; as a consequence, they struggle to identify how to integrate their different forms of expertise. This makes it hard if not impossible to marshal a coherent understanding of the problem that sparked the collaboration.
To make matters worse, collaborators are frequently discouraged from even talking about this problem. The aspects of a research project that any one collaborator finds problematic may not even be noticed by the others. Each collaborator may hesitate to point out what they find problematic in order to avoid being labeled as a troublemaker. The consequence is that these differences are unlikely to be resolved.
The Toolbox dialogue method and workshop
The Toolbox Dialogue Initiative has designed a dialogue-based method to address the Problem of Unacknowledged Differences and to nurture collaborative, cross-disciplinary research. This method – the Toolbox dialogue method – is deployed in a facilitated workshop setting, typically over a 3- to 4-hour period, and features a 60- to 90-minute philosophically-structured dialogue in which collaborators explore their unacknowledged differences so as to enhance their mutual understanding. After the dialogue, collaborators work on a co-creation activity (eg., concept mapping) that further builds on what they have learned about themselves and each other.
The dialogue in Toolbox workshops is structured by prompts that express commitments that are obvious to some disciplines and professions but are foreign to others. Presented as rating-response items, these prompts are organized into several thematically-focused modules (eg., “Methodology”, “Research Identity”, “Values”) that together constitute a Toolbox instrument. In a workshop, participants individually work through the instrument by scoring the items and then collectively talk about the issues the items raise.
Prompts include items such as, “Knowledge generated by research is valuable even if it has no application” and “Value-neutral scientific research is possible”. These are not psychometrically-validated survey items, but rather prompts designed to get people talking in a facilitated dialogue about issues that disclose key features of their worldviews. For example, consider the prompt, “Scientific research must be hypothesis driven”. Some may see this as self-evident – as simply just what science is – whereas others may rarely use hypotheses in their research practice. By comparing and discussing their responses, team members can work out just how central hypotheses are to each member’s scientific worldview and how important they will be to the conduct of their common project.
The primary goal of a Toolbox workshop is to enable collaborators to address the Problem of Unacknowledged Differences by articulating, sharing, and discussing their research perspectives with one another. Facilitated dialogue about the core beliefs and values that frame research perspectives can enhance mutual understanding among collaborators and improve their ability to collaborate effectively and to achieve their common goals.
Conclusion
In the 15 years since the Toolbox dialogue method was developed, workshops have been held with more than 370 cross-disciplinary teams. The method was initially used in interdisciplinary scientific contexts but can be used in other cross-disciplinary contexts and in non-academic settings. Toolbox workshops have proven useful to teams at the beginning of a project, but they can also support reflection and perspective taking throughout the entirety of a project.
Questions
Have you experienced the Problem of Unacknowledged Differences in a research collaboration? If so, how have you attempted to deal with it? If you have been involved in a Toolbox workshop, how did you find the process?
To find out more:
Hubbs, G., O’Rourke, M. and Orzack, S. H. (Eds.). (2020). The Toolbox Dialogue Initiative: The Power of Cross-Disciplinary Practice. CRC Press: Florida, United States of America. (Online – book description): https://www.taylorfrancis.com/books/toolbox-dialogue-initiative-graham-hubbs-michael-rourke-steven-hecht-orzack/e/10.1201/9780429440014
Toolbox Dialogue Initiative website: http://tdi.msu.edu/
Biography: Graham Hubbs PhD is Associate Professor and Chair of the Department of Politics and Philosophy at the University of Idaho in Moscow, USA. He is also a senior member of the Toolbox Dialogue Initiative. He contributes to cross-disciplinary integration through his work with the Initiative.
Biography: Michael O’Rourke PhD directs the Toolbox Dialogue Initiative (TDI) and the Center for Interdisciplinarity at Michigan State University in East Lansing, USA, where he is Professor of Philosophy and faculty in AgBioResearch. He is a founding member of TDI, which has been funded by NASA (National Aeronautics and Space Administration) and several US National Science Foundation programs.
Biography: Steven Hecht Orzack PhD is Senior Research Scientist and President of the Fresh Pond Research Institute in Cambridge, Massachusetts, USA. He is a member of the advisory board of the Toolbox Dialogue Initiative.
Bethany Larsen had a lot of literature suggestions in response to Stephen’s categories, which, again, are as follows:
a. The role for power
b. What we at TDI have seen
c. How best to understand and respond to disciplinary bias
For (a), Dotson (2011) is helpful to read on testimonial quieting and smothering. The important point from Dotson is that people can be quieted by others and also smother themselves in the presence of hostile power. Bethany herself discusses (a) briefly in Laursen (2018). Finally, Anna Malavisi wrote a section on epistemic justice in “The Power of Philosophy,” chapter 6 in TDI’s recent book _The Toolbox Dialogue Initiative: The Power of Cross-Disciplinary Practice_. (Michael, Steven, and I co-edited this volume.)
For (b), see Chapter 8 of the TDI book, which offers lots of practical ways to mitigate the adverse effects of power on a TDI dialogue.
For (c), see Giri (2002) and Park (2019) on “disciplinary chauvinism.” Piso et al (2016) explain how power can lead teams to actively reinforce ignorance by allowing them to leave their situatedness un-examined and un-balanced.
Hope this helps!
____
Dotson, K. (2011). Tracking Epistemic Violence, Tracking Practices of Silencing. Hypatia, 26(2), 236–257. https://doi.org/10.1111/j.1527-2001.2011.01177.x
Giri, A. K. (2002). The calling of a creative transdisciplinarity. Futures, 34(1), 103–115. https://doi.org/10.1016/s0016-3287(01)00038-6
Gonnerman, C., Hubbs, G., Laursen, B. K., Malavisi, A. (2020). The power of philosophy. In G. Hubbs, M. O’Rourke, and S. H. Orzack (Eds.), The Toolbox Dialogue Initiative: The Power of Cross-Disciplinary Practice (pp. 82–93). Boca Raton, FL: CRC Press. https://www.routledge.com/The-Toolbox-Dialogue-Initiative-The-Power-of-Cross-Disciplinary-Practice/Hubbs-ORourke-Orzack/p/book/9781138341685
Laursen, B. K. (2018). What is collaborative, interdisciplinary reasoning? The heart of interdisciplinary team science. Informing Science, 21, 75–106. https://doi.org/10.28945/4010
Park, S. (2019). My Confession as a Disciplinary Chauvinist. Canadian Journal of History, 54(1–2), 26–31. https://doi.org/10.3138/cjh.ach.54.1-2.03
Piso, Z., Sertler, E., Malavisi, A., Marable, K., Jensen, E., Gonnerman, C., & O’Rourke, M. (2016). The Production and Reinforcement of Ignorance in Collaborative Interdisciplinary Research. Social Epistemology, 30(5–6), 643–664. https://doi.org/10.1080/02691728.2016.1213328
Rinkus, M. A., Vasko, S. E. (2020). Best practices for planning and running a Toolbox workshop. In G. Hubbs, M. O’Rourke, and S. H.
Orzack (Eds.), The Toolbox Dialogue Initiative: The Power of Cross-Disciplinary Practice (pp. 116–126). Boca Raton, FL: CRC Press. https://www.routledge.com/The-Toolbox-Dialogue-Initiative-The-Power-of-Cross-Disciplinary-Practice/Hubbs-ORourke-Orzack/p/book/9781138341685
I would also point to this excellent comment article: Halpern, M., & O’Rourke, M. (2020). Power in science communication collaborations. Journal of Science Communication, 19(04), 1–12. http://doi.org/10.22323/2.19040302
Thank you, Bethany and Graham! These ideas and references are helpful. Bethany, this article on power is especially nice both because of the insightful and nuanced message and because it’s so nicely written (maybe that’s normal in communication journals, but I doubt that it’s universal!).
Thanks for all of these comments and questions. One of the great things of being part of TDI is belonging to an outstanding team. Evelyn (if I may), I put your question to our team and got the following feedback.
Stephen Crowley said he sees three separable issues here:
a. The role for power
b. What we at TDI have seen
c. How best to understand and respond to disciplinary bias
He didn’t have much to say about (a) or (c), but as I’ll indicate in a second, Bethany Laursen did. Re: (b), he recommended you have a look at TDI’s contribution (chapter 6) in “Interdisciplinary and Transdisciplinary Failures” (https://www.routledge.com/Interdisciplinary-and-Transdisciplinary-Failures-Lessons-Learned-from-Cautionary/Fam-ORourke/p/book/9780367207038). It describes ways that we have seen power mess up our dialogue sessions.
He closed by noting that the key insight, which bears repeating over and over, is that having a seat at the table is not the same as being listened to.
Having demonstrated the Toolbox instrument in a number of workshops, I urge all readers to become familiar with it. Unpacking assumptions is crucial to integration and collaboration. It fosters transparency and the potential for more equitable treatment of knowledge domains in teamwork. Evelyn Brister is right to raise the question of social power in this respect: driven by differing status in disciplinary hierarchy, gender, and culture.
This is excellent, thanks – exactly the sort of thing we’re working through at the moment…
This seems like a common problem on interdisciplinary teams, and the differences can be small and fairly easy to identify, such as assumptions about statistical methods, to large and really quite hidden, such as assumptions about what counts as a causal factor. I’m wondering if you have thoughts about how social power plays into attempts to uncover and resolve unacknowledged differences through the dialogue process? What kind of power dynamics have you observed, and especially, is there a kind of status that’s attached to discipline for some ID teams?
Thanks Evelyn! See the two notes I posted earlier in response to your questions and comments here. (My mistake for not hitting the right “Reply” button to post those notes directly in this comment’s thread.)