Scale decisions and good practices in socio-environmental systems modelling: guidance and documentation during problem scoping and model formulation
Article Full Text (PDF)

Keywords

organisational scale
spatial scale
temporal scale
thematic scale
uncertainty

How to Cite

Wang, H.-H., van Voorn, G., Grant, W. E., Zare, F., Giupponi, C., Steinmann, P., Müller, B., Elsawah, S., van Delden, H., Athanasiadis, I. N., Sun, Z., Jager, W., Little, J. C., & Jakeman, A. J. (2023). Scale decisions and good practices in socio-environmental systems modelling: guidance and documentation during problem scoping and model formulation. Socio-Environmental Systems Modelling, 5, 18563. https://doi.org/10.18174/sesmo.18563

Abstract

Models of socio-environmental or social-ecological systems (SES) commonly address problems requiring interdisciplinary scientific expertise and input from a heterogeneous group of stakeholders. In SES modelling multiple interactions occur on different scales among various phenomena. These scale phenomena include the technical, such as system variables, process detail, inputs and outputs, which most often require spatial, temporal, thematic and organisational choices. From a good practice and project efficiency perspective, the problem scoping and conceptual model formulation phase of modelling is the one to address well from the outset. During this phase, intense and substantive discussions should arise regarding appropriate scales at which to represent the different phenomena. Although the details of these discussions influence the path of model development, they are seldom documented and as a result often forgotten. We draw upon personal experience with existing protocols and communications in recent literature to propose preliminary guidelines for documenting these early discussions about the scale(s) of the studied phenomena. Our guidelines aim to aid modelling group members in building and capturing the richness of their rationale for scoping and scale decisions. The resulting transcripts are intended to promote transparency of modelling decisions and provide essential support for the justification of the final model for its intended use. They also facilitate adaptive modifications of the pathway of model development via retracing decisions and iterative reflection upon alternative scale options.

Article Full Text (PDF)

References

Allen, T., & Hoekstra, T. (1994). Toward a definition of sustainability. In Sustainable ecological ecosystems: Implementing an ecological approach to land management, General Technical Report, RM-247 (pp. 98–108). USDA Forest Service.

Ayllón, D., Railsback, S. F., Gallagher, C., Augusiak, J., Baveco, H., Berger, U., Charles, S., Martin, R., Focks, A., & Galic, N. (2021). Keeping modelling notebooks with TRACE: Good for you and good for environmental research and management support. Environmental Modelling & Software, 136, 104932. https://doi.org/10.1016/j.envsoft.2020.104932

Badham, J., Elsawah, S., Guillaume, J. H. A., Hamilton, S. H., Hunt, R. J., Jakeman, A. J., Pierce, S. A., Snow, V. O., Babbar-Sebens, M., Fu, B., Gober, P., Hill, M. C., Iwanaga, T., Loucks, D. P., Merritt, W. S., Peckham, S. D., Richmond, A. K., Zare, F., Ames, D., & Bammer, G. (2019). Effective modeling for Integrated Water Resource Management: A guide to contextual practices by phases and steps and future opportunities. Environmental Modelling & Software, 116, 40-56. https://doi.org/10.1016/j.envsoft.2019.02.013

Bankes, S. (1993). Exploratory modeling for policy analysis. Operations Research, 41(3), 435-449. https://doi.org/10.1287/opre.41.3.435

Bierkens, M. F. P., Finke, P. A., & de Willigen, P. (2000). Upscaling and downscaling methods for environmental research (Vol. 88). Springer.

Brugière, A., Nguyen-Ngoc, D., & Drogoul, A. (2022, 2022-December-01). Handling multiple levels in agent-based models of complex socio-environmental systems: A comprehensive review [Review]. Frontiers in Applied Mathematics and Statistics, 8. https://doi.org/10.3389/fams.2022.1020353

Carrada, G. (2006). Communicating science: Infrastructure, hman resources, international cooperation, research and development, environment and health, societal Issues, industrial innovation - A scientist's survival kit. Office for Official Publications of the European Communities.

Cartwright, S. J., Bowgen, K. M., Collop, C., Hyder, K., Nabe-Nielsen, J., Stafford, R., Stillman, R. A., Thorpe, R. B., & Sibly, R. M. (2016). Communicating complex ecological models to non-scientist end users. Ecological Modelling, 338, 51-59. https://doi.org/10.1016/j.ecolmodel.2016.07.012

Cumming, G. S., Cumming, D. H. M., & Redman, C. L. (2006). Scale mismatches in social-ecological systems: Causes, consequences, and solutions. Ecology and Society, 11(1), 14. http://www.jstor.org/stable/26267802

Díaz, S., Demissew, S., Joly, C., Lonsdale, W. M., & Larigauderie, A. (2015). A Rosetta Stone for nature’s benefits to people. PLOS Biology, 13(1), e1002040. https://doi.org/10.1371/journal.pbio.1002040

Edmonds, B., Le Page, C., Bithell, M., Chattoe-Brown, E., Grimm, V., Meyer, R., Montañola-Sales, C., Ormerod, P., Root, H., & Squazzoni, F. (2019). Different modelling purposes. Journal of Artificial Societies and Social Simulation, 22(3), 6. https://doi.org/10.18564/jasss.3993

Elsawah, S., Filatova, T., Jakeman, A. J., Kettner, A. J., Zellner, M. L., Athanasiadis, I. N., Hamilton, S. H., Axtell, R. L., Brown, D. G., Gilligan, J. M., Janssen, M. A., Robinson, D. T., Rozenberg, J., Ullah, I. I. T., & Lade, S. J. (2020). Eight grand challenges in socio-environmental systems modeling. Socio-Environmental Systems Modelling, 2, 16226. https://doi.org/10.18174/sesmo.2020a16226

Elsawah, S., Guillaume, J. H. A., Filatova, T., Rook, J., & Jakeman, A. J. (2015). A methodology for eliciting, representing, and analysing stakeholder knowledge for decision making on complex socio-ecological systems: From cognitive maps to agent-based models. Journal of Environmental Management, 151, 500-516. https://doi.org/10.1016/j.jenvman.2014.11.028

Ford, A. (1999). Modeling the environment: An introduction to systems dynamics modeling of environmental systems. Island Press.

Forrester, J. W. (1961). Industrial dynamics. Cambridge: MIT Press.

García-Álvarez, D., Lloyd, C. D., Van Delden, H., & Camacho Olmedo, M. T. (2019). Thematic resolution influence in spatial analysis. An application to Land Use Cover Change (LUCC) modelling calibration. Computers, Environment and Urban Systems, 78, 101375. https://doi.org/10.1016/j.compenvurbsys.2019.101375

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. Oxford: Further Education Unit.

Gibson, C. C., Ostrom, E., & Ahn, T. K. (2000). The concept of scale and the human dimensions of global change: A survey. Ecological Economics, 32(2), 217-239. https://doi.org/10.1016/S0921-8009(99)00092-0

Glynn, P. D., Voinov, A. A., Shapiro, C. D., & White, P. A. (2017). From data to decisions: Processing information, biases, and beliefs for improved management of natural resources and environments. Earth's Future, 5(4), 356-378. https://doi.org/10.1002/2016EF000487

Gotts, N. M., van Voorn, G. A. K., Polhill, J. G., Jong, E. d., Edmonds, B., Hofstede, G. J., & Meyer, R. (2019). Agent-based modelling of socio-ecological systems: Models, projects and ontologies. Ecological Complexity, 40, 100728. https://doi.org/10.1016/j.ecocom.2018.07.007

Grant, W. E. (1986). Systems analysis and simulation in wildlife and fisheries sciences. New York: Wiley.

Grimm, V., & Railsback, S. F. (2012). Pattern-oriented modelling: a ‘multi-scope’ for predictive systems ecology. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1586), 298-310. https://doi.org/10.1098/rstb.2011.0180

Grimm, V., Augusiak, J., Focks, A., Frank, B. M., Gabsi, F., Johnston, A. S. A., Liu, C., Martin, B. T., Meli, M., Radchuk, V., Thorbek, P., & Railsback, S. F. (2014). Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE. Ecological Modelling, 280, 129-139. https://doi.org/10.1016/j.ecolmodel.2014.01.018

Grimm, V., Berger, U., Bastiansen, F., Eliassen, S., Ginot, V., Giske, J., Goss-Custard, J., Grand, T., Heinz, S. K., Huse, G., Huth, A., Jepsen, J. U., Jørgensen, C., Mooij, W. M., Müller, B., Pe’er, G., Piou, C., Railsback, S. F., Robbins, A. M., Robbins, M. M., Rossmanith, E., Rüger, N., Strand, E., Souissi, S., Stillman, R. A., Vabø, R., Visser, U., & DeAngelis, D. L. (2006). A standard protocol for describing individual-based and agent-based models. Ecological Modelling, 198(1), 115-126. https://doi.org/10.1016/j.ecolmodel.2006.04.023

Grimm, V., Berger, U., DeAngelis, D. L., Polhill, J. G., Giske, J., & Railsback, S. F. (2010). The ODD protocol: A review and first update. Ecological Modelling, 221(23), 2760-2768. https://doi.org/10.1016/j.ecolmodel.2010.08.019

Grimm, V., Johnston, A. S. A., Thulke, H. H., Forbes, V. E., & Thorbek, P. (2020). Three questions to ask before using model outputs for decision support. Nature Communications, 11(1), 4959. https://doi.org/10.1038/s41467-020-17785-2

Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W. M., Railsback, S. F., Thulke, H.-H., Weiner, J., Wiegand, T., & DeAngelis, D. L. (2005). Pattern-oriented modeling of agent-based complex systems: Lessons from ecology. Science, 310(5750), 987-991. https://doi.org/10.1126/science.1116681

Guillaume, J. H. A., Helgeson, C., Elsawah, S., Jakeman, A. J., & Kummu, M. (2017). Toward best practice framing of uncertainty in scientific publications: A review of Water Resources Research abstracts. Water Resources Research, 53(8), 6744-6762. https://doi.org/10.1002/2017WR020609

Guillaume, J.H.A., Jakeman, J.D., Marsili-Libelli, S., Asher, M., Brunner, P., Croke, B., Hill, M.C., Jakeman, A.J., Keesman, K.J., Razavi, S., & Stigter, J.D. (2019) Introductory overview of identifiability analysis: A guide to evaluating whether you have the right type of data for your modeling purpose. Environmental Modelling and Software, 119: 418-432. https://doi.org/10.1016/j.envsoft.2019.07.007

Hall, D. M., Lazarus, E. D., & Swannack, T. M. (2014). Strategies for communicating systems models. Environmental Modelling & Software, 55, 70-76. https://doi.org/10.1016/j.envsoft.2014.01.007

Hämäläinen, R. P., Luoma, J., & Saarinen, E. (2013). On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems. European Journal of Operational Research, 228(3), 623-634. https://doi.org/10.1016/j.ejor.2013.02.001

Hamilton, S. H., ElSawah, S., Guillaume, J. H. A., Jakeman, A. J., & Pierce, S. A. (2015). Integrated assessment and modelling: Overview and synthesis of salient dimensions. Environmental Modelling & Software, 64, 215-229. https://doi.org/10.1016/j.envsoft.2014.12.005

Hamilton, S. H., Pollino, C. A., Stratford, D. S., Fu, B., & Jakeman, A. J. (2022). Fit-for-purpose environmental modeling: Targeting the intersection of usability, reliability and feasibility. Environmental Modelling & Software, 148, 105278. https://doi.org/10.1016/j.envsoft.2021.105278

Howarth, C., & Anderson, A. (2019). Increasing local salience of climate change: The un-tapped impact of the media-science interface. Environmental Communication, 13(6), 713-722. https://doi.org/10.1080/17524032.2019.1611615

Ishikawa, K. (1990). Introduction to Quality Control (Translator: J.H. Loftus). Productivity Press, New York, USA.

Iwanaga, T., Steinmann, P., Sadoddin, A., Robinson, D., Snow, V., Grimm, V., & Wang, H.-H. (2022). Perspectives on confronting issues of scale in systems modeling. Socio-Environmental Systems Modelling, 4, 18156. https://doi.org/10.18174/sesmo.18156

Iwanaga, T., Wang, H.-H., Hamilton, S. H., Grimm, V., Koralewski, T. E., Salado, A., Elsawah, S., Razavi, S., Yang, J., Glynn, P., Badham, J., Voinov, A., Chen, M., Grant, W. E., Peterson, T. R., Frank, K., Shenk, G., Barton, C. M., Jakeman, A. J., & Little, J. C. (2021a). Socio-technical scales in socio-environmental modeling: Managing a system-of-systems modeling approach. Environmental Modelling & Software, 135, 104885. https://doi.org/10.1016/j.envsoft.2020.104885

Iwanaga, T., Wang, H.-H., Koralewski, T., Grant, W., Jakeman, A., & Little, J. (2021b). Toward a complete interdisciplinary treatment of scale: Reflexive lessons from socioenvironmental systems modeling. Elementa: Science of the Anthropocene, 9(1), 00182. https://doi.org/10.1525/elementa.2020.00182

Jakeman, A. J., Letcher, R. A., & Norton, J. P. (2006). Ten iterative steps in development and evaluation of environmental models. Environmental Modelling & Software, 21(5), 602-614. https://doi.org/10.1016/j.envsoft.2006.01.004

Kéfi, S., Eppinga, M. B., de Ruiter, P. C., & Rietkerk, M. (2010). Bistability and regular spatial patterns in arid ecosystems. Theoretical Ecology, 3(4), 257-269. https://doi.org/10.1007/s12080-009-0067-z

Kelly, R. A., Jakeman, A. J., Barreteau, O., Borsuk, M. E., ElSawah, S., Hamilton, S. H., Henriksen, H. J., Kuikka, S., Maier, H. R., Rizzoli, A. E., van Delden, H., & Voinov, A. A. (2013). Selecting among five common modelling approaches for integrated environmental assessment and management. Environmental Modelling & Software, 47, 159-181. https://doi.org/10.1016/j.envsoft.2013.05.005

Lippe, M., Bithell, M., Gotts, N., Natalini, D., Barbrook-Johnson, P., Giupponi, C., Hallier, M., Hofstede, G. J., Le Page, C., Matthews, R. B., Schlüter, M., Smith, P., Teglio, A., & Thellmann, K. (2019). Using agent-based modelling to simulate social-ecological systems across scales. GeoInformatica, 23(2), 269-298. https://doi.org/10.1007/s10707-018-00337-8

Louie, M. A., & Carley, K. M. (2008). Balancing the criticisms: Validating multi-agent models of social systems. Simulation Modelling Practice and Theory, 16(2), 242-256. https://doi.org/10.1016/j.simpat.2007.11.011

McEvoy, N., & Whitcombe, A. (2002). Structured risk analysis. Infrastructure Security, InfraSec 2002,

Meinen, B. U., & Robinson, D. T. (2021). Agricultural erosion modelling: Evaluating USLE and WEPP field-scale erosion estimates using UAV time-series data. Environmental Modelling & Software, 137, 104962. https://doi.org/10.1016/j.envsoft.2021.104962

Moallemi, E. A., Zare, F., Hebinck, A., Szetey, K., Molina-Perez, E., Zyngier, R., Hadjikakou, M., Kwakkel, J., Haasnoot, M., & Miller, K. K. (2022). Knowledge co-production for decision-making in human-natural systems under uncertainty. https://doi.org/10.5281/zenodo.7426011

Moallemi, E. A., Zare, F., Reed, P. M., Elsawah, S., Ryan, M. J., & Bryan, B. A. (2020). Structuring and evaluating decision support processes to enhance the robustness of complex human–natural systems. Environmental Modelling & Software, 123, 104551. https://doi.org/10.1016/j.envsoft.2019.104551

Modell, S. (2009). Institutional research on performance measurement and management in the public sector accounting literature: A review and assessment. Financial Accountability & Management, 25(3), 277-303. https://doi.org/10.1111/j.1468-0408.2009.00477.x

Müller, B., Bohn, F., Dreßler, G., Groeneveld, J., Klassert, C., Martin, R., Schlüter, M., Schulze, J., Weise, H., & Schwarz, N. (2013). Describing human decisions in agent-based models – ODD + D, an extension of the ODD protocol. Environmental Modelling & Software, 48, 37-48. https://doi.org/10.1016/j.envsoft.2013.06.003

Nabavi, E., Daniell, K. A., & Najafi, H. (2017). Boundary matters: the potential of system dynamics to support sustainability? Journal of Cleaner Production, 140, 312-323. https://doi.org/10.1016/j.jclepro.2016.03.032

Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. Science, 325(5939), 419-422. https://doi.org/doi:10.1126/science.1172133

Patten, B. C. (1971). A primer for ecological modeling and simulation with analog and digital computers (Vol. 1). Academic Press.

Podestá, G. P., Natenzon, C. E., Hidalgo, C., & Ruiz Toranzo, F. (2013). Interdisciplinary production of knowledge with participation of stakeholders: A case study of a collaborative project on climate variability, human decisions and agricultural ecosystems in the Argentine Pampas. Environmental Science & Policy, 26, 40-48. https://doi.org/10.1016/j.envsci.2012.07.008

Razavi, S., Jakeman, A., Saltelli, A., Prieur, C., Iooss, B., Borgonovo, E., Plischke, E., Lo Piano, S., Iwanaga, T., Becker, W., Tarantola, S., Guillaume, J. H. A., Jakeman, J., Gupta, H., Melillo, N., Rabitti, G., Chabridon, V., Duan, Q., Sun, X., Smith, S., Sheikholeslami, R., Hosseini, N., Asadzadeh, M., Puy, A., Kucherenko, S., & Maier, H. R. (2021). The future of sensitivity analysis: An essential discipline for systems modeling and policy support. Environmental Modelling & Software, 137, 104954. https://doi.org/10.1016/j.envsoft.2020.104954

Reed, M. S. (2008). Stakeholder participation for environmental management: A literature review. Biological Conservation, 141, 2417-2431. https://doi.org/10.1016/j.biocon.2008.07.014

Refsgaard, J. C., & Henriksen, H. J. (2004). Modelling guidelines––terminology and guiding principles. Advances in Water Resources, 27(1), 71-82. https://doi.org/10.1016/j.advwatres.2003.08.006

Robinson, S. (1997, 7-10 December 1997). Simulation model verification and validation: Increasing the users' confidence. Proceedings of the 1997 Winter Simulation Conference, Atlanta, GA.

Rykiel, E. J. (1996). Testing ecological models: the meaning of validation. Ecological Modelling, 90(3), 229-244. https://doi.org/10.1016/0304-3800(95)00152-2

Saltelli, A., Jakeman, A., Razavi, S., & Wu, Q. (2021). Sensitivity analysis: A discipline coming of age. Environmental Modelling & Software, 146, 105226. https://doi.org/10.1016/j.envsoft.2021.105226

Sargent, R. (2008). Verification and validation of simulation modelling. Proceedings of the 2008 Winter Simulation Conference, New York, NY.

Schils, R. L. M., van Voorn, G. A. K., Grassini, P., & van Ittersum, M. K. (2022, 2022/01/01/). Uncertainty is more than a number or colour: Involving experts in uncertainty assessments of yield gaps. Agricultural Systems, 195, 103311. https://doi.org/10.1016/j.agsy.2021.103311

Schmolke, A., Thorbek, P., DeAngelis, D. L., & Grimm, V. (2010). Ecological models supporting environmental decision making: a strategy for the future. Trends in Ecology & Evolution, 25(8), 479-486. https://doi.org/10.1016/j.tree.2010.05.001

Sitas, N., Ryan, P., & Schultz, L. (2021). Systems scoping. In R. Biggs, A. de Vos, R. Preiser, H. Clements, K. Maciejewski, & M. Schlüter (Eds.), The Routledge Handbook of Research Methods for Social-Ecological Systems (pp. 83-94). Routledge. https://doi.org/10.4324/9781003021339

Trébuil, G., Bousquet, F., Ekasingh, B., Baron, C., & Le Page, C. (2005). A multi-agent model linked to a GIS to explore the relationship between crop diversification and the risk of land degradation in northern Thailand highlands. In F. Bousquet, G. Trébuil, & B. Hardy (Eds.), Companion modeling and multi-agent systems for integrated natural resource management in Asia (pp. 167-190). International Rice Research Institute.

Turner, M., Gardner, R., O'neill, R., Gardner, R., & O'Neill, R. (2001). Landscape ecology in theory and practice (Vol. 401). Springer.

van Delden, H., van Vliet, J., Rutledge, D. T., & Kirkby, M. J. (2011). Comparison of scale and scaling issues in integrated land-use models for policy support. Agriculture, Ecosystems & Environment, 142(1), 18-28. https://doi.org/10.1016/j.agee.2011.03.005

van Voorn, G. A. K., Verburg, R. W., Kunseler, E. M., Vader, J., & Janssen, P. H. M. (2016). A checklist for model credibility, salience, and legitimacy to improve information transfer in environmental policy assessments. Environmental Modelling & Software, 83, 224-236. https://doi.org/10.1016/j.envsoft.2016.06.003

Voinov, A., & Bousquet, F. (2010). Modelling with stakeholders. Environmental Modelling & Software, 25(11), 1268-1281. https://doi.org/10.1016/j.envsoft.2010.03.007

Wagener, T., Boyle, D. P., Lees, M. J., Wheater, H. S., Gupta, H. V., & Sorooshian, S. (2001). A framework for development and application of hydrological models. Hydrology and Earth System Sciences, 5(1), 13-26. https://doi.org/10.5194/hess-5-13-2001

Wang, H.-H., & Grant, W. E. (2021). Reflections of two systems ecologists on modelling coupled human and natural (socio-ecological, socio-environmental) systems. Ecological Modelling, 440, 109403. https://doi.org/10.1016/j.ecolmodel.2020.109403

Wernz, C., & Deshmukh, A. (2012). Unifying temporal and organizational scales in multiscale decision-making. European Journal of Operational Research, 223(3), 739-751. https://doi.org/10.1016/j.ejor.2012.06.038

Wu, J., & Li, H. (2006). Concepts of scale and scaling. In J. Wu, K. B. Jones, H. Li, & O. L. Loucks (Eds.), Scaling and uncertainty analysis in ecology (pp. 3-15). Springer.

Zare, F., Guillaume, J. H. A., & Jakeman, A. J. (2019). Constructing customized modelling guidelines: A participatory integrated assessment and modelling example. 23rd International Congress on Modelling and Simulation, Canberra, Australia.

Zare, F., Guillaume, J. H. A., ElSawah, S., Croke, B., Fu, B., Iwanaga, T., Merritt, W., Partington, D., Ticehurst, J., & Jakeman, A. J. (2021). A formative and self-reflective approach to monitoring and evaluation of interdisciplinary team research: An integrated water resource modelling application in Australia. Journal of Hydrology, 596, 126070. https://doi.org/10.1016/j.jhydrol.2021.126070

Zare, F., Guillaume, J. H. A., Jakeman, A. J., & Torabi, O. (2020). Reflective communication to improve problem-solving pathways: Key issues illustrated for an integrated environmental modelling case study. Environmental Modelling & Software, 126, 104645. https://doi.org/10.1016/j.envsoft.2020.104645

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2023 Hsiao-Hsuan Wang, George van Voorn, William E. Grant, Fateme Zare, Carlo Giupponi, Patrick Steinmann, Birgit Muller, Sondoss Elsawah, Hedwig van Delden, Ioannis N. Athanasiadis, Zhanli Sun, Wander Jager, John C. Little, Anthony J. Jakeman