Generic selectors
Exact matches only
Search in title
Search in content
Search in posts
Search in pages

Top 10 Tips to Engage People with a System Dynamics Model

Top 10 Tips to Engage People with a System Dynamics Model

Andrew P. Jones is Co-Founder and Co-Director of Climate Interactive and a Research Affiliate at MIT Sloan. Andrew is an expert on climate change and energy issues, a prominent System Dynamics modeler, and a keynote speaker.

In his webinar with System Dynamics Society, Jones presented his 10+1 tips to engage people with a System Dynamics model. Here’s a summary of the tips, but you can watch the recording below for all details!

All Seminar Series are free for members of the Society. Join us today and unlock all benefits!

1. Make it a challenging adventure on their terms in your virtual world
Make your model playful to entice curiosity about what it tests. This is a virtual world where people will experience something new. The challenging adventure or game is what we do mostly with the interface of the model. If you open the En-ROADS interface, you will see two main graphs, the main output, and several sliders. When playing with the sliders, your changes will be reflected in the graphs. Avoid telling people: “I’m going to show you how to do this”, instead, try saying: “On your terms, you’re going to have to figure out how to get that graph down to your target line”

“We do NOT model systems. We model problems.

2. Focus on mental models you want to improve
We do NOT model systems. We model problems. In System Dynamics, we define a problem as a behavior over time, a reference mode that we’re curious about why does it behave like that. We’re so curious about the problem that we develop a simulation to understand it. We build interfaces to improve the mental models of the stakeholders or clients. System Dynamics modelers know that mostly the mental models of decision-makers don’t match with the real world and how the actual system behaves. We don’t build interfaces to give access to policy levers in the system, but we are trying to leverage the necessary mental model improvements.

3. Make participants mentally simulate before running a scenario
If people don’t have a theory, they don’t notice the mental model they use to forecast what’s going to happen. Then they don’t get to learn and improve their understanding. Therefore, you must encourage people to anticipate, based on their own theories, what’s going to happen when running a scenario. No theory, no learning.” (Edward Deming)

“Tell people what to look at, let them guess what they are going to see, and then make it exciting like a movie”

4. Create a dynamic visual experience
Humans like to see change and it is important to employ this fact to get people to run and look at your graphs without losing their focus. Make people think and anticipate and then direct their eyes to what you want them to notice. If you do this well, you don’t even need to draw a Causal Loop Diagram because they are drawing it in their heads. Tell people what to look at, let them guess what they are going to see, and then make it exciting like a movie.

5. Set up participants to talk with each other
People learn socially and with hot-button issues like climate change, they need to know that their friends are not going to hate them if they change their minds. You need people to be processing the information collectively and socially with others. When presenting your model, stop frequently and advise: “Turn to the person next to you and discuss what you think of that conclusion”.

“Keep the discussion on improving system performance not on the tool you’re using”

6. Know along the way that you are playing at least seven roles

Try to present your model with the help of, at least, another person. Ideally, you need someone to facilitate the discussion while another runs the model. As a facilitator, you will be playing four roles including:

Coach – Helping participants to extract insights out of the model.
Professor – Teaching the audience theories and sharing factual information
Playwright – Creating an emotional journey of ups and downs.
Fellow Traveler – Being authentic, vulnerable, and just another person trying to solve a complex problem. If it is worth making a model about, it’s very important. If it is very important, you must deeply care about it.

You want the conversation to be around how to solve a complex problem together and what your audience is going to do about it. Keep the discussion on improving system performance not on “oh that’s a cool model how did you make that”. That’s all side information.

You want to minimize your roles in:
Tech – you must keep the conversation on improving the system performance, not the way or tool you have used to develop the model or create the graphs
Advocate – when people disagree with you, your job is not to fight them or disagree with them back, but to set up others to find the voice of your work.
Defender – Don’t get involved in the fight of “YOU HAVE A BAD MODEL!”. Avoid this fight as much as you can.

Read the article “Teamwork in Group Model Building” on the System Dynamics Review for more insights on strategies for efficient and effective model building in groups.

7. Build confidence and share testing as needed

You can share your tests and comparisons to other models and/or predictions to build stronger confidence. For instance, Climate Interactive and MIT Sloan built the En-ROADS with the best science available, using the data sources such as the Intergovernmental Panel on Climate Change (IPCC) and International Energy Agency. All the assumptions are available open-source in the 400-page reference guide. Many of the assumptions that someone might not believe in are changeable within the model. Several models do not have good literature of other scenarios to compare against, while En-ROADS can be compared with six integrated assessment models to build confidence.

8. Use loops and stock/flow diagrams only to illuminate
As you help people improve their intuition, sometimes you need to use loops and stock/flow diagrams, especially if you are presenting to a more technical audience but always connect it to the simulator. Avoid showing this to policymakers, they are usually not interested in the loops, instead, tell a story about reinforcing or balancing feedback.

9. Make space for feelings and processing

Deliver your presentation with excitement and intensity, but you need to slam on the brakes and let participants compromise with their feelings and do the necessary processing. You may create a scenario of success, and they get to create their vision, something that they would love to see. And it’s time to slam on the brakes and may invite them to 60 seconds of silence. Yes! It is weird but imagine 60 seconds of silence of people sitting with a scenario of success.

“Create the conditions where people are open to changing their minds”

10. Pay attention to three legs of the learning stool
Reflective Conversation – Create the conditions where people are open to changing their minds, surfacing and testing assumptions, and talking to their peers about improving their assumptions. You’ve got to make the space where people are open to being wrong and thinking differently.

Vision – Help people see a future that they fall in love with they just want it so badly that they see the gap between the vision they want and the reality that they feel and experience that tension in between. Orient towards what one genuinely cares about.

Systems Thinking – Explaining how a complex system works where time, cause, and effect are distant in time and space can be difficult, especially when you include stocks, flows, feedback loops, and other inner relationships. You can learn how to facilitate a training that uses systems thinking and System Dynamics for free with Climate Interactive learning resources

10 + 1. Give them the simulator

People need your help as a facilitator, but you must give them something to play with that naturally gives them the mental model improvements that you want and guides them towards committing themselves to action to improve system performance. As Buckminster Fuller states “If you want to teach people a new way of thinking, don’t bother trying to teach them. Instead, give them a tool, the use of which will lead to new ways of thinking.”

Watch the recording below

Whoops, this recording is available for members only. If you have a membership, please log in. If not, you can definitely get access! Purchase a membership here. If you're not a member but have purchased a ticket to this webinar, please contact us at office@systemdynamics.org

Recent Posts

ISDC 2021 Highlights: Tackling Structural Racism with Modeling

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

Housing Dynamics

Housing Dynamics We had an insightful conversation with David Stroh, Martijn Eskinasi, and Kaveh Dianati at our latest seminar. We learned about how using causal loop diagrams based on simple archetypes, illuminate interdependencies across housing availability, wealth...

Upcoming Events

Recent Business cases

General Motors OnStar

Name The General Motors OnStar Project Modelers Vince Barabba, Chet Huber, Fred Cooke, Nick Pudar, Jim Smith, Mark Paich Client General Motors Client Type Corporation The Official Website onstar.com is the official website in which you can become a member, get...

Pharmaceutical Product Branding Strategies

Pharmaceutical Product Branding Strategies Name Pharmaceutical Product Branding Strategies — Simulating Patient Flow and Portfolio Dynamics Modelers Mark Paich, Corey Peck, Jason Valant Contact Jason Valant or Corey Peck Client Numerous Pharmaceutical Companies Client...

Polio Eradication

Polio Eradication Name Polio Eradication Modelers Kimberly M. Thompson,and Radboud J. Duintjer Tebbens Client World Health Organization (WHO) Client Type NGO The Issue You Tackled Following successful eradication of smallpox and impressive progress in the elimination...

Join us

The Effect of Institutional Quality on Economic Growth

Free for Members | $25 for non-members.

11 am New York | 4 pm London | 6 pm Johannesburg | 11 pm Beijing

The purpose of this webinar is to present a macroeconomic framework that identifies the structure of institutional quality in developing countries and their linkages to economic growth and income distribution. The objective is to identify leverage points related to institutional quality that can be addressed and thereby, help to optimize policy options that enhance and sustain economic growth.

Dr. Aman Ullah holds a Ph.D. in Public Policy from the University of Auckland, New Zealand, and an M.Phil. in Economics from Quaid-i-Azam University. He is the author of several Publications and recipient of many scholarships and grants. Currently, Dr. Aman is serving as Joint Chief Economist for the Planning and Development Board, Government of Punjab, and holding the position of Senior Research Fellow, Pakistan Institute of Development Economics, Government of Pakistan. Dr. Aman has held various important positions at the P&D Board including Chief Economist and Director of Punjab Economic Research Institute. Before joining the Government of Punjab, he has worked with the Planning Commission of Pakistan for many years.

Ivan Taylor has been a member of the System Dynamics Society since 1997 and is active as a conference paper peer reviewer and a one-on-one mentor. He has a Ph.D. in Public Policy and a Masters in Information and Systems Science. He retired from the Center for Operational Research of Defence Research and Development Canada in 2012 after more than 33 years and has spent his time since then working exclusively with System Dynamics.

Seminars are free for 2021 System Dynamics Society Members and Subscribers. Join or Renew today to unlock all benefits.

Make sure you log in to get the discount.

Women in System Dynamics: Experiences of a Diverse Panel

Inge Bleijenbergh

Inge Bleijenbergh

She’s an expert in participatory action research, facilitated modeling, gender and diversity and policy change. She uses modeling to involve decision makers in analyzing and addressing complex problems.

Krystyna Stave

Krystyna Stave

Krys is a professor of Environmental Studies at UNLV. She uses a systems perspective in her research and teaching to promote sustainable environmental management and increase public participation in decision-making.

Nasim Sabounchi

Nasim Sabounchi

She’s a Research Associate Professor at the City University of New York (CUNY) Graduate School of Public Health and Health Policy where she is also affiliated with the Center for Systems and Community Design (CSCD).

Min Xiang

Min Xiang

After working in the Middle East for 3 years, I resigned and came to the University of Bergen to study System Dynamics, which was one of the best decisions I have ever made. 

Laura Guzmán

Laura Guzmán

She’s a System Dynamics lecturer of the Department of Industrial Engineering at Universidad de Los Andes. Her work focuses on decision-making processes and engineering designs with a participatory and systemic perspective. She has carried out System Dynamics projects with public sector entities, international organizations, and universities.

Free for Members | $25 for non-members.

12 pm New York | 5 pm London

System dynamics is a male-dominated field but has become more diverse in recent years. The System Dynamics Society aims to be inclusive, address sexism and racism, and promote diversity within the global community. This seminar will allow women in the System Dynamics field from different geographical backgrounds and at different career levels to reflect upon their experiences. What do they recognize in each other’s experiences? What advice would they give to students and colleagues? We aim for an open and constructive discussion with all participants!

Seminars are free for 2021 System Dynamics Society Members and Subscribers. Join or Renew today to unlock all benefits.

Make sure you log in to get the discount.

Applied System Dynamics for Students and Beginners

Free for Members | $25 for non-members.

12 pm New York | 4 pm London | 6 pm Johannesburg | 12 am Beijing

Several guidelines on the System Dynamics modeling process are found in the literature. While these are rigorous, we have experienced challenges in the use of these existing guidelines in practice, especially where implementation based on the modeling results is critical. In this seminar, we will take you through an integrated system dynamics modeling process which is based on the customized process followed by Eskom SOC with specific elements from the Sustainable Development Programme at Stellenbosch University and Dynamic Strategies. We will also cover the do’s and don’ts when it comes to validation and calibration.

Visit the South African Chapter Website

Seminars are free for 2021 System Dynamics Society Members and Subscribers. Join or Renew today to unlock all benefits.

Make sure you log in to get the discount.

Group Model Building Online: Experiences and Insights

All Seminar Series Webinars are free for System Dynamics Society members. Join or Renew today and unlock all membership benefits.

11 am New York | 4 pm London | 12 am Beijing

Birgit Kopainsky | Anaely Aguiar | Brooke Wilkerson | Christina Gkini | Lars-Kristian Lunde Trellevik

When COVID-19 hit almost a year ago, we, a group of researchers at the University of Bergen in Norway, decided to take the leap and run a planned in-person Group Model Building workshop online on fairly short notice. Encouraged by the positive outcomes of this initial event, we have since experimented with several more online activities. In this seminar, we will share our experiences so far, demonstrate some of the online tools and templates that we have been developing, and exchange tips and tricks with seminar participants.

Seminars are free for 2021 System Dynamics Society Members and Subscribers. Join or Renew today to unlock all benefits.

Make sure you log in to get the discount.

 

Group Model Building Online: Experiences and Insights Seminar

All Seminar Series Webinars are free for System Dynamics Society members. Join or Renew today and unlock all membership benefits.

11 am New York | 4 pm London | 12 am Beijing

When COVID-19 hit almost a year ago, we, a group of researchers at the University of Bergen in Norway, decided to take the leap and run a planned in-person Group Model Building workshop online on fairly short notice. Encouraged by the positive outcomes of this initial event, we have since experimented with several more online activities. In this seminar, we will share our experiences so far, demonstrate some of the online tools and templates that we have been developing, and exchange tips and tricks with seminar participants.

Seminars are free for 2021 System Dynamics Society Members and Subscribers. Join or Renew today to unlock all benefits.

Make sure you log in to get the discount.

 

Anaely Aguiar

Anaely Aguiar

Birgit Kopainsky

Birgit Kopainsky

Brooke Wilkerson

Brooke Wilkerson

Christina Gkini

Christina Gkini

Lars-Kristian Trellevik

Lars-Kristian Trellevik

Modeling for Implementation: an Illusion of Control?

Modeling for Implementation: an Illusion of Control?

Every so often, I see someone in our field drawing attention to the fact that many client-based system dynamics modeling projects do not lead to effective implementation of their findings, and they wonder what can be done to fix this problem.  This is not a new idea, but rather one that has been expressed for more than 40 years.

The first important example was Ed Roberts’ 1977 paper, “Strategies for effective implementation of complex corporate models”, which advocated extensive client involvement, substantive real-world detail and metrics in the model, actionable findings, and supporting the client team into the implementation phase. 

Thirty years later, in 2007, came an even more assertive article from Andreas Grössler, “System dynamics projects that failed to make an impact” (System Dynamics Review 23:4). Grössler argues that System Dynamics projects should be viewed as nothing less than organizational interventions, involving both analysis and action planning. He asks for more research to be done on how modeling can be smoothly integrated into large-scale organizational change efforts.  

Jorgen Randers later amplified this message in his 2019 paper, “The great challenge for system dynamics on the path forward: implementation and real impact” (System Dynamics Review 35:1). Randers says that we need to focus much more on the question of implementation and to develop an effective implementation methodology to stand alongside our modeling methodology.

These are important thoughts on implementation, and I do not doubt the authors when they point to cases of successful implementation as evidence that we can do better.  I must confess, however, that I get uncomfortable when someone speaks of modeling as merely the lead-in to the broader task of organizational change.  I ask myself, “Have I not set my sights high enough?  Why can I not see beyond today’s modeling to the more profound organizational reverberations to follow?”  

But this is silly. Over more than 30 years of private and public sector consulting (often side by side with major-league consulting firms), I have never witnessed profound organizational change happening, not even with longtime clients. I have never expected that any of my models would lead to a cascading change of organizational structure or culture. I really only expect to complete a high-quality model that the client finds useful and clear.

Why would I expect more than that? What ends up happening after the model is completed is largely out of my hands.  I was not trained in organizational intervention, and even those who do claim expertise have a mixed track record.

I have decided that it is sufficient to do a good job of System Dynamics modeling for the client without any particular expectation of implementation afterward. Developing a useful model takes all of my attention. Neither the client nor I can know with certainty what the next step will be after the current modeling project is complete, nor in fact whether this work will continue to be supported by the organization.

So, to answer the question in this blog’s title—yes, I would say that a System Dynamics modeler who believes he or she knows how to maximize the chances of implementation is under an illusion of control. Changing an organization is an incredibly difficult undertaking, and it seems presumptuous to think that one’s modeling skills extend into social engineering or executive leadership. 

I plan to stick with my only real skill set, which is modeling for clients, and to keep trying to do a better job of it. The only way I “model for implementation” is by satisfying the client and putting them in a position to take a more confident next step, whatever it may be.

Recent Posts

ISDC 2021 Highlights: Food “Wickedness”

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

ISDC 2021 Highlights: Tackling Structural Racism with Modeling

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

Housing Dynamics

Housing Dynamics We had an insightful conversation with David Stroh, Martijn Eskinasi, and Kaveh Dianati at our latest seminar. We learned about how using causal loop diagrams based on simple archetypes, illuminate interdependencies across housing availability, wealth...

Upcoming Events

En-Roads: an online Climate Action Simulation

En-Roads: an online Climate Action Simulation

SYDIC is proud to announce the “En-Roads: an online Climate Action Simulation” workshop, that will be held on 21-22 September 2021 on the occasion of the “#All4Climate – Italy 2021” manifestation, promoted by the Italian Ministry for Ecological Transition (MiTE), and...

Recent Business cases

General Motors OnStar

Name The General Motors OnStar Project Modelers Vince Barabba, Chet Huber, Fred Cooke, Nick Pudar, Jim Smith, Mark Paich Client General Motors Client Type Corporation The Official Website onstar.com is the official website in which you can become a member, get...

Pharmaceutical Product Branding Strategies

Pharmaceutical Product Branding Strategies Name Pharmaceutical Product Branding Strategies — Simulating Patient Flow and Portfolio Dynamics Modelers Mark Paich, Corey Peck, Jason Valant Contact Jason Valant or Corey Peck Client Numerous Pharmaceutical Companies Client...

Polio Eradication

Polio Eradication Name Polio Eradication Modelers Kimberly M. Thompson,and Radboud J. Duintjer Tebbens Client World Health Organization (WHO) Client Type NGO The Issue You Tackled Following successful eradication of smallpox and impressive progress in the elimination...

Join us

Webinar Q&A | Local Level COVID Models

Webinar Q&A | Local Level COVID Models

We had an insightful Webinar with the participation of The COVID 19 Localisation Modelling Group. Kim Warren and Maurice Glucksman and the formidable youth Farrah Farnejad, Quinn Kennedy, Harshita Magroria, and Brahmani Nutakki joined us for a great discussion about the positive impacts of using a localized System Dynamics model to understand COVID realities locally.

You can watch the webinar recording here and download the presentation here. And don’t forget to check the Understanding Your Local COVID-19 Outbreak FREE course that allows you to apply the model to your own locality!

Here are the answers to questions asked live during the Webinar. Please refer to the event page to get more information about the project.

Learn more about the Seminar Series.

Q&A Webinar Local Level COVID Models: Bringing Youth to the Table

Answers by Kim Warren and Maurice Glucksman

  1. Do any of the models consider bigger system impacts on the health of the community and the economy?

These are big important issues but beyond the scope of what we are doing. Our work on mass localizing is starting to address some of the macro issues but only as it relates to the pandemic. Our collaboration with the Emergent Alliance is aimed at wider societal impacts on this and Kim especially is currently engaged with the NHS on Mental Health issues as they relate to the wider impact of COVID-19.

  1. Can you repeat what equation you used to graph/visualize the map?

The data we use comes from publicly available sources that produce the maps.

  1. How can this model help decision-makers make better decisions?

Good question.  We deliberately focused on young people who are captains of their ship and uniquely in this pandemic their actions and decisions are very important for reducing the impact on others through asymptomatic transmission  — even though as a group they are less directly impacted because of severe illness and death in young people is a tiny fraction of older people. So if you define decision-makers as the largest group of people impacting others then it’s very big and it is starting to percolate through the schools and social networks. If you define decision-makers as the traditional healthcare policy organizations it could also be big but not yet.

  1. What data needs to be available to fit a localized model?

Simply 10-year age-group population numbers, and daily series for reported cases, deaths, and hospital cases. You also make estimates of some localization-specific differences. This is all documented in our free webinars and course.

  1. What do the models tell us about the longer-term outlook?

The models tell us radically different stories for every local area and the story is hugely uncertain because of reinfections and mutations. In some cases, the pandemic is over, as the slums of Mumbai, Here in London we are just getting started but vaccines might save us. There is no one story except that you can’t analyze or manage the pandemic well at a national or even state level.

  1. Can we see the model structures? What software did you use?

This is all freely available and documented in our webinars and course.

  1. Quinn — Did you update the model based on your learning to see if you could successfully predict what happened from Jul-Dec 2020 case? And what policies would you recommend going forward?

You need to ask Quinn – will pass this to him. We are constantly revising the model as new information comes in. The pace of revisions has slowed but continues.

  1. Could this be applied to other areas of concern say Climate Change or Food Security to demonstrate inequities?

We have used the principle of localization in Supply Chain, Operations, Marketing, Sales, Strategy so we know it is widely applicable. Issues like Climate change are global by their nature. However, our approach can certainly be used to tackle widely-found environmental challenges – a generic model of common issues, easily configurable to specific local conditions. Others in our field are doing great work on such issues!

  1. Does the definition of local ever change because of events?

Yes. If you look at historical examples of pandemics the maps show each pandemic is a dynamic self-organizing animal without a brain flowing like a swollen river breaking through its banks and spreading out across the landscape influenced by topography, demographics, infrastructure. Inevitably the definition of a local area changes as that happens. Our challenge as analysts is to select a local area that is stable enough to get insights about policies that will help.

  1. How are you defining youth? Including young adults?  What’s the age range?

See question 3.  Youth is our focus because they are important and have been disenfranchised in the pandemic. There is no barrier for anyone of any age to use the models.

  1. Do any of the models include vaccinations and their consequences?

Yes. You can see examples of this analysis in the Westminster presentation.

  1. Farrah — You did a fantastic job. When calibrating your model what data did you find most difficult to find and you missed the most?

You have to ask Farrah! I will pass the question to her but short of that in our Webinars, we go through the data quality issues in detail. The least reliable data is paradoxically the most widely reported: new cases. This is perhaps partly why unfortunately there are so many problems managing the pandemic — it’s like trying to drive your car by looking at google maps on your phone with bad reception and ignoring the view of the road outside. Opportunities for misinterpretation are constant. Death rates are mostly more reliable, but still under-reported to varying degrees, often substantial! The most reliable information is seroprevalence surveys – but these are very occasional [no daily time-series] These allow us to ‘back into’ what must be happening with the stock of susceptible and total stock of infected people. The WHO, CDC, etc will tell you these are the key high leverage drivers of strategy and management of the pandemic but rarely if ever reported.

  1. Have local public health authorities and policymakers who have an influence on policies that affect these communities been involved in the discussion of these results?

This has been limited so far partly because of our focus on young people who have to work hard to win the trust of authorities before their views are taken into account, but it has started to percolate through in surprising ways and we are optimistic that over time the Greta Thunberg effect may take hold in the pandemic.

  1. Many people think that a more effective vaccine is better for them. Is there any way to show that a more rapid roll-out of a less effective vaccine is of greater benefit to everyone?

Farrah is working on a one vs two-dose strategy for Westminster and other boroughs in London. Our working hypothesis is there is no one-size-fits-all strategy. To see why it’s useful to do a thought experiment imagining two districts right next to each other (like Mumbai) where one district has many susceptible people and the other hardly any. The best dosing strategy in these two districts is highly unlikely to be the same.

  1. Can this be broadened to be a ‘system of systems’ where local models are threaded together to look at the local effects, compounded together / interacting?

This is one objective of the ‘mass localization’ project we are working on now.   There will be ‘meta’ interactions between locations that we can’t see working from one location.  It’s the forest for the parable of the trees.

  1. Good to have such a worldwide community for modeling important material

The insights from every location are informing the others. We believe this is very powerful and we hope it is creating an enduring network between young people that would never have developed otherwise.

  1. This is impressive work by the young team led by Prof. Kim. The model has been validated or not?

The model has been validated in dozens of locations globally and provides good insights into radically different locations. Data quality is always a major issue.  Validation is ongoing updating parameters as new mutations emerge and regional differences in the proportion of asymptomatic infections as well as the varying impact of differing vaccines. Occasionally new structures emerge — a good example is a migration that occurred last summer in the Dharavi slum — we could not replicate the pandemic outbreak without allowing half the population to leave the slum. Our belief is no possibility of correctly validating any model of the pandemic that is not local and not developed in collaboration with people actually living in that location or at the very least with excellent access to people who are living there. 

  1. We see so much data on a daily basis, without it being connected in the way models such as this work. Do we feel there would be a benefit if models such as these were more widely shared, and what may those benefits be? 

Tough question… we don’t know. We are sharing our work as open-source with the hope that it will help. The evidence is it has helped our students. They have spoken in this presentation about how the modeling helps them not only understand the pandemic but it has spilled over into other areas in their educations and the way they think about the world. Whether that will have long-term benefits it’s hard to say. I think from our perspective, working on this project has helped us stay sane in what would otherwise be mind-numbingly boring lockdowns, and from a selfish perspective has been a great learning experience and a great way to mobilize our personal networks to have a positive impact on society.

  1. Maurice & Kim – great work! Any tips on how to engage youth effectively?

Thank you. Many tips but mainly motivation. Our key resource was paradoxically having Covid 19 as a research assistant — that motivated all of us to try to solve this and we learned a great deal from the virus about how to make a problem-solving effort viral. It may be possible to leverage other networks, e.g. teachers, but they have had other pressures from COVID.

  1. Wondering about the potential of applying this localization principle could be applied to Doughnut Economic metrics linking social foundation metrics with ecological ceiling metrics to demonstrate complex relationships.

Apparently, donughts are a big reason why diabetes is a major global issue — that’s a complex chain of interaction we can blame on runnin’ on Dunkin’ and Krispy Kreme 😉

  1. Could use it for predicting the new COVID variant found out in Amazonas, Brazil?

We are working with Guttenberg Ferreira Passos and Niraldo Nascimento right now. Suggest you reach out to them and get involved. Let us know if you need us to connect you.

  1. How does System Dynamics modeling compare to Agent-Based Modelling of infection?

We are not agent-based modeling experts but have an amateur understanding of how they work. Agent-based models are excellent for understanding the dynamics of disease transmission – especially for geospatial patterns – because the agents capture the infection pathways and can show emergent dynamics you might miss if you are working only with and SEIR Stock and flow. I believe they are complementary and both offer insight.

  1. How have you raised awareness and gained interest in System Dynamics (COVID) modeling across institutions and what’s next?

We have worked like hell to generate awareness and I would say its early days but the signs are positive. Our work with the NHS in the UK, MIT students in the MISTI program, engagement with Junior Achievement, and most recently the Emergent Alliance are good lead indicators but we can do much more.

  1. Lockdowns serve to restrict the movement between locales and thereby enhance the relevance of the model

Lockdowns, shielding of vulnerable, hygiene measures, testing and tracing policies, vaccines, hospital capacity are amongst the policy levers directly available.

  1. The final model appears to use Silico. What is this?

Silico is a relatively new System Dynamics Simulation software package. We use it because it is free for personal use as long as you are happy to share your model as an open-source resource, it is easy to teach and use and very intuitive… check it out in our webinars and course. Check their website.

Recent Posts

ISDC 2021 Highlights: Tackling Structural Racism with Modeling

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

Housing Dynamics

Housing Dynamics We had an insightful conversation with David Stroh, Martijn Eskinasi, and Kaveh Dianati at our latest seminar. We learned about how using causal loop diagrams based on simple archetypes, illuminate interdependencies across housing availability, wealth...

Upcoming Events

En-Roads: an online Climate Action Simulation

En-Roads: an online Climate Action Simulation

SYDIC is proud to announce the “En-Roads: an online Climate Action Simulation” workshop, that will be held on 21-22 September 2021 on the occasion of the “#All4Climate – Italy 2021” manifestation, promoted by the Italian Ministry for Ecological Transition (MiTE), and...

Recent Business cases

General Motors OnStar

Name The General Motors OnStar Project Modelers Vince Barabba, Chet Huber, Fred Cooke, Nick Pudar, Jim Smith, Mark Paich Client General Motors Client Type Corporation The Official Website onstar.com is the official website in which you can become a member, get...

Pharmaceutical Product Branding Strategies

Pharmaceutical Product Branding Strategies Name Pharmaceutical Product Branding Strategies — Simulating Patient Flow and Portfolio Dynamics Modelers Mark Paich, Corey Peck, Jason Valant Contact Jason Valant or Corey Peck Client Numerous Pharmaceutical Companies Client...

Polio Eradication

Polio Eradication Name Polio Eradication Modelers Kimberly M. Thompson,and Radboud J. Duintjer Tebbens Client World Health Organization (WHO) Client Type NGO The Issue You Tackled Following successful eradication of smallpox and impressive progress in the elimination...

Join us

Local Level COVID Models: Bringing Youth to the Table

11 am New York | 4 pm London | 12 am Beijing

Across the world, citizens are being told what to do about Coronavirus by experts and politicians, with no understanding of what is happening or what is best to do around them. And those conditions can be highly localized, with infection and death rates differing by multiples just across the street. Young people, in particular, are disenfranchised by this approach, even though they play a key role in the pandemic. This webinar describes an accessible COVID model that can be readily localized to any specific area – large or small. It will describe unique findings – generated by young people with no prior experience – for Delhi, distinct parts of Mumbai, London, and New York/Bronx. It will conclude with wider implications for localizing System Dynamics models and for youth-engagement.

About the presenters:

Maurice Glucksman is currently Co-Lead Architect, The COVID 19 Localisation Modelling Group he founded with Dr. Kim Warren in March 2020 aiming to democratize COVID 19 modeling with an emphasis on quantifying and managing risk in local areas to especially help young people become confident advocates for risk assessment positive policy change in the pandemic.   He is now also an active investor and was Director of Research for Hamilton Ventures a Merchant Bank and Stockbroker Strenuus Capital. He also was a leader of the Business Dynamics group at McKinsey & Co a consultant with Pugh Roberts Associates and practiced Naval Architecture for 3 years between Business and Engineering degrees at MIT and the University of Michigan.

Kim Warren is the co-founder and director of Strategy Dynamics and former president of the System Dynamics Society. He’s an experienced strategy professional, teacher, and publisher of online courses and resources on business modeling. He held senior strategy roles in several industries, from petrochemical to brewing. He taught at the London Business School on MBA and Executive programs for long years and developed the powerful strategy dynamics frameworks for designing and managing enterprise strategy. Kim’s work on modeling business plans and issues has spanned cases in several businesses across the world. He’s the author of the prize-winning Competitive Strategy Dynamics and teaches at the Worcester Polytechnic Institute and the Vienna University of Economics and Business.

Farrah Farnejad is a student at Queen Mary University of London who won the COVID 19 Youth Modelling Competition and has developed a model of the borough of Westminster and wrote an article with the COVID 19 Localisation Modelling Group on the impact of the new Covid 19 mutation.

Quinn Kennedy is a high School Student at Fordham Prep in the Bronx, who worked to estimate the likelihood of herd immunity in the boroughs of New York City and was an active contributor to an early analysis of herd immunity in New York City last summer and helped the COVID 19 Localisation Modelling Group to develop its course.

Harshita Magroria is a student at the University of Mumbai who led a team of 5 other students to study the outbreak in L Ward and discover the key differences between the slum and non-slum areas

Brahmani Nutakki a student at the University of Hyderabad who is the winner of a hackathon based on her work to automate predictive models of COVID 19 She led a similar effort to study Delhi and accurately predicted that the city would experience a surge in infections at the present moment. 

About the COVID 19 Localisation Modelling Group:

The COVID 19 Localisation Modelling Group was founded and collaborates with a group of 100+ volunteers to support teams working on COVID localized models globally. The group also offers a free COVID 19 Localisation Modelling Course.

The System Dynamics Society is committed to making all COVID 19-related resources available for free. Sponsor now and help us in this effort!

 

Models, Maps, and Levels of Evidence

Models, Maps, and Levels of Evidence

Anyone who has attended a System Dynamics conference in recent years, or has read past posts in the System Dynamics Society blog, is surely aware of differences of opinion on the value of qualitative maps as opposed to quantified simulations.

What you may not know is that this debate has been going on for a long time, stretching back to the early 1980s, when Eric Wolstenholme and others asserted that one might be able to infer dynamics from qualitative maps.  In 1990, Peter Senge’s book The Fifth Discipline upped the ante by suggesting that certain problems might be categorized according to System Archetypes, which some took to mean that one could go directly to solutions without first simulating.  This became known as Systems Thinking.

In 2000, Geoff Coyle wrote a paper (SDR 2000, 16:3) that pointedly asked whether there might be situations so uncertain that quantified modeling cannot tell us more than qualitative mapping alone.  Rogelio Oliva and I wrote a rejoinder (SDR 2001, 17:4) that challenged this idea and sought to reclaim Jay Forrester’s original view of simulation as the necessary test bed for any dynamic hypothesis that might conceivably lead to policy decisions.

Even now, 20 years later, the debate continues.  We see in our conferences increasing use of Group Model Building that goes no further than a qualitative map, and from which the authors claim to have derived dynamic insights.

Some have been dismayed by this development—which appears to be the further expansion of Systems Thinking—fearing it is diluting and dumbing down the fundamentals of our field.  The modelers accuse the mappers of lacking rigor, while the mappers say that good group process has a rigor of its own.

What can we do about this long-brewing pot of trouble?  Is there any way out of the impasse?

I’d like to suggest a possibility.  Several years ago, I published a paper (SDR 2014, 30:1-2) describing how a “levels of evidence” approach—a standard for classifying work in the biomedical sciences—might be applied in SD.  To achieve an “A” level of evidence, one would need both strong structural and behavioral evidence and the ability to reliably test one’s model.  Structural evidence comes from conversations with subject matter experts and focused studies of cause and effect.  Behavioral evidence comes from a comparison of model output with time series data and historical records.   Work with strong support for structure but not behavior, or behavior but not structure, would achieve at best a “B” rating.  Work with strong support for neither would get a “C” rating.

In the biomedical sciences, works that have “B” or “C” ratings can still be presented at conferences and even appear in prestigious journals.  A rating less than “A” does not mean poor quality but rather lack of full, iron-clad reliability for drawing conclusions and making decisions; that is, something more exploratory or tentative.  Its level of evidence is designated in the conference proceedings or at the top of the paper so that the audience knows what they are dealing with—a decisive work (one from which decisions can be made with confidence) or something less than that.

It seems to me we can apply the Levels of Evidence filter objectively across both simulation models and qualitative maps.  Let’s start with the simple fact that a simulation model can be tested formally, while a qualitative map cannot.  It follows that the best possible rating for a simulation model is “A”, while the best possible for a qualitative map is “B”.

If we can agree on this much, then we may be able to find a way for simulation models and qualitative maps to coexist.  It would require acknowledgment from the advocates of qualitative maps that their work can never be considered decisive.  And, it would require acknowledgment from the advocates of simulation that a model lacking sufficient evidence may be no more reliable than a well-developed qualitative map.

Recent Posts

ISDC 2021 Highlights: Food “Wickedness”

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

ISDC 2021 Highlights: Tackling Structural Racism with Modeling

The International System Dynamics Conference (ISDC) convenes practitioners who demonstrate what’s new and developing in their fields with System Dynamics. This section of the WiSDom Blog, “Conference Highlights,” asks system dynamicists to spotlight key presentations...

Housing Dynamics

Housing Dynamics We had an insightful conversation with David Stroh, Martijn Eskinasi, and Kaveh Dianati at our latest seminar. We learned about how using causal loop diagrams based on simple archetypes, illuminate interdependencies across housing availability, wealth...

Upcoming Events

Recent Business cases

General Motors OnStar

Name The General Motors OnStar Project Modelers Vince Barabba, Chet Huber, Fred Cooke, Nick Pudar, Jim Smith, Mark Paich Client General Motors Client Type Corporation The Official Website onstar.com is the official website in which you can become a member, get...

Pharmaceutical Product Branding Strategies

Pharmaceutical Product Branding Strategies Name Pharmaceutical Product Branding Strategies — Simulating Patient Flow and Portfolio Dynamics Modelers Mark Paich, Corey Peck, Jason Valant Contact Jason Valant or Corey Peck Client Numerous Pharmaceutical Companies Client...

Polio Eradication

Polio Eradication Name Polio Eradication Modelers Kimberly M. Thompson,and Radboud J. Duintjer Tebbens Client World Health Organization (WHO) Client Type NGO The Issue You Tackled Following successful eradication of smallpox and impressive progress in the elimination...

Join us