Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages

Go Home

ETS Reduces Costs With Questions Inventory Management

Nov 4, 2020 | Cases, Education, IT

In the mid-1990s, ETS started a transition from paper-and-pencil testing to computer-based testing for all of its graduate-level tests.  Computer-based tests, offered on an almost daily basis at many test locations around the world and throughout the year, draw questions from a weekly pool of test items many times larger than the test itself, and that weekly pool itself gets refreshed from an even larger inventory of items.  This inventory represents a substantial investment to ETS, because the items must be written and honed for precision, reviewed for cultural and gender bias, and pre-tested on large samples of test takers. Both item security and millions of dollars in item development costs are affected by the way in which the item inventory is managed. 

An SD model was developed to project the number of available test items under different assumptions about security risk, and also to look at policies for more cost-effective inventory management.  The model revealed that in cases of higher security risk, under existing policies, the number of available items could stagnate at an unacceptably low level.  Model tests showed that a modest and safe amount of “recycling” items used in the past could neutralize this potential problem.  Moreover, the model showed that, even when security risk was not high, the policy of recycling could effectively reduce ETS item creation costs and help their bottom line.  The model analysis was presented to the ETS executive board and affected their decisions regarding test item inventory policy.

Client Educational Testing Service (ETS), the world’s leading developer and provider of standardized educational tests
Author/Consultant Homer J

Do you want to know more?

Publication

Homer J.  Structure, Data, and Compelling Conclusions: Notes from the FieldSystem Dynamics Review, 13(4): 293-309, 1997.

OTHER SUCCESSFUL APPLICATIONS

RSC Uses System Dynamics to Increase HVACR Sales Against the Tide

RSC Uses System Dynamics to Increase HVACR Sales Against the Tide “Using the proven Strategy Dynamic process focused our limited resources on organizing strategic issues, identifying the critical resources, and developing the insight to more rapidly create intuitive...

Achieving a Polio-Free World Through System Dynamics Simulation

Achieving a Polio-Free World Through System Dynamics Simulation EXECUTIVE Summary This System Dynamics model underpinned a 192 country resolution to eradicate polio globally and led the Bill and Melinda Gates Foundation to give Rotary International $100 million to...

MasterCard Halts Market Share Slide With Scenario Planning

MasterCard Halts Market Share Slide With Scenario Planning The Problem MasterCard, a major credit card company, once held a dominant market position US Market Share with only one primary competitor, Visa. They woke up one day and realized that, after six years of...

Upcoming Events

2022 SDS Policy Council Meeting

2022 SDS Policy Council Meeting

Monthly meetings of the Policy Council occur on the last Wednesday of the month with the exception of conference month.  All Society members are welcome to attend.  Login to see the meeting location which will be displayed here to members 15 minutes prior to the start...

Recent Posts

Data & Uncertainty in System Dynamics

Data & Uncertainty in System Dynamics Jay Forrester cautioned that “fitting curves to past system data can be misleading”. Certainly, that can be true, if the model is deficient. But we can have our cake and eat it too: a good model that passes traditional System...

Modeling for Improved Organizational Staff Diversity

Modeling for Improved Organizational Staff Diversity We cannot all succeed when (more than) half of us are held back. This slightly modified quote is from Malala Yousafzai, the courageous young woman who stood up for her right to be educated. It summarizes the ethos...

Join us

LET US BE PART OF YOUR JOURNEY

Do you want to lead your organization into the future by overcoming paradigms and creating change? With Systems Thinking and System Dynamics you will enable powerful decision-making and find the leverage points to improve profits, strategy, efficiency, sustainability, and more.

Rebecca Niles

Talk with Us

The most efficient way to align your needs with our offerings is to schedule a meeting with our Executive Director, Rebecca Niles

Engage a Systems Consultant

Looking for a Systems Consultant? Fill out this form and we will follow up with a call and, soon enough, the right person for the job.

Experience Systems Thinking

Bring in a facilitator to unleash the power of Systems Thinking in your organization. Fill out this form for a Beer Game facilitator and join the companies, and graduate and MBA programs that play this game all over the world. Contact us if a facilitator for a different game is needed.

WPI System Dynamics Fundamentals micro-course 1

Start Learning

Join the WPI Sytem Dynamics Fundamentals Course to understand the causes of dynamic behavior at a basiic level and much more! The course is self-led and self-paced.

System Dynamics Admins
System Dynamics Admins