Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages

Go Home

ETS Reduces Costs With Questions Inventory Management

Nov 4, 2020 | Cases, Education, IT

In the mid-1990s, ETS started a transition from paper-and-pencil testing to computer-based testing for all of its graduate-level tests.  Computer-based tests, offered on an almost daily basis at many test locations around the world and throughout the year, draw questions from a weekly pool of test items many times larger than the test itself, and that weekly pool itself gets refreshed from an even larger inventory of items.  This inventory represents a substantial investment to ETS, because the items must be written and honed for precision, reviewed for cultural and gender bias, and pre-tested on large samples of test takers. Both item security and millions of dollars in item development costs are affected by the way in which the item inventory is managed. 

An SD model was developed to project the number of available test items under different assumptions about security risk, and also to look at policies for more cost-effective inventory management.  The model revealed that in cases of higher security risk, under existing policies, the number of available items could stagnate at an unacceptably low level.  Model tests showed that a modest and safe amount of “recycling” items used in the past could neutralize this potential problem.  Moreover, the model showed that, even when security risk was not high, the policy of recycling could effectively reduce ETS item creation costs and help their bottom line.  The model analysis was presented to the ETS executive board and affected their decisions regarding test item inventory policy.

Client Educational Testing Service (ETS), the world’s leading developer and provider of standardized educational tests
Author/Consultant Homer J

Do you want to know more?

Publication

Homer J.  Structure, Data, and Compelling Conclusions: Notes from the FieldSystem Dynamics Review, 13(4): 293-309, 1997.

OTHER SUCCESSFUL APPLICATIONS

Twinings Uses System Dynamics Games to Enhance HR Capability

Twinings Uses System Dynamics Games to Enhance HR Capability “Realistic simulation is a powerful approach to building capability. The business simulation developed [by Dashboard Simulations and Lane4] gave [Twinings staff] an experience that called for them to develop...

RSC Uses System Dynamics to Increase HVACR Sales Against the Tide

RSC Uses System Dynamics to Increase HVACR Sales Against the Tide “Using the proven Strategy Dynamic process focused our limited resources on organizing strategic issues, identifying the critical resources, and developing the insight to more rapidly create intuitive...

Achieving a Polio-Free World Through System Dynamics Simulation

Achieving a Polio-Free World Through System Dynamics Simulation EXECUTIVE Summary This System Dynamics model underpinned a 192 country resolution to eradicate polio globally and led the Bill and Melinda Gates Foundation to give Rotary International $100 million to...

Upcoming Events

Exploring Careers in System Dynamics

Exploring Careers in System Dynamics

11 am NY | 4 pm London | 12 am Beijing | Time Converter Exploring Careers in System Dynamics Join us for an engaging panel discussion on careers in System Dynamics featuring experts Sharon Els, Eduardo Romanovski, and Georg Pallaske, moderated by Shane Carnohan. This...

Recent Posts

Engaging Younger Audiences in Climate Change Education

Engaging Younger Audiences in Climate Change Education This webinar focused on engaging younger audiences in climate change education using the analogy of a bathtub. Linda Booth Sweeney, a systems educator, and author shared innovative ways to educate children about...

Celebrating Women’s International Day

Celebrating Women’s International Day Over the past several decades, more women have become part of the System Dynamics field, greatly increasing gender diversity in our discipline. We have many amazing, inspiring, brilliant, and visionary female leaders. Today...

Join us

LET US BE PART OF YOUR JOURNEY

Do you want to lead your organization into the future by overcoming paradigms and creating change? With Systems Thinking and System Dynamics you will enable powerful decision-making and find the leverage points to improve profits, strategy, efficiency, sustainability, and more.

Rebecca Niles

Talk with Us

The most efficient way to align your needs with our offerings is to schedule a meeting with our Executive Director, Rebecca Niles

Engage a Systems Consultant

Looking for a Systems Consultant? Fill out this form and we will follow up with a call and, soon enough, the right person for the job.

Experience Systems Thinking

Bring in a facilitator to unleash the power of Systems Thinking in your organization. Fill out this form for a Beer Game facilitator and join the companies, and graduate and MBA programs that play this game all over the world. Contact us if a facilitator for a different game is needed.

WPI System Dynamics Fundamentals micro-course 1

Start Learning

Join the WPI Sytem Dynamics Fundamentals Course to understand the causes of dynamic behavior at a basiic level and much more! The course is self-led and self-paced.