QUERY Ensuring Quality of Models (SD6660)

[SDMAIL Richard G. Dudley]

Posted by  Richard G. Dudley <richard.dudley at attglobal.net>

In his Next Fifty Years Article in the most recent System Dynamics Review,
Forrester comments: "We need to begin debating how to raise quality and scope in
applications, published papers, and especially in academic programs."
 
What I am wondering is: 

What procedures do people use to ensure that the model formulation, testing,
evaluations cycle is done in a rigorous manner?  How could that be improved?

Models developed for clients may end up being tested in the real world.  Perhaps
that is the ultimate test.   But how do consultants make sure that a model is
ready for presentation?  What internal controls are used to test, and approve a
model, or parts thereof, prior to going ahead to the client, or to the next
modeling step.   Are specific internal or external evaluation processes used or
is the convincing of the client a sufficiently rigorous exercise.   Is coming up
with a 'bad' model risky for future business?

Presumably quality of published models should be checked by those refereeing the
journal article.  Is that right... are the models actually examined?  My
impression is that examination of the models themselves is very variable...
reviewing a model takes a lot more time than reviewing a paper.

I am just wondering what procedures consulting firms or institutions actually
use in reviewing their own models.

Richard
Posted by  Richard G. Dudley <richard.dudley at attglobal.net>
posting date  Fri, 9 Nov 2007 11:27:45 +0700