Measurement dysfunction describes a situation or behavior where actual data metrics, statistics and especially their meaning (or communicated meaning), can become problematic due to misuse.[ 1] [ 2] [ 3] Specifically, in areas such as Human Resources (Performance measurements[ 4] ), Technology (Safety[ 5] ), Finance or Health,[ 5] measurement dysfunctionality are critical, as it can lead to negative outcomes, wrong predictions or forecasts.
Practices to avoid:[ 6] [ 3]
Reward of wrong behavior (also persons who manipulate[ 7] )
Measuring the wrong things[ 8]
Measuring either not enough or too much
Cheating or data manipulation (intentional or unintentional due to wrong calculation models, systematic errors, human errors, etc.)
On eliminating dysfunctional measurement:[ 9]
Establish, and monitor the move to and adherence to ‘policies’ for good, functional measurement
Support technical correctness
Periodically evaluate the information need and value delivered by measurements
"What gets measured gets manipulated."[ 10] [ 11]
^ "Presentations and Papers" . www.osel.co.uk . Retrieved 2021-02-22 .
^ Austin, Robert D. (1996). Measuring and managing performance in organizations . Tom DeMarco, Timothy R. Lister. New York: Dorset House Publishing. ISBN 0-932633-36-6 . OCLC 34798037 .
^ a b "Measurement Dysfunction" . proactsafety.com . Retrieved 2021-02-22 .
^ "Measurement Madness: Recognizing and Avoiding the Pitfalls of Performance Measurement | Wiley" . Wiley.com . Retrieved 2021-02-22 .
^ a b Vincent, Charles, Dr (2013). The measurement and monitoring of safety : drawing together academic evidence and practical experience to produce a framework for safety measurement and monitoring . Susan Burnett, Jane Carthey. London. ISBN 978-1-906461-44-7 . OCLC 861644942 . {{cite book }}
: CS1 maint: location missing publisher (link ) CS1 maint: multiple names: authors list (link )
^ "When Measurement Goes Bad" . www.amanet.org . Retrieved 2021-02-22 .
^ "How to Spot and Stop Manipulators" . Psychology Today . Retrieved 2021-02-22 .
^ Leonelli, Sabina (2020), "Scientific Research and Big Data" , in Zalta, Edward N. (ed.), The Stanford Encyclopedia of Philosophy (Summer 2020 ed.), Metaphysics Research Lab, Stanford University, retrieved 2021-02-22
^ Shelley, C. C. (October 2009). "eXtreme Measurement: recognizing, understanding and avoiding measurement dysfunction" (PDF) . www.osel.co.uk . Oxford Software Engineering. Retrieved 2021-02-22 . {{cite web }}
: CS1 maint: date and year (link )
^ Dekker, Sidney (2017-10-19). "What gets measured, gets manipulated" . The Safety Anarchist . Routledge. pp. 75–98. doi :10.4324/9780203733455-5 . ISBN 978-0-203-73345-5 .
^ "Managing the Unmanageable: More Rules of Thumb" . www.managingtheunmanageable.net . Retrieved 2021-02-22 .