This finding in isolation did little to explain the complex nature of performance and supervisory relationship. Statistical significance may not mean practical significance. While a finding may show that some event did not occur by chance, it does not mean that a particular measurement or factor is relevant, useful, or that a difference of a few points is meaningful. This often means that it is not randomized or stratified in selection, may not represent a larger population, and may not be free of various kinds of bias. Although the design was considerably flawed, the findings have been extended to all kinds of organizations and levels of management.
Research is subject to bias, even unintentionally.
The political and social climate of a society often shapes the research question and the perspective for viewing findings. Laboratory research, in an attempt to counter some of the above criticisms, has brought people into artificial situations that are highly controlled, in order to focus on specific behaviors. Although the concept of control is laudable, it also creates an artificial settings that often changes participant's responses. The result of this patchwork quilt of interventions may mean that techniques work at cross purposes. Although Deming stated that TQM requires inclusion of all 14 of his points, some businesses have selectively taken what they like and disregarded others.