VIEW POINT

Tests, testing, and tested - we need to critically evaluate the meaning of testsin psychiatry
Douglas M. Berger
Meguro Counseling Center, Tokyo, Japan

ABSTRACTThis article describes clinical pitfalls in our concepts of what it means for an illness, diagnosis, or evaluation and treatment
methods to say that they have been “tested”. This articles begins with the problems encountered in newborn testing for
Krabbe Disease of the nervous system in New York State over the last few years as an example of a test that did not liveup to its promise to help the society. Next, the article gives 3 examples of testing in psychiatry, 1. Psychological testing
to make treatment decisions in children with depression, 2. Patient’s and parents who have been told, or believe, that
WKH\KDYH$VSHUJHU¶VGLVRUGHUDQG7KHFRQFOXVLRQVPDGHDERXWWKHHI¿FDF\RIFRJQLWLYHEHKDYLRUDOWKHUDS\EDVHGRQ
clinical studies. The article’s conclusion sums up these examples as reasons why we need to have a more practical andVFLHQWL¿FDSSURDFKWRRXUXQGHUVWDQGLQJDQGLPSOHPHQWDWLRQRIWHVWVXVHGLQRXU¿HOG
Key words:$VSHUJHU¶VGLVRUGHUFRJQLWLYHEHKDYLRUDOWKHUDS\FOLQLFDOVWXGLHVSV\FKLDWU\SV\FKRORJLFDOWHVWLQJWHVWVINTRODUCTION
A recent article entitled, “Perils of Newborn Screening”[1]
led me to think of how we in psychiatry and our patients
also have some perilous ideas about screening and testing.
The article describes testing initiated in 2006 in New YorkState for Krabbe disease of the nervous system. Krabbedisease is a rare inherited disorder where lack of theenzyme galactocerebrosidase causes the myelin coating on
the nerves to break down. Mental and motor development
are affected, and muscle weakness, deafness, and blindness
may occur.[2]Out of the total one-million babies tested, 24 tested
positive and out of 24, 4 developed symptoms. One
family refused treatment and subsequently the child died;another child died from complications of the treatment;
another’s illness is progressing despite treatment, andone baby who had been treated successfully has recentlylost his ability to walk. Parents of babies who test
positive, are described to be in a constant state of worry,
Address for correspondence: Dr. Douglas M. Berger,Yutenji 1-27-2-204, Meguro Counseling Center, Tokyo, Japan.
E-mail: doug@japanpsychiatrist.com

How to cite this article: Berger DM. Tests, testing, andtested - we need to critically evaluate the meaning of testsin psychiatry. Indian J Psychiatry 2013;55:200-3.
200

some pursue risky tests, and the emotional trauma (notto mention the cost) incurred is likely to outweigh thebenefits.
This example illustrates how one kind of test may havepros and cons. The pros and cons of ‘testing’ can also beseen in one’s daily practice of psychiatry. The following are
personal experiences of my practice in Tokyo.
CLINICAL EXAMPLES“My 8-year-old child is depressed, should they havepsychological (psych) testing to determine if
antidepressants are warranted?”
A woman I have been treating for a few years for major
depression told me about her 8-year-old son who isirritable, has been crying more, and has written some notes
contemplating suicide. She first brought her son to a large
local counseling center where they recommended in-person
Access this article online
Quick Response Code
Website:www.indianjpsychiatry.org

DOI:
10.4103/0019-5545.111466

Indian Journal of Psychiatry 55(2), Apr-Jun 2013

Berger: Tests, testing, and tested - we need to critically evaluate the meaning of tests in psychiatry

counseling with their staff psychologist, school observations,and psych testing (costing about $4,500), and told the motherthat they could not recommend starting antidepressants until
the psych testing was complete. The son could not finish thetesting because he was unable to maintain concentration.
The mother eventually decided she couldn’t wait anymore
and asked me to evaluate the child who clearly looked
depressed. I explained that if the psych testing assessed theson having a depression, this affirms the obvious. If the psych
testing assessed the son without a depression, we are stillleft with a depressed-looking child who is writing suicide
notes, and with an anti-depressant responsive depression in
his mother. Neither family dynamics nor school issues could
explain the child’s depression.
We agreed that there was no logic for psych testing in termsof, ‘to treat’ or ‘not to treat’; and in tandem to a medical
work-up for depression, we initiated 2.5 mg of escitalopram
a day with a good response.
Scales and tests for depression may indeed provide somehelpful information; however, predictive value, sensitivity,and specificity are still far from perfect,[3] and the National
Institute of Mental Health (NIMH) guidance only mentions
medical examination and history of symptoms in theevaluation of depression.[4]While no test can fully prove a psychiatric diagnosis, weunderstood that the medication can be construed to
be both a treatment as well as a kind of diagnostic test,
i.e., improvement on administration, and relapse on
discontinuation would support the diagnosis of a major
depression.
In addition, while the son was ill with depression, the otheraspects of psych testing, i.e., personality or intellectual
testing, would not properly reflect these areas of functioning.
It would be like asking a person with pneumonia to run
around a track, time them, and then make an interpretationof this person’s ability to run (not to mention the cost savingof the psych testing).
The next peril is the way the school authorities may use
the results of his psychological testing, which may havea negative impact on the child’s education in the future.
I opined that the school only needed to know that the son
would get help, but did not need to know the diagnostic ortreatment details.
“My 4-year-old has been tested and diagnosed withAsperger’s Disorder, can you counsel him?”
This has been a more frequent inquiry in recent years. Someparents or adult patients almost seem to be proud to havethis diagnosis, thinking that it portends high intelligence,but it may actually be a way to avoid a more uncomfortable
Indian Journal of Psychiatry 55(2), Apr-Jun 2013

mental illness diagnosis. Most of these parents do notrealize that there is no test to prove that someone has
Asperger’s, (the criteria for Asperger’s includes: Marked
impairment in social relations, often with stereotyped motor
movements, and a vast knowledge of some topic of esotericor impractical value),[5] and that the incidence of Asperger’sis thought to be extremely low (about three in 10,000)[6]
when compared with other disorders whose symptoms
overlap with Asperger’s (i.e., attention deficit disorder/
attention deficit hyperactivity disorder (ADD/ADHD), which
may affect up to 10% of children.[7]) Few of the patients whocome in with a supposed diagnosis of Asperger’s actuallyfulfill the criteria for Asperger’s.
On examination, most of these children have symptoms
suggesting ADD or ADHD; some have depression or anxiety,and others a shyness or awkwardness that may be normal
or may evolve into social anxiety disorder later in life. Onrare occasion some do look like high-functioning autistic
children, although it seems parsimonious and logical toassume that these children have the far more common
diagnosis rather than a rare diagnosis if the symptoms
overlap significantly.
The peril here is when the parents or an adult patientdoes not accept having a diagnosis or treatment otherthan that for Asperger’s. If a child also seems to havea comorbid ADD or ADHD, it needs to be treated first;
to ascertain what Asperger’s symptoms may be left.
Otherwise, it would be like making a diagnosis of asthma
in a child with pneumonia (i.e., it is impossible to see if
Asperger’s is there while the person is clearly impairedwith ADD or ADHD).
In addition, once a child gets a diagnosis in their educational
record, it tends to have a life of its own as definitive, andneither parents, educators, nor even psychologists orpsychiatrists, endeavor to change the record.
“Cognitive behavioral therapy has been tested and proven tobe effective for depression; can you give it to me?”This is another situation where the use of the word ‘tested’
comes in and is an inquiry that can be a challenge for thepsychiatrist to handle when the patient has vegetative
symptoms, a strong family history, and a chronic courseof depression because these patients usually require
antidepressant medication in addition to any therapy.
Cognitive behavioral therapy (CBT) aims at repairing
negative thoughts that are thought to cause
depression.[8] Clinically, it is easy to observe; however,that negative cognitions improve when depressed mood
improves, be it with antidepressants or the natural cycling
course out of depression.[9] This is analogous to delusions
improving, when one is given an antipsychotic, so thatnegative thoughts are more likely the result of depression
201

Berger: Tests, testing, and tested - we need to critically evaluate the meaning of tests in psychiatry

rather than the cause, just like a runny nose and a coughare the result of a cold. If negative thoughts were the causeof depression, then this would be the only Diagnostic
and Statistical Manual of Mental Disorders (DSM) Axis I
condition where the symptoms are also construed to bethe cause.
However, it can often be seen that CBT may help persons
with depression function better. Degree of depression
is usually evaluated by a rating scale that assesses bothneuro-vegetative symptoms as well as misery (i.e., cognitive
symptoms such as despair and helplessness). Giving
persons hope and support can alleviate some of the miserysymptoms decreasing depression scores. Allowing sometime to pass where the persons improve by themselves orcycle out of depression can also decrease scores. In either
case, the person functions better and their depression
scores decrease over time. Even a few points lower on
a depression test can result in a call of a “statisticallysignificant difference” compared to a supportive therapy
control group, but that does not mean the illness is reallytreated. For example, I broke my arm by falling on the ice.
I had real pain and also misery because I couldn’t do things
I normally liked to do. When my orthopedist told me, “I see
many fractures like this, you will be fine in a few months,”
all my misery disappeared, but the fracture did not change.
Patients in misery can respond well to an authority figure
which gives them hope.
A more important problem with using the word ‘tested’ isthat it is not easy to study psychotherapy as a modality oftreatment because the studies cannot be double blinded
like a drug study that has a placebo arm—an extremely
crucial point. A study on bias in treatment outcome studies
concluded that the results of unblinded randomized clinicaltrials (RCTs) tended to be biased toward beneficial effects
if the RCTs’ outcomes were subjective (as they are inpsychotherapy studies) contrary to being objective.[10]for non-specific effects of intervention were analyzed. This
study concluded that CBT is no better than non-specificcontrol interventions in the treatment of schizophrenia anddoes not reduce relapse rates, treatment effects are smallin treatment studies of major depression, and it is not aneffective treatment strategy for prevention of relapse inbipolar disorder.
This does not mean that CBT has no value, it only meansthat we need to consider CBT as an adjunctive modality
to help functional impairment and suffering vs. an illness
course-changing intervention. It is imperative that ourfield does not allow studies that are unblinded to be called“evidence based tests.” They need to be in a different
category, i.e., “uncontrolled clinical data”, or “clinicalimpressions” (of CBT practitioners and/or their patients).
CONCLUSION
To the lay-person, the word “test” implies some absolute
truth. The value of a test or a diagnosis given by an authority
is very hard to evaluate by the average lay-person, andwhen it comes to testing of a therapeutic intervention,even most mental health professionals do not understandwhy it is crucial to control bias by double-blinding in aclinical trial of an intervention, whether psychotherapy
or drug. The words “controlled” or “randomized” seemto carry more weight than they are worth if there is noplacebo or double blind to back them up. We must also
not avoid a critical discussion of the economic incentive
to do a test or to “prove” the evidence base of a certain
therapy.
{Ed.: Dr. Berger is in private practice in Japan and consultant onpharmaceutical clinical trials. Web page is at: www. japanpsychiatrist.
com. This article is intended as a personal opinion piece and not ascientific analysis.}

REFERENCES
Patients and even professionals assume that the words“randomized and controlled” mean that the studies looking
at a therapeutic modality are fully evidence based, even if
they are not double blind. They may be single blinded, i.e.,
the rater may not know the treatment the patient received,
but the patient themselves cannot be blinded to the typeof therapy, thus potentially biasing the results. Depression
studies notoriously have large random errors due to thewide variety of subjects many of which have mild formsof low mood, investigator and patient preference andeconomic incentive, or non perfect rating instruments, etc.
Bias can lead to a result very far from the true value.[11]A recent meta analysis[12] examined how effective CBT iswhen placebo control and blindedness are factored in.
Pooled data from published trials of CBT in schizophrenia,
major depression, and bipolar disorder that used controls
202

1.
2.
3.

4.

5.

6.

7.

8.
9.

Bleicher A. Perils of newborn screening: Doctors may be testing infants for
too many diseases. Sci Am 2012;307:16-7.
Pastores GM. Krabbe disease: An overview. Int J Clin Pharmacol Ther
2009;47(Suppl 1):S75-81.
Rivera CL, Bernal G, Rossello J. The Children’s Depression Inventory (CDI)
and The Beck Depression Inventory (BDI): Their validity as screening
measures for major depression in a group of Puerto Rican adolescents.
Int J Clin Health Psychol 2005;5:485-98.
Available from: http://www.nimh.nih.gov/health/publications/men-anddepression/diagnostic-evaluation-and-treatment.shtml. [Last Accessedon 2013 Mar 30].
F84. Pervasive developmental disorder. International Statistical&ODVVL¿FDWLRQRI'LVHDVHVDQG5HODWHG+HDOWK3UREOHPVth (ICD-10) ed.
World Health Organization (2006).
Fombonne E. Epidemiological surveys of pervasive developmental
disorders. In: Volkmar FR, editor. Autism and Pervasive Developmental
Disorders. 2nd ed. Cambridge: Cambridge University Press; 2007. p. 33-68.
Centers for Disease Control and Prevention. Summary Health Statistics
for U.S. Children. National Health Interview Survey, 2002. March 2004,
Series 10, No. 221.
Burns, David. Feeling Good, The New Mood Therapy. Avon Books; 1980.
Fava M, Davidson K, Alpert JE, Nierenberg AA, Worthington J, O’Sullivan R,
et al. Hostility changes following antidepressant treatment: Relationship toIndian Journal of Psychiatry 55(2), Apr-Jun 2013

Berger: Tests, testing, and tested - we need to critically evaluate the meaning of tests in psychiatry

10.

11.

stress and negative thinking. J Psychiatr Res 1996;30:459-67.
Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, et al. Empiricalevidence of bias in treatment effect estimates in controlled trials withdifferent interventions and outcomes: Meta-epidemiological study. BMJ
2008;336:601-5.
Steven Piantadosi. Clinical Trials: A Methodologic Perspective. 2nd ed.
Hoboken: Wiley-Interscience; 2005.

12.

Lynch D, Laws KR, McKenna PJ. Cognitive behavioural therapy for major
psychiatric disorder: Does it really work? A meta-analytical review ofwell-controlled trials. Psychological Medicine 2010;40:9-24.

Source of Support: Nil, &RQÀLFWRI,QWHUHVW None declared

Announcement

iPhone App
A free application to browse and search the journal’s content is now available for iPhone/iPad.
The application provides “Table of Contents” of the latest issues, which are stored on the device
for future offline browsing. Internet connection is required to access the back issues and searchfacility. The application is Compatible with iPhone, iPod touch, and iPad and Requires iOS 3.1 orlater. The application can be downloaded from http://itunes.apple.com/us/app/medknow-journals/
id458064375?ls=1&mt=8. For suggestions and comments do write back to us.
Indian Journal of Psychiatry 55(2), Apr-Jun 2013

203