Please no plagiarism and make sure you are able to access all resource on your own before you bid. Main references come from Neukrug, E. S., & Fawcett, R. C. (2015) and/or Encyclopedia of Counseling (2017). You need to have scholarly support for any claim of fact or recommendation regarding treatment. APA format also requires headings. Use the prompt each week to guide your heading titles and organize the content of your initial post under the appropriate headings. Remember to use scholarly research from peer-reviewed articles that are current. I have attached scoring sheet and test results, so you can see how to make full points. Please follow the instructions to get full credit for the discussion. I need this completed by 02/05/20 at 6pm.
DISCUSSION POSTS— For your Main discussion posts, I require that all posts be a MINIMUM of 250 words. The main post must contain a minimum of two (2) different references from a peer reviewed journal or scholarly book or scholarly website. It is a good idea to use your Learning Resources each week. Wikipedia does not count as a scholarly website since the information is not validated.
Discussion – Week 11
Top of Form
Using Assessments for Positive Social Change
As a counselor, you are in a unique position to effect positive social change for your clients, your practice, and your community. In reflecting on what you have learned in this course, consider how you can achieve social change.
To Prepare:
By Day 3 of Week 11
Post and explain how you might be able to apply the content from this course to achieve positive social change in your community.
Be sure to support your postings and responses with specific references to the Learning Resources. Identify current relevant literature to support your work.
Bottom of Form
Required Resources
Neukrug, E. S., & Fawcett, R. C. (2015). Chapter 10: “Career and occupational assessment: Interest inventories, multiple aptitude, and special aptitude tests.” In The essentials of testing and assessment: A practical guide for counselors, social workers, and psychologists (pp. 221-244). Stamford, CN: Cengage Learning.
Neukrug, E. S., & Fawcett, R. C. (2015). Figure 10.2 Strong interest inventory profile sheet for basic interest scales. In The essentials of testing and assessment: A practical guide for counselors, social workers, and psychologists (pp. 226-227). Stamford, CN: Cengage Learning.
Alexander Street Videos (n.d.). Retrieved from the Walden Library resources.
Eric Marciano (Author), Eric Marciano (Director), Jill Feyer (Producer), Eric Marciano (Producer), (2010). Teen Depression. Falls Church, VA: Landmark Media. [Streaming Video]. Retrieved from video.alexanderstreet.com/watch/teen-depression database
Firestone Assessment of Self-Destructive Thoughts
Review of the Firestone Assessment of Self-Destructive Thoughts by WILLIAM E. MARTIN, JR., Professor of Educational Psychology, Northern Arizona University, Flagstaff, AZ:
The Firestone Assessment of Self-Destructive Thoughts (FAST) is designed to measure the “Continuum of Negative Thought Patterns” as they relate to a client’s level of self-destructive potential or suicidality. The authors recommend the FAST to be used for screening, diagnosis, treatment progress, treatment outcome, research, and therapy. The FAST is theoretically grounded in what the authors refer to as the “concept of the voice,” which refers to negative thoughts and attitudes that are said to be at the core of maladaptive behavior.
The FAST consists of 84 items that provide self-report information from a respondent on how frequently he or she is experiencing various negative thoughts directed toward himself or herself. Four “composites” and 11 linked “continuum levels” comprise the FAST. One composite is named Self-Defeating and has five continuum levels (Self-Depreciation, Self-Denial, Cynical Attitudes, Isolation, and Self-Contempt). Addictions is another composite with addictions listed as its continuum level. A third composite is Self-Annihilating with four continuum levels (Hopelessness, Giving Up, Self-Harm, Suicide Plans, and Suicide Injunctions). The last composite is Suicide Intent and no continuum levels are identified.
ADMINISTRATION, SCORING, AND INTERPRETATION. The FAST instrument is a seven-page perforated, self-carbon form used for responding to items, scoring responses, and graphing the results. T scores are derived for the 11 continuum levels, four composites, and for the total score. Percentiles and 90% confidence interval bands also are available for use. The T scores are plotted on the T-Score profile graph, which has shaded partitions that indicate if the T scores fall within a nonclinical range, equivocal range, or clinical ranges that include elevated and extremely elevated.
The normative sample for the FAST was a clinical sample of outpatient clients undergoing psychotherapy. A T score of 50 on any scale represents the average performance of an individual who was in outpatient treatment with no suicide ideation from the normative sample. The nonclinical range is a T score between 20 and 41 whereas the equivocal range is 42-48. The two clinical ranges are elevated (42-59) and extremely elevated (60+). Any score that falls above the equivocal range is treated with concern and anyone scoring in the extremely elevated range on levels 7-11, the Self-Annihilating Composite, the Suicide Intent Composite, or the Total score should be immediately assessed for suicide potential.
DEVELOPMENT OF THE SCALES. The items for the FAST were derived from actual statements of 21 clinical outpatients who were receiving “voice therapy” in groups. Nine of the outpatients had a previous history of serious suicide attempts and the others exhibited less severe self-defeating behaviors including self-denial, isolation, substance abuse, and eating disorders. The list of items was further refined from a study conducted to select those factors that significantly discriminated between suicide attempters and nonattempters. Then items were retained or deleted based upon their psychometric relationship to hypothesized constructs, resulting in the current 84-item version of the FAST.
RELIABILITY AND VALIDITY. Cronbach’s alpha reliability coefficients ranging from .76 to .91 (Mdn = .84) are reported for the 11 level scores. Standard errors of measurement and 90% confidence intervals also are provided. However, sample sizes and descriptions are not provided for these measures. Test-retest reliability coefficients (1-266 days) ranged from .63-.94 (M = .82) using a sample (N = 131) of nonclinical, psychotherapy outpatients, and psychiatric inpatients.
Content validity of the FAST was investigated using a Guttman Scalogram Analysis resulting in a coefficient of reproducibility of .91 and a coefficient of scalability of .66. FAST Total Scores were correlated with the Suicide Ideation subscale of the Suicide Probability Scale (r = .72) as indicators of convergent validity. An exploratory factor analysis was conducted using 579 outpatients resulting in a 3-factor solution (Self-Annihilating, Self-Defeating, and Addictions), which provided support for construct validity. Evidence for criterion-related validity was demonstrated from studies showing how FAST scores were able to discriminate inpatient and outpatient ideators from nonideators and to identify individuals who made prior suicide attempts.
SUMMARY. The authors have put forth empirical evidence that supports the psychometric properties of the FAST. However, continuing studies are needed, especially related to the effectiveness of the FAST in diagnosing and predicting chemical addictive behavior. Furthermore, the construct validity of scores from the FAST needs further consideration. First, the items for the FAST were generated from a small (N = 21) somewhat restricted focus group of persons receiving “voice therapy.” Second, the FAST is closely anchored to a theoretical orientation known as “concept of the voice” in which additional studies are needed to validate.
Overall, the FAST is a measure worth considering for professionals working with individuals who have exhibited self-destructive potential or suicidality. However, I encourage professionals to study the theoretical orientation underlying the FAST and determine if it is congruent with their own expectations for clinical outcomes prior to extensive use of the instrument.
Review of the Firestone Assessment of Self-Destructive Thoughts by ROBERT C. REINEHR, Professor of Psychology, Southwestern University, Georgetown, TX:
The Firestone Assessment of Self-Destructive Thoughts (FAST) is a self-report questionnaire intended to provide clinicians with a tool for the assessment of a patient’s suicide potential. Respondents are asked to endorse how frequently they are experiencing various negative thoughts directed toward themselves. The items were derived from the actual statements of clinical outpatients who were members of therapy groups in which the techniques of Voice Therapy were used.
Voice Therapy is a technique developed by the senior test author as a means of giving language to the negative thought processes that influence self-limiting, self-destructive behaviors and lifestyles. The FAST includes items intended to assess each of 11 levels of a Continuum of Negative Thought Patterns. Items were assigned to levels based on the judgments of advanced graduate students and psychologists with training in Voice Therapy.
In the standardization process, the FAST was administered to a sample of 478 clients who were currently receiving outpatient psychotherapy and who did not have any current (within the last month) suicide ideation, suicide threats, or suicide attempts. Standard scores were calculated for the Total Score, for four composite scores derived by factor analysis and other statistical procedures, and for each of the 11 levels of negative thought patterns.
Estimates of internal consistency are based on a single sample, the size of which is not reported in the manual. They range from .76 to .97, with the majority falling between .81 and .88. Test-retest reliability estimates are reported for three samples with intervals from 28-266 days in one study and 1-31 days in another: psychiatric inpatients (n = 28), psychotherapy outpatients (n = 68), and nonclinical college students (n = 35). Reliabilities for the various levels of the negative-thought continuum range from .63 to .94, with the higher coefficients generally being found among the nonclinical respondents. Test-retest reliability estimates for the various composite scores and for the total score are somewhat higher, ranging from .79 to .94.
As an indication of construct validity, FAST scores were compared to scores on the Beck Depression Inventory (BDI), the Beck Suicide Inventory (BSI), and the Suicide Probability Scale (SPS). The FAST Total score had its highest correlations with the BDI (.73), the BSI (.72), and the Suicide Ideations subscale of the SPS (.76). The composite scores and the various level scores had lower correlations with the subscales of the Beck instruments or the SPS.
The FAST was administered to groups of inpatients and outpatients with various diagnoses including Adjustment Disorder, Anxiety Disorder, Bipolar Disorder, Depression, Personality Disorder, Schizophrenia, and Substance Abuse, and to a nonclinical sample of 172 college students. Each of the clinical groups was further subdivided into suicide Ideators and Nonideators. Ideators had higher average FAST Total scores than did Nonideators and clinical groups had higher average FAST Total scores than did the nonclinical group. Information is provided in the manual with respect to the relationships between the various FAST subscales and the diagnostic groups and subgroups.
SUMMARY. In general, it would appear that the FAST is similar in many ways to other depression and suicide inventories. Total Scores tend to be higher for respondents in diagnostic groups than for nonclinical respondents, and within diagnostic groups, Suicide Ideators score more highly than do Nonideators.
Within the limits of these findings, the FAST may be useful to clinicians as an indication of how a given respondent’s answers compare to those of various diagnostic groups. It might also be possible to use the scale as a clinical tool for the evaluation of change during therapy, although use as a psychometric instrument is not justified on the basis of the evidence presented in the manual.
A. Attitudes and Beliefs
1. Culturally skilled counselors believe that cultural self-awareness and sensitivity to one’s own
cultural heritage is essential.
2. Culturally skilled counselors are aware of how their own cultural background and experiences
have influenced attitudes, values, and biases about psychological processes.
3. Culturally skilled counselors are able to recognize the limits of their multicultural competency
and expertise.
4. Culturally skilled counselors recognize their sources of discomfort with differences that exist
between themselves and clients in terms of race, ethnicity and culture.
B. Knowledge
1. Culturally skilled counselors have specific knowledge about their own racial and cultural
heritage and how it personally and professionally affects their definitions and biases of
normality/abnormality and the process of counseling.
2. Culturally skilled counselors possess knowledge and understanding about how oppression,
racism, discrimination, and stereotyping affect them personally and in their work. This allows
individuals to acknowledge their own racist attitudes, beliefs, and feelings. Although this standard
applies to all groups, for White counselors it may mean that they understand how they may have
directly or indirectly benefited from individual, institutional, and cultural racism as outlined in White
identity development models.
3. Culturally skilled counselors possess knowledge about their social impact upon others. They
are knowledgeable about communication style differences, how their style may clash with or
foster the counseling process with persons of color or others different from themselves based on
the A, B and C, Dimensions ,and how to anticipate the impact it may have on others.
C. Skills
1. Culturally skilled counselors seek out educational, consultative, and training experiences to
improve their understanding and effectiveness in working with culturally different populations.
Being able to recognize the limits of their competencies, they (a) seek consultation, (b) seek
further training or education, (c) refer out to more qualified individuals or resources, or (d) engage
in a combination of these.
2. Culturally skilled counselors are constantly seeking to understand themselves as racial and
cultural beings and are actively seeking a non racist identity.
A. Attitudes and Beliefs
1. Culturally skilled counselors are aware of their negative and positive emotional reactions
toward other racial and ethnic groups that may prove detrimental to the counseling relationship.
They are willing to contrast their own beliefs and attitudes with those of their culturally different
clients in a nonjudgmental fashion.
2. Culturally skilled counselors are aware of their stereotypes and preconceived notions that they
may hold toward other racial and ethnic minority groups.
B. Knowledge
1. Culturally skilled counselors possess specific knowledge and information about the particular
group with which they are working. They are aware of the life experiences, cultural heritage, and
historical background of their culturally different clients. This particular competency is strongly
linked to the “minority identity development models” available in the literature.
2. Culturally skilled counselors understand how race, culture, ethnicity, and so forth may affect
personality formation, vocational choices, manifestation of psychological disorders, help seeking
behavior, and the appropriateness or inappropriateness of counseling approaches.
3. Culturally skilled counselors understand and have knowledge about sociopolitical influences
that impinge upon the life of racial and ethnic minorities. Immigration issues, poverty, racism,
stereotyping, and powerlessness may impact self esteem and self concept in the counseling
process.
C. Skills
1. Culturally skilled counselors should familiarize themselves with relevant research and the latest
findings regarding mental health and mental disorders that affect various ethnic and racial groups.
They should actively seek out educational experiences that enrich their knowledge,
understanding, and cross-cultural skills for more effective counseling behavior.
2. Culturally skilled counselors become actively involved with minority individuals outside the
counseling setting (e.g., community events, social and political functions, celebrations,
friendships, neighborhood groups, and so forth) so that their perspective of minorities is more
than an academic or helping exercise.
A. Beliefs and Attitudes
1. Culturally skilled counselors respect clients’ religious and/ or spiritual beliefs and values,
including attributions and taboos, because they affect worldview, psychosocial functioning, and
expressions of distress.
2. Culturally skilled counselors respect indigenous helping practices and respect help~iving
networks among communities of color.
3. Culturally skilled counselors value bilingualism and do not view another language as an
impediment to counseling (monolingualism may be the culprit).
B. Knowledge
1. Culturally skilled counselors have a clear and explicit knowledge and understanding of the
generic characteristics of counseling and therapy (culture bound, class bound, and monolingual)
and how they may clash with the cultural values of various cultural groups.
2. Culturally skilled counselors are aware of institutional barriers that prevent minorities from
using mental health services.
3. Culturally skilled counselors have knowledge of the potential bias in assessment instruments
and use procedures and interpret findings keeping in mind the cultural and linguistic
characteristics of the clients.
4. Culturally skilled counselors have knowledge of family structures, hierarchies, values, and
beliefs from various cultural perspectives. They are knowledgeable about the community where a
particular cultural group may reside and the resources in the community.
5. Culturally skilled counselors should be aware of relevant discriminatory practices at the social
and community level that may be affecting the psychological welfare of the population being
served.
C. Skills
1. Culturally skilled counselors are able to engage in a variety of verbal and nonverbal helping
responses. They are able to send and receive both verbal and nonverbal messages accurately
and appropriately. They are not tied down to only one method or approach to helping, but
recognize that helping styles and approaches may be culture bound. When they sense that their
helping style is limited and potentially inappropriate, they can anticipate and modify it.
2. Culturally skilled counselors are able to exercise institutional intervention skills on behalf of
their clients. They can help clients determine whether a “problem” stems from racism or bias in
others (the concept of healthy paranoia) so that clients do not inappropriately personalize
problems.
3. Culturally skilled counselors are not averse to seeking consultation with traditional healers or
religious and spiritual leaders and practitioners in the treatment of culturally different clients when
appropriate.
4. Culturally skilled counselors take responsibility for interacting in the language requested by the
client and, if not feasible, make appropriate referrals. A serious problem arises when the linguistic
skills of the counselor do not match the language of the client. This being the case, counselors
should (a) seek a translator with cultural knowledge and appropriate professional background or
(b) refer to a knowledgeable and competent bilingual counselor.
5. Culturally skilled counselors have training and expertise in the use of traditional assessment
and testing instruments. They not only understand the technical aspects of the instruments but
are also aware of the cultural limitations. This allows them to use test instruments for the welfare
of culturally different clients.
6. Culturally skilled counselors should attend to as well as work to eliminate biases, prejudices,
and discriminatory contexts in conducting evaluations and providing interventions, and should
develop sensitivity to issues of oppression, sexism, heterosexism, elitism and racism.
7. Culturally skilled counselors take responsibility for educating their clients to the processes of
psychological intervention, such as goals, expectations, legal rights, and the counselor’s
orientation.
Arredondo, P., Toporek, M. S., Brown, S., Jones, J., Locke, D. C., Sanchez, J. and Stadler, H. (1996)
Operationalization of the Multicultural Counseling Competencies. AMCD: Alexandria, VA
A. Attitudes and Beliefs
B. Knowledge
C. Skills
III. Culturally Appropriate Intervention Strategies
A. Beliefs and Attitudes
B. Knowledge
C. Skills
Corey, Corey, Corey, and Callanan Ethical Decision-Making Model
In addition to the moral model just noted, a number of other ethical decision-making models exist (Neukrug, 2016). One hands-on, practical, problem-solving model espoused by Corey, Corey, and Corey (2019) suggests that the practitioner go through the following eight steps when making complex ethical decisions: 1. Identify the problem or dilemma 2. Identify the potential issues involved 3. Review the relevant ethical guidelines 4. Know the applicable laws and regulations 5. Obtain consultation 6. Consider possible and probable courses of action 7. Enumerate the consequences of various decisions 8. Decide on what appears to be the best course of action Finally, in addition to the moral and practical models mentioned earlier, some suggest that regardless of the approach one takes in ethical decision-making, the ability to make wise ethical decisions may well be influenced by the clinician’s level of ethical, moral, and cognitive development (Lambie, Hagedor, & Ieva, 2010; Levitt & Moorhead, 2013) (see Exercise 2.1). Those who are at higher levels of cognitive development, they state, view ethical decision-making in more complex ways than others. Certainly, this has broad implications for the training that takes place in clinical programs, as it would be hoped that students are challenged to make decisions that are comprehensive and thoughtful (McAuliffe & Eriksen, 2010).
Neukrug, Edward S.. Essentials of Testing and Assessment: A Practical Guide for Counselors, Social Workers, and Psychologists, Enhanced (p. 28). Cengage Learning. Kindle Edition.
ED388883 1995-00-00 Mental Health
Counseling Assessment: Broadening
One’s Understanding of the Client and
the Clients Presenting Concerns. ERIC
Digest.
ERIC Development Team
www.eric.ed.gov
If you’re viewing this document online, you can click any of the topics below to link directly to that section.
Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns.
ERIC Digest…………………………………………………………. 2
CONTINUOUS ASSESSMENT………………………………………. 2
QUALITATIVE ASSESSMENT……………………………………….. 3
BEHAVIORAL ASSESSMENT……………………………………….. 4
PAST RECORDS……………………………………………………… 4
SUMMARY…………………………………………………………….. 4
REFERENCES………………………………………………………… 5
ERIC Identifier: ED388883
Publication Date: 1995-00-00
Author: Juhnke, Gerald A.
Source: ERIC Clearinghouse on Counseling and Student Services Greensboro NC.
Mental Health Counseling Assessment:
ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
Page 1 of 6
Broadening One’s Understanding of the Client
and the Clients Presenting Concerns. ERIC
Digest.
THIS DIGEST WAS CREATED BY ERIC, THE EDUCATIONAL RESOURCES
INFORMATION CENTER. FOR MORE INFORMATION ABOUT ERIC, CONTACT
ACCESS ERIC 1-800-LET-ERIC
OVERVIEW
Assessment has experienced a resurgence in recent years both in the United States
and abroad (Piotrowski & Keller, 1992; Watkins, 1994). Some continue to use the terms
assessment and testing interchangeably. Both are vitally important to the counseling
process (Lambert, Ogles, & Masters, 1992). Yet, assessment is broader in scope than
testing. Typically, assessment includes gathering and integrating information about a
client in a manner that promotes effective treatment (Cohen, Swerdlik, & Smith, 1992).
This can be accomplished by using testing in conjunction with other methods, such as
qualitative techniques, behavioral assessments and review of past client records.
Testing should not be used as the only source of information about a client (Anastasi,
1992).
Corroborating data from a number of sources helps create a more thorough
understanding of the client and his or her presenting concerns. The counselor can then
interpret these data and formulate hypotheses related to the client’s strengths and
weaknesses. Data gathered and the hypotheses formed, thereby, contribute to the
creation of an effective counseling strategy. This digest discusses how counselors can
use assessment as a continuous process throughout treatment. It also reviews three
common forms of assessment techniques which can be used in conjunction with testing.
CONTINUOUS ASSESSMENT
Vacc (1982) notes, “Assessment in counseling should be viewed not as a one-time
prediction activity but rather as continuous throughout the counseling process…” (p.40).
Continuous assessment influences the direction of treatment in two ways. First,
presenting concerns and client circumstances are not static. Goals identified by the
client during the initial assessment often must be modified or re-ordered to meet new
and urgent client needs. Continuous assessment apprises the counselor of possible
new and urgent needs which have arisen since the initial assessment. These needs can
then be addressed through the counseling process. Second, assessment can aid in
evaluating the efficacy of treatment. Upon entering treatment, an initial assessment
establishes the client’s baseline of functioning. Continuous assessment allows
comparisons between this initial base-line and the client’s current functioning.
www.eric.ed.gov ERIC Custom Transformations Team
Page 2 of 6 ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
Improvements suggest treatment efficacy and the benefit of continuing the current
treatment course. Reduction in functioning or a lack of improvement, however, suggests
a need to alter treatment. Continuous assessment, therefore, is important, because it
keeps the counselor apprised of the client’s ever changing needs and indicates
treatment efficacy.
QUALITATIVE ASSESSMENT
Qualitative assessment techniques are compatible with the belief that “…assessment
activities should not stand outside the change process; rather, they should blend into
treatment strategies to guide self-discovery and to inform clients” (Drum, 1992, p. 622).
Unlike standardized tests, qualitative assessments often consist of games or simulation
exercises that are flexible, open-ended, holistic, and nonstatistical (Goldman, 1992).
Typically a debriefing follows the qualitative assessment experience. Clients can
process what they learned from the experience immediately within the counseling
session.
One commonly used qualitative assessment experience is called, “The Life Line”
(Goldman, 1992). The intent of this experience is to help clients reflect upon significant
past events which have influenced them. Clients draw a horizontal timeline on a blank
sheet of paper. They are then asked to recall past significant experiences, relationships,
events or wishes which have influenced their lives, and to plot these along the timeline.
The result gives the counselor detailed information about significant events in the
client’s developmental history.
Similarly, role plays can serve as a qualitative assessment experience. For example, a
mental health counselor may ask a client to role play a recent anxiety provoking
experience (e.g., an argument with a supervisor, receiving a speeding ticket, etc.). The
role play provides the mental health counselor with a sample of the client’s behaviors.
As the role play is being demonstrated the counselor can query the client regarding
possible negative self-talk (e.g., I’m so stupid, he’ll never listen to me, etc.).
Understanding the self-talk used by a client can help the counselor generate effective
intervention ideas. Clients can also practice new counselor-directed behaviors or
self-talk (e.g., I’m intelligent, he’ll want to listen to me) within the counseling session
through role plays.
Another qualitative assessment technique that can provide valuable information is a
photograph safari. Depending upon the presenting concerns, the counselor may request
that the client bring to the session photographs of the client’s family-of-origin or
childhood. The counselor and client can jointly review these photographs. Particular
attention should be paid to: (a) those present in the photographs; (b) those consistently
absent from the photographs (e.g., Are the client’s siblings always included in the
photographs but the client absent?); (c) common themes of the photographs (e.g., Are
all the pictures taken on the family farm? Are pictures only taken during certain
holidays?); (d) proximity to significant others posing in the photographs (e.g., Is the
client consistently posed beside the client’s father? Is the client consistently standing
ERIC Resource Center www.eric.ed.gov
ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
Page 3 of 6
apart from other family members?); and (e) emotions displayed on family member faces
(e.g., Does the client consistently pout or appear angry in photographs?). Such
qualitative assessment techniques can promote insight for the client and therapeutic
direction for the counselor.
BEHAVIORAL ASSESSMENT
Counselors using behavioral assessments are most interested in recording manifest
behaviors. Emphasis is placed upon identifying antecedents to problem behaviors and
consequences that reduce their frequency or eliminate them (Galassi & Perot, 1992).
Both indirect and direct methods are used for behavioral assessments. Indirect methods
of behavioral assessment might include the counselor interviewing the client or talking
to significant others about the reported problem behavior. Indirect behavioral
assessment provides important information about the client and the client’s presenting
concerns, but the information obtained may be contaminated by misperceptions or
biases about the client or the client’s behaviors. More direct methods reduce the
probability of misperceptions or biases, and might include counselor observation of the
client or client self-monitoring. A behavioral problem checklist or procedures especially
designed to record the client’s concerns directly (e.g., recording the frequency, duration
and intensity of marital arguments) can be used to help clarify possible antecedents to
behavioral problems and record what subsequent interactions result in their
discontinuance.
PAST RECORDS
Reviewing previous client records (e.g., counseling, school, police, medical, military,
etc.) help the mental health counselor identify important patterns which the client may
be unaware of or disinclined to discuss readily (e.g., problems with authority figures,
self-injurious behaviors occurring after the ending of significant relationships, etc.).
These records can be a vital source of information. Often a review of previous
counseling records will indicate what types of treatment were attempted. Previously
ineffective treatments can be ruled out, and treatment regimes found helpful
re-implemented.
Concomitantly, past records link the client’s history to the presenting concern. A
counselor can gain increased clarity of the immediate concern based upon an improved
understanding of previous stressors or transitions leading to the client’s current
condition. The Counselor can then address the cause(s) of the symptoms rather than
the symptoms, themselves.
SUMMARY
Assessment provides direction for treatment and aids in the evaluation process.
Although many methods can be employed to promote a thorough assessment, no one
method should be used by itself. Ultimately, it is the counselor’s responsibility to gain
www.eric.ed.gov ERIC Custom Transformations Team
Page 4 of 6 ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
sufficient information regarding the client and the client’s presenting concerns to
establish an effective treatment strategy. Using a combination of assessment
techniques increases the likelihood of positive interventions and promotes successful
treatment.
REFERENCES
Anastasi, A. (1992). What counselors should know about the use and interpretation of
psychological tests. Journal of Counseling & Development, 70(5), 610-615.
Cohen, R. J., Swerdlik, M. E., & Smith, D. K. (1992). Psychological testing and
assessment: An introduction to tests and measurements. Mountain View, CA: Mayfield
Publishing Company.
Drum, D. J. (1992). A review of Leo Goldman’s article “Qualitative assessment: An
approach for Counselors.” Journal of Counseling & Development, 70(5), 622-623.
Galassi, J. P. & Perot, A. R. (1992). What you should know about behavioral
assessment. Journal of Counseling & Development, 70(5), 624-631.
Goldman, L. (1992). Qualitative assessment: An approach for counselors. Journal of
Counseling & Development, 70(5), 616-621.
Lambert, M. J., Ogles, B. M., & Masters, K. S. (1992). Choosing outcome assessment
devices: An organizational and conceptual scheme. Journal of Counseling &
Development, 70(4), 527-532.
Piotrowski, C., & Keller, J. W. (1992). Projective techniques: An international
perspective. (ED 355 273).
Vacc, N. A. (1982). A conceptual framework for continuous assessment of clients.
Measurement and Evaluation in Guidance, 15 (1), 40-47.
Watkins, C. E., (1994). Thinking about “Tests and Assessment” and the career beliefs
inventory. Journal of Counseling & Development, 72(4), 421-423.
Gerald A. Juhnke is an assistant professor and Clinic Coordinator in the Department of
Counseling and Educational Development in the School of Education at the University
of North Carolina at Greensboro.
ERIC Digests are in the public domain and may be freely reproduced and disseminated.
This publication was funded by the U.S. Department of Education, Office of Educational
Research and Improvement, Contract No. RR93002004. Opinions expressed in this
report do not necessarily reflect the positions of the U.S. Department of Education,
OERI, or ERIC/CASS.
ERIC Resource Center www.eric.ed.gov
ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
Page 5 of 6
Title: Mental Health Counseling Assessment: Broadening One’s Understanding of the
Client and the Clients Presenting Concerns. ERIC Digest.
Document Type: Information Analyses—ERIC Information Analysis Products (IAPs)
(071); Information Analyses—ERIC Digests (Selected) in Full Text (073);
Available From: ERIC/CASS, School of Education, 101 Park Building, University of
North Carolina at Greensboro, Greensboro, NC 27412 (free).
Descriptors: Behavior Patterns, Client Characteristics (Human Services), Counseling
Techniques, Counselor Client Relationship, Data Analysis, Data Collection, Evaluation,
Evaluation Methods, Evaluation Utilization, Personality Assessment, Psychological
Evaluation, Qualitative Research
Identifiers: ERIC Digests
###
[Return to ERIC Digest Search Page]
www.eric.ed.gov ERIC Custom Transformations Team
Page 6 of 6 ED388883 1995-00-00 Mental Health Counseling Assessment: Broadening One’s
Understanding of the Client and the Clients Presenting Concerns. ERIC Digest.
/databases/ERIC_Digests/index/
/databases/ERIC_Digests/index/
Training Therapists in Evidence-Based Practice: A Critical
Review of Studies From a Systems-Contextual Perspectiv
e
Rinad S. Beidas and Philip C. Kendall, Department of Psychology, Temple Universit
y
Evidence-based practice (EBP), a preferred psychologi-
cal treatment approach, requires training of community
providers. The systems-contextual (SC) perspective, a
model for dissemination and implementation efforts,
underscores the importance of the therapist, client, an
d
organizational variables that influence training and con-
sequent therapist uptake and adoption of EBP. Thi
s
review critiques the extant research on training in EBP
from an SC perspective. Findings suggest that therapist
knowledge improves and attitudinal change occurs fol-
lowing training. However, change in therapist behavio
rs
(e.g., adherence, competence, and skill) and client out-
comes only occurs when training interventions address
each level of the SC model and include active learning
.
Limitations as well as areas for future research are
discussed.
Key words: dissemination and implementation, evi-
dence-based practice, systems-contextual perspective,
therapist training. [Clin Psychol Sci Prac 17: 1–30, 2010]
The American Psychological Association (APA) and the
American Academy of Child and Adolescent Psychiatry
(AACAP) support the provision of evidence-based prac-
tice (EBP; American Academy of Child and Adolescent
Psychiatry, 2006; American Psychological Association,
2005). However, a report by the United States Surgeo
n
General (1999) suggests that the majority of clients with
mental illness do not receive EBP. There are obstacles in
the dissemination and implementation (DI) of EBP into
clinical practice (e.g., criticism of treatment manuals,
inadequate training, and unsupportive organizational
climates). Understanding how to best disseminate EBP is
paramount to reducing the gap between research and
practice (Addis & Krasnow, 2000; Hayes, 2002;
Herschell, McNeil, & McNeil, 2004).
Multiple terms have been used interchangeably, and
at times inaccurately, in this area (Kendall & Beidas,
2007). EBP
1
as defined by the American Psychological
Association (2005) is ‘‘the integration of the best avail-
able research with clinical expertise.’’ ESTs refer to
psychological interventions that have been evaluated
scientifically (e.g., a randomized controlled trial, RCT)
and satisfy the criteria outlined in Chambless and
Hollon (1998). DI research includes the purposeful
distribution of relevant information and materials to
therapists (i.e., dissemination) and the adoption and
integration of EPB into practice (i.e., implementation;
Lomas, 1993). Our focus is on training as it relates to
DI research: How does training influence therapist
knowledge and behavior (adherence, competence, and
skill), and how does the therapist’s context (organiza-
tional support and client population) influence adop-
tion and implementation of interventions?
To understand training as it relates to DI, a systems-
contextual (SC) approach is warranted. The SC per-
spective recommends that when considering the effec
ts
of training on therapist behavior, contextual factors
such as therapist variables, organizational support, qual-
ity of training program, and client variables (Sanders &
Turner, 2005; Turner & Sanders, 2006) should be
Address correspondence to Rinad S. Beidas, Department of
Psychology, Temple University, Weiss Hall, Philadelphia, P
A
19122. E-mail: rbeidas@temple.edu.
This project was supported by the Ruth L. Kirschstein
National Research Service Award (F31 MH083333) awarded
to the first author.
� 2010 American Psychological Association. Published by Wiley Periodicals, Inc., on behalf of the American Psychological Association.
All rights reserved. For permissions, please email: permissionsuk@wiley.com 1
examined. Studying the outcomes of training without
addressing contextual variables is insufficient becau
se
training and potential implementations occur within a
system. Effective DI may occur when therapists are
trained appropriately and when the context supports
behavior change (Sanders & Turner, 2005). Such an
approach is holistic and provides an understanding of
how training influences an individual within a system.
Each component of the SC model (i.e., quality of
training, practitioner variables, client variables, and
organizational support) will be operationalized and
expanded upon below.
The quality of training provided to therapists refers to
the availability of training for individuals interested in
implementing an EBP, as well as the content and
method of the training. The current ‘‘gold standard’’ of
training in EBP includes a workshop, a manual, and
clinical supervision (Sholomskas, Syracuse-Siewert,
Rounsaville, Ball, & Nuro, 2005). The quality of train-
ing in EBP is likely to vary based on when therapists
received their graduate training. Therapists trained
before 1995 are unlikely to have had an emphasis on
EBP, while those trained after 1995 have had varied
exposure to EBP during training (Karekla, Lundgren,
& Forsyth, 2004). A 1995 survey of training directors
found that doctoral programs in clinical psychology
covered about 50% of EBP (specifically—ESTs) and
that most internships did not require competence in
EBP (specifically—ESTs; Crits-Christoph, Frank,
Chambless, Brody, & Karp, 1995). Similarly, a survey
of 200 trainees in APA-accredited programs found that
32% had no coursework in EBP (specifically—ESTs)
and over 65% had not read any of the major Task
Force reports regarding EBP (specifically—ESTs).
Those who had read the Task Force reports tended to
be cognitive-behavioral in orientation (Karekla et al.,
2004). These findings suggest that experienced thera-
pists are not likely to have received training in EBP,
and that newer therapists may have received training in
some aspects of EBP.
Importantly in our view, the content and method
(i.e., overall quality) of the training program is crucial
to successful DI. Some suggest that training content is
important and prefer a focus on principles, rather than
teaching the details of manuals (Abramowitz, 2006;
Hayes, 2002; Miller, Yahne, Moyers, Martinez, &
Pirritano, 2004). Miller et al. (2004) noted that the
appropriate training approach includes an emphasis on
principles and the ‘‘underlying spirit’’ of a treatment
rather than a focus on techniques. Further empirical
study is needed to determine the appropriate focus of
training content.
Training method is an important vehicle through
which change in therapist behavior may be achieved.
Current training methods include passively delivered
didactic lectures (e.g., the format of a continuing edu-
cation workshop) despite findings that this type of
instruction has limited effects on behavior change
(El-Tannir, 2002). Active learning, an alternative to
passive learning, is an interactive process that uses
action and reflection. Active learning is useful for skills
that must be employed within a clinical context (Cross,
Matthieu, Cerel, & Knox, 2007) and has been
employed successfully in the Triple P-Positive Parent-
ing Program (Triple P) training program (Sanders &
Turner, 2005). Cross et al. (2007) endorse active learn-
ing methods (modeling, practice opportunities, buildin
g
self-efficacy, and interaction among learners), which
may be accomplished through behavioral role-play
s.
Including behavioral role-plays as part of training
improved behavior in both clinical and nonclinical
employees in suicide prevention efforts (Cross et al.,
2007; Matthieu, Cross, Batres, Flora, & Knox, 2008).
Change in behavior may be less robust without the
inclusion of behavioral role-plays in training (Wyman
et al., 2008). Further empirical study of the contribu-
tion of active learning to effective DI efforts is needed.
Therapist attributes may be an important aspect of
whether training produces differential learning and sub-
sequent behavior change. Therapist variables include
individual attributes such as clinical experience, theo-
retical orientation, and therapist attitudes towards EBP.
Conflicting evidence exists regarding whether or not
prior clinical experience influences skill acquisition.
One study found that prior general clinical experience
did not influence therapist skill acquisition in cognitive
therapy (CT), but that prior specific clinical experience
in CT facilitated skill acquisition (James, Blackburn,
Milne, & Reichfelt, 2001). Another study comparing
practicing therapists to trainee therapists suggested that
clinical experience did not moderate skill attainment
(DeViva, 2006).
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 2
Therapist attitudes towards EBP have been exam-
ined in survey format (e.g., Addis & Krasnow, 2000;
Najavits, Weiss, Shaw, & Dierberger, 2000), with
mixed results. Some suggest that therapists hold favor-
able attitudes towards EBP (Najavits et al., 2000),
whereas others suggest that therapists hold unfavorable
attitudes towards EBP (Addis & Krasnow, 2000). The-
oretical orientation may be an individual difference that
explains these mixed results: In the first study, partici-
pants were mainly identified as cognitive-behavioral,
whereas in the second study, a large variety of theoreti-
cal orientations were surveyed. Another therapist dif-
ference explaining these discrepant findings may be
clinical experience: Those earlier on in their careers
(e.g., predoctoral interns) may hold more favorable
attitudes towards EBP when compared with those who
are more advanced in their careers (e.g., practicing
therapists; Aarons, 2004). Few studies have explicitly
examined therapist attributes and attitudes towards EBP
as predictors of training outcomes, which may inform
who will benefit most from training.
Variables relating to organizational support (e.g., clini-
cal supervision and organizational environment) can
also impact therapist training outcomes. Reading a
manual and attending a workshop may start the transfe
r
of knowledge (i.e., dissemination), but ongoing super-
vision may be needed for actual therapist behavior
change and skillful implementation (Bazelmans, Prins,
Hoogveld, & Bleijenberg, 2004; Herschell et al., 2004;
Kendall & Southam-Gerow, 1996). Research on evi-
dence-based supervision is sparse (Ellis, Krengel,
Ladany, & Schult, 1996; Holloway & Neufeldt, 1995),
but it is likely that learning occurs and confidence is
built during the supervisory process. Competent super-
visors may be related to therapist adherence and com-
petence (Henggeler, Schoenwald, Liao, Letourneau, &
Edwards, 2002), two therapist behaviors that are crucial
for fidelity to a treatment (Perpepletchikova & Kazdin,
2005). In addition, continued supervision may decrease
therapist psychological barriers to adoption of EBP
(specifically ESTs; Luoma et al., 2007).
The particulars on supervision differ by intervention,
but one feasible model comes from Turner and
Sanders’s (2006) Triple P approach. Supervision
includes updates on Triple P research through newslet-
ters, conferences, a website, and a question and answer
forum. The approach includes self-monitoring and self-
regulation, which allows therapists to direct their own
learning and skill acquisition following training (Sand-
ers & Turner, 2005). Other organizational support
variables important for therapist behavior change
include organizational openness to change and an orga-
nizational structure that supports implementation of
EBP (Zazzali
et al., 2008).
Client variables must be accounted for when consid-
ering successful therapist training outcomes. Client
variables include a therapist’s belief that a particular
EBP can be useful for his or her client population
when considering the severity and risk factors of such
clients (Turner & Sanders, 2006). Some believe that
research samples are not representative of community
samples because the selection criteria of RCTs are not
generally inclusive and comorbidity is not highly repre-
sented (Westen, Novotny, & Thompson-Brenner,
2004). However, other researchers (e.g., Stirman,
DeRubeis, Crits-Christoph, & Rothman, 2005) have
demonstrated that these differences may be overstated.
Stirman et al. (2005) mapped charts of individuals seek-
ing treatment under managed care to the criteria of
nearly 100 RCTs and identified that 80% of these indi-
viduals would be eligible for at least one RCT, and the
majority did not have more complex diagnostic profiles
than participants included in RCTs. It is important to
address therapists, concerns that a treatment is viable
for their clients and that a treatment allows for flexible
application (Kendall & Beidas, 2007). Additionally,
given the ultimate goal of DI (i.e., client access to
EBP), client outcomes following therapist training are
key dependent variables that must be examined.
This review examines studies that train therapists in
EBP from an SC perspective as recommended by
Sanders and Turner (2005) and Turner and Sanders
(2006). This perspective is ecological in nature in that
it views DI as occurring through complex bidirectional
processes between the practitioner, practitioner’s envi-
ronment, and quality of the training (Sanders &
Turner, 2005). Additionally, the perspective views the
practitioner as embedded within a broader working
environment that influences practitioner implementa-
tion of innovation (Sanders & Turner, 2005).
The
primary aim of this review was to identify training
studies and consider which level of the SC model (i.e.,
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 3
therapist variables, client variables, organizational
support, and training) was addressed. Secondarily, we
characterize the quality of the training, with an empha-
sis on training method (e.g., active and ⁄ or passive
learning strategies) and content (i.e., a focus on
principles or the teaching of a manual session by
session).
METHOD
S
A systematic literature review for the 18-year period
spanning 1990–2008 was conducted. Published journal
articles, abstracts, and books were identified via Psych-
Info and PubMed. Key words included ‘‘training,’’
‘‘dissemination,’’ ‘‘implementation,’’ ‘‘adherence,’’
‘‘competence,’’ and ‘‘therapists.’’ Additionally, reference
lists of relevant articles guided the identification of
appropriate studies. Studies were included if they trained
service providers (e.g., social workers, psychologists,
physicians, substance abuse counselors, secondary school
staff, master’s-level clinicians, and nurses) in EBP or
ESTs for at-risk or clinical populations.
2
Training studies
not affiliated with an evidence base were not included,
nor were trainings in single techniques. All studies
included in this review focused on training in EBP (see
Table 1). Unpublished theses or dissertations were not
included.
We operationalized the four levels of the systems-
contextual approach to DI as follows: (a) therapist vari-
ables: Study included at least one measure of therapist
attitudes and ⁄ or a comprehensive measure of clinical
experience and theoretical orientation,
3
(b) organiza-
tional support: Study included at least one measure of
organizational characteristics and ⁄ or provided ongoing
consultation or supervision, (c) quality of training pro-
cesses:
4
Study provided training and described training
sufficiently so that characteristics of training could be
identified, and (d) client variables: Study included at
least one measure of severity, risk factors, and resiliency
Table 1. Evidence-based practices (EBPs) included in this study
EBP References
Classifying body
deeming the
treatment to be
an EBP
Dialectical behavior therapy for borderline personality
disorder
Hawkins and Sinha (1998) A
Motivational interviewing for substance abuse Baer et al. (2004); Hunter et al. (2005); Miller and Mount
(2001); Miller et al. (2004); Rubel et al. (2000); Schoener
et al. (2006); Saitz et al. (2000)
A
Cognitive behavior therapy for eating disorders McVey et al. (2005) A
Interpersonal therapy for eating disorders McVey et al. (2005) A
Cognitive-behavioral therapy for child anxiety Beidas et al. (2009) A
Behavioral therapy for anxiety Gega, Norman, & Marks (2007) A
Trauma-focused cognitive-behavioral therapy National Crime Victims Research & Treatment Center
(2007)
C
Intervention for youth suicide Chagnon et al. (2007); Cross et al. (2007); Wyman et al.
(2008)
B
Cognitive and ⁄ or cognitive-behavioral therapy for
substance abuse
Crits-Christoph et al. (1998); Morganstern et al. (2001);
Sholomskas et al. (2005); Siqueland et al. (2000);
Watkins et al. (2008)
A
Dynamic therapy for substance abuse Crits-Christoph et al. (1998); Siqueland et al. (2000) A
Drug counseling for substance abuse Crits-Christoph et al. (1998); Luoma et al. (2007);
Siqueland et al. (2000)
B
Triple P parenting program for at-risk youth Sanders, Murphy-Brennan, et al. (2003) B
Time-limited dynamic psychotherapy for adults with Axis I
and II disorders
Bein et al. (2000); Henry, Schacht, et al. (1993); Henry,
Strupp, et al. (1993)
A
Behavioral family therapy for relatives caring for family
member with schizophrenia
Brooker and Butterworth (1993); Fadden (1997) A
Cognitive-behavioral therapy for youth and young adults
presenting to primary care
Maunder et al. (2008) A
Contingency management for youth substance abuse Henggeler, Chapman, et al. (2008); Henggeler, Sheidow,
et al. (2008)
C
Multisystemic therapy for youth substance abuse Henggeler, Sheidow, et al. (2008) C
Note. As cited in A, Chambless & Ollendick (2001); B, Substance Abuse and Mental Health Services Administration (www.nationalregistry.samhsa.gov);
C, Special section of Journal of Clinical Child and Adolescent Psychology (Silverman, Pina, & Viswesvaran, 2008).
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 4
of therapist’s client population, or included a measure of
client treatment outcome (e.g., diagnostic interview).
We operationalized the training method as employ-
ing passive (e.g., didactic presentation, lectures, and
seminars) and ⁄ or active learning strategies (e.g., behav-
ioral role-plays, feedback, coaching, and experiential
exercises). Training content was defined as focusing
on principles of the treatment (i.e., the underlying
foundational principles of the EBP) or teaching the
manual and going through the treatment session by
session.
Outcome measures included both self-reported (e.g.,
therapist attitudes) and independently rated (e.g., thera-
pist adherence) variables. Studies were classified as
using standardized measures if the report indicated ade-
quate psychometric properties (i.e., reliability: intraclass
coefficients or kappa values above 0.60; Landis &
Koch, 1977; adequate validity) and if the measure was
used in more than one research report. Studies were
classified as using nonstandardized investigator-created
measures if psychometric properties were not reported,
were not adequate, or if the measure was only used in
one study. Studies that included the outcome measures
of knowledge,
5
adherence, and skill ⁄ competence were
emphasized given the importance of these constructs in
the transportation of a treatment (Perpepletchikova &
Kazdin, 2005). Additionally, we note whether gains
made in various outcome measures (i.e., knowledge,
adherence, and skill ⁄ competence) suggest therapist pro-
ficiency. An 80% score was used to mark proficiency
in therapist knowledge and behavior. Eighty percent
was used as the cutoff, consistent with training condi-
tions used in other evaluations of EBP as the criterion
to be satisfied prior to being certified to deliver a treat-
ment (e.g., Seng, Prinz, & Sanders, 2006; Sholomaskas
et al., 2005; Walkup et al., 2008).
RESULTS
Many DI studies (32) of training have been reported,
but few (3) assess and measure all domains of the SC
model. Studies in this review are organized as follows:
those that address (a) training, (b) training and organi-
zational support, (c) training and therapist variables, (d)
training and client variables, (e) training, organizational
support, and therapist variables, (f) training, organiza-
tional support, and client variables, and (g) training,
organizational support, therapist variables, and client
variables.
6
Training
Description of Studies. Eight studies focused on train-
ing (see Table 2). The following EBPs were studied:
(a) dialectical behavior therapy (DBT) for borderline
personality disorder (Hawkins & Sinha, 1998), (b)
motivational interviewing (MI) for adult substance
abuse (Baer, Rosengren, Dunn, Wells, & Ogle, 2004),
(c) CBT and interpersonal therapy (IPT) for eating dis-
orders (ED) (McVey et al., 2005), (d) CBT for youth
anxiety (Beidas, Barmish, & Kendall, 2009), (e)
trauma-focused CBT (tf-CBT) for traumatized youth
(National Crime Victims Research & Treatment Cen-
ter, 2007), (f) behavior therapy (BT) for anxiety (Gega,
Norman, & Marks, 2007), (g) the Question, Persuade,
Refer (QPR) prevention program for youth suicide
(Cross et al., 2007), and (h) Triple P for externalizing
behaviors in youth (Sanders, Tully, Turner, Maher, &
McAuliffe, 2003). One study used an RCT design
(Gega et al., 2007), whereas the other studies used a
nonrandomized, convenience-sample, pre–post quasi-
experimental design. Study sample sizes ranged from 20
to 4,387 participants and educational level ranged from
bache
lor’s to postgraduate degrees (e.g., MD, PhD, and
PsyD). Most participants were community mental
health providers.
Training Method and Content. One study exclusively
included passive learning (e.g., didactic presentation;
Gega et al., 2007), whereas four included both passive
and active learning (e.g., experiential learning, inter-
active computer exercises, role-plays; Baer et al., 2004;
Cross et al., 2007; National Crime Victims Research &
Treatment Center, 2007;
Sanders, Tully, et al., 2003).
Two studies did not provide sufficient description of
the training to identify training method (Hawkins &
Sinha, 1998; McVey et al., 2005). When sufficiently
described, training content included a focus on review-
ing each session of the treatment protocol (Beidas
et al., 2009; National Crime Victims Research &
Treatment Center, 2007; Sanders, Tully, et al., 2003)
or a focus on principles and ⁄ or the underlying spirit of
the treatment (Baer et al., 2004; Gega et al., 2007).
Training duration varied widely from one hour (Cross
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 5
T
a
b
le
2
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
B
a
e
r
e
t
a
l.
(
2
0
0
4
)
2
2
M
I
A
d
u
lt
su
b
st
.
u
se
A
d
d
ic
ti
o
n
a
n
d
m
e
n
ta
l
h
e
a
lt
h
cl
in
ic
ia
n
s
2
-d
a
y
1
4
-h
o
u
r
w
o
rk
sh
o
p
w
it
h
b
ri
e
f
d
id
a
ct
ic
s
a
n
d
e
x
p
e
ri
e
n
ti
a
l
a
ct
iv
it
ie
s
E
x
p
e
ri
e
n
ti
a
l
a
ct
iv
it
ie
s
(s
m
a
ll
g
ro
u
p
p
ra
ct
ic
e
)
1
.
H
R
Q
2
.
co
d
e
d
M
IS
C
(O
Q
,
C
R
,
R
:Q
,
M
I-
C
b
e
h
a
v
io
r
,
M
I-
In
c
b
e
h
a
v
io
r)
C
o
n
v
e
n
ie
n
ce
s
a
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
2
-m
o
n
th
f
⁄u
;
S
M
1
.
In
cr
e
a
se
in
H
R
Q
+
R
:Q
,
O
Q
,
M
I-
C
a
t
p
re
–
p
o
st
2
.
In
cr
e
a
se
in
H
R
Q
+
R
:Q
m
a
in
ta
in
e
d
a
t
f
⁄u
B
e
id
a
s
e
t
a
l.
(2
0
0
9
)
2
0
C
B
T
C
h
ild
a
n
x
ie
ty
P
sy
D
tr
a
in
e
e
s
2
-h
o
u
r
d
id
a
ct
ic
w
o
rk
sh
o
p
p
lu
s
m
a
n
u
a
l
N
o
n
e
1
.
R
a
te
d
A
2
.
R
a
te
d
S
3
.
K
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
n
o
f
⁄u
;
IC
M
1
.
In
cr
e
a
se
in
K
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t
2
.
N
o
in
cr
e
a
se
in
A
,
o
r
S
C
r
o
ss
e
t
a
l.
(2
0
0
7
)
7
6
Q
P
R
Y
o
u
th
su
ic
id
e
p
re
v
e
n
ti
o
n
N
o
n
cl
in
ic
a
l
e
m
p
lo
y
e
e
s
1
-h
o
u
r
w
o
rk
sh
o
p
p
lu
s
ro
le
-p
la
y
E
x
p
e
ri
e
n
ti
a
l
b
e
h
a
v
io
ra
l
ro
le
–
p
la
y
1
.
d
e
c
K
2
.
p
e
r
K
3
.
se
lf
-e
ffi
ca
cy
4
.
S
a
5
.
d
if
fu
si
o
n
o
f
K
6
.
ra
te
d
S
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
6
-w
e
e
k
f
⁄u
;
IC
M
1
.
d
e
c
K
,
p
e
r
K
,
in
cr
e
a
se
d
p
re
–
p
o
st
.
2
.
h
ig
h
S
a
a
t
p
o
st
a
ss
e
ss
m
e
n
t.
3
.
H
ig
h
d
if
fu
si
o
n
a
t
p
o
st
a
ss
e
ss
m
e
n
t
4
.
S
ra
n
g
e
d
b
e
tw
e
e
n
1
1
.7
9
⁄1
5
a
t
p
o
st
a
ss
e
ss
m
e
n
t
a
n
d
1
1
.4
3
⁄1
5
a
t
f
⁄u
(n
o
si
g
.
d
if
f)
.
G
e
g
a
,
N
o
rm
a
n
&
M
a
rk
s
(2
0
0
7
)
9
2
B
T
P
ri
m
.
ca
re
N
u
rs
in
g
st
u
d
e
n
ts
4
-h
o
u
r
co
m
p
u
te
r
tr
a
in
in
g
o
r
4
-h
o
u
r
w
o
rk
sh
o
p
N
o
n
e
1
.
K
2
.
ra
te
d
S
3
.
S
a
R
a
n
d
o
m
iz
e
d
co
n
tr
o
lle
d
tr
ia
l
w
it
h
cr
o
ss
o
v
e
r;
n
o
f
⁄u
;
IC
M
1
.
B
o
th
co
n
d
it
io
n
s
im
p
ro
v
e
d
K
,
ra
te
d
S
,
a
n
d
S
a
e
q
u
a
lly
w
h
e
n
p
ro
v
id
e
d
a
lo
n
e
.
N
o
a
d
d
e
d
b
e
n
e
fi
t
to
d
o
in
g
b
o
th
tr
a
in
in
g
s.
H
a
w
k
in
s
a
n
d
S
in
h
a
(1
9
9
8
)
1
0
9
D
B
T
B
P
D
C
o
m
m
u
n
it
y
cl
in
ic
ia
n
s
N
o
t
d
e
sc
ri
b
e
d
N
o
t
d
e
sc
ri
b
e
d
1
.
K
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
n
o
f
⁄u
;
IC
M
1
.
K
in
cr
e
a
se
d
p
re
–
p
o
st
2
.
K
p
re
d
ic
to
rs
:
st
u
d
y
g
ro
u
p
a
tt
e
n
d
a
n
ce
,
ti
m
e
a
p
p
ly
in
g
tx
,
r
e
a
d
in
g
,
p
e
e
r
co
n
su
lt
M
cV
e
y
e
t
a
l.
(2
0
0
5
)
3
3
1
5
C
B
T
⁄I
P
T
E
D
H
e
a
lt
h
-c
a
re
p
ra
ct
it
io
n
e
rs
w
it
h
p
ro
fe
ss
io
n
a
l
tr
a
in
in
g
3
-h
o
u
r
to
4
-d
a
y
in
te
n
si
v
e
w
o
rk
sh
o
p
s
a
n
d
m
a
n
u
a
l
N
o
t
d
e
sc
ri
b
e
d
1
.
p
e
r
K
2
.
co
m
f
o
rt
in
tr
e
a
ti
n
g
o
r
te
a
ch
in
g
a
b
o
u
t
E
D
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
n
o
f
⁄u
;
IC
M
1
.
In
cr
e
a
se
in
p
e
r
K
a
n
d
co
m
fo
rt
p
re
–
p
o
st
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 6
et al., 2007) to five days (Hawkins & Sinha, 1998).
Three studies used manuals to supplement the didactic
presentation (Beidas et al., 2009; McVey et al., 2005;
Sanders, Tully, et al., 2003).
Outcome Measures. The outcome measures for the
majority of the studies were self-reports, with the
exception of independently rated adherence and skill.
Self-reported outcomes included knowledge,
satisfaction, level of comfort with providing treatment,
self-efficacy, training experiences, and diffusion of
knowledge. Two studies (Baer et al., 2004; Sanders,
Tully, et al., 2003) used psychometrically sound stan-
dardized measures, whereas the other studies used
investigator-created nonstandardized measures.
Summary of Studies. Studies using only self-report
questionnaires (e.g., knowledge and satisfaction) were
considered less rigorous than studies that included inde-
pendently rated adherence and ⁄ or skill given the find-
ing that knowledge change is often not generalized as
actual behavior change (Miller, Sorensen, Selzer, &
Brigham, 2006). Surveyed mental health professionals
(n = 3,315) reported a statistically significant increase in
perceived knowledge of ED, an increase in level of
comfort in treating ED, and increased comfort teaching
others about ED treatment after receiving differential
doses of training (McVey et al., 2005). Training varied
across participants, ranging from three hours to four
days, and knowledge was not objectively measured.
Another study objectively measured declarative
knowledge and concluded that community mental
health providers (n = 109) were able to reach profi-
ciency in DBT after receiving unspecified dosages of
training (training varied across participants; Hawkins &
Sinha, 1998). In the group that attended the highest dose
of training (n = 36; a five-day intensive workshop), the
highest percentage of correct answers on a knowledge
test was 67.6. Although the authors conclude that partic-
ipants learned the protocol, they did not achieve profi-
ciency according to the 80% criterion. Another study
objectively measuring knowledge found that a multime-
dia web-based distance learning program for mental
health professionals seeking training in tf-CBT signifi-
cantly increased participants’ knowledge (National
Crime Victims Research & Treatment Center, 2007)Ta
b
le
2
.
(C
o
n
ti
n
u
e
d
)
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
N
a
ti
o
n
a
l
C
ri
m
e
V
ic
ti
m
s
R
e
se
a
rc
h
&
T
re
a
tm
e
n
t
C
e
n
te
r
(2
0
0
7
)
4
,3
8
7
tf
-C
B
T
Y
o
u
th
tr
a
u
m
a
M
e
n
ta
l
h
e
a
lt
h
p
ro
fe
ss
io
n
a
ls
1
0
-h
o
u
r
w
e
b
-b
a
se
d
se
m
in
a
r
In
te
ra
ct
iv
e
co
m
p
u
te
r
p
ro
g
ra
m
(e
.g
.,
s
t
re
a
m
in
g
v
id
e
o
)
1
.
K
2
.
S
a
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
R
A
;
n
o
f
⁄u
;
IC
M
1
.
H
ig
h
S
a
a
t
p
o
st
a
ss
e
ss
m
e
n
t
2
.
S
ig
.
in
cr
e
a
se
in
K
fo
r
a
ll
1
0
m
o
d
u
le
s
S
a
n
d
e
rs
,
T
u
lly
,
e
t
a
l.
(2
0
0
3
)
3
2
T
ri
p
le
P
Y
o
u
th
b
e
h
a
v
io
r
p
ro
b
le
m
s
G
e
n
e
ra
l
p
h
y
si
ci
a
n
s
W
o
rk
sh
o
p
R
o
le
-p
la
y
a
n
d
f
e
e
d
b
a
ck
1
.
S
2
.
S
a
3
.
C
o
n
fi
d
e
n
ce
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
w
a
it
lis
t
co
m
p
a
ri
so
n
;
S
M
1
.
H
ig
h
e
r
S
in
tr
a
in
e
d
g
ro
u
p
2
.
H
ig
h
e
r
sa
ti
sf
a
ct
io
n
3
.
H
ig
h
e
r
co
n
fi
d
e
n
ce
N
o
te
.
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
H
R
Q
,
H
e
lp
fu
l
R
e
sp
o
n
se
s
Q
u
e
st
io
n
n
a
ir
e
;
M
IS
C
,
M
o
ti
v
a
ti
o
n
a
l
In
te
rv
ie
w
in
g
S
k
ill
s
C
o
d
e
(O
Q
,
o
p
e
n
q
u
e
st
io
n
s;
C
R
,
co
m
p
le
x
re
fl
e
ct
io
n
s;
R
:Q
,
ra
ti
o
o
f
re
fl
e
ct
io
n
s
to
q
u
e
st
io
n
s;
M
I-
C
,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
co
n
si
st
e
n
t;
M
I-
In
c,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
i
e
w
in
g
in
co
n
si
st
e
n
t)
;
R
A
,
ra
n
d
o
m
a
ss
ig
n
m
e
n
t;
f
⁄u
,
fo
ll
o
w
-u
p
a
ss
e
ss
m
e
n
t;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
C
B
T
,
co
g
n
it
iv
e
-b
e
h
a
v
io
ra
l
th
e
ra
p
y
;
A
,
a
d
h
e
re
n
ce
;
S
,
sk
ill
;
K
,
k
n
o
w
le
d
g
e
;
I
C
M
,
in
v
e
st
ig
a
to
r-
cr
e
a
te
d
m
e
a
su
re
s;
Q
P
R
,
q
u
e
st
io
n
,
p
e
rs
u
a
d
e
,
re
fe
r;
d
e
c
K
,
d
e
cl
a
ra
ti
v
e
k
n
o
w
le
d
g
e
;
p
e
r
K
,
p
e
rc
e
iv
e
d
k
n
o
w
le
d
g
e
;
S
a
,
sa
ti
sf
a
ct
io
n
;
B
T
,
b
e
h
a
v
io
r
th
e
ra
p
y
;
D
B
T
,
d
ia
le
ct
ic
a
l
b
e
h
a
v
io
r
th
e
ra
p
y
;
B
P
D
,
b
o
rd
e
rl
in
e
p
e
rs
o
n
a
lit
y
d
is
o
rd
e
r;
tx
,
tr
e
a
tm
e
n
t;
IP
T
,
in
te
rp
e
rs
o
n
a
l
th
e
ra
p
y
;
E
D
,
e
a
ti
n
g
d
is
o
rd
e
rs
;
tf
–
C
B
T
,
tr
a
u
m
a
-f
o
cu
se
d
C
B
T
.
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 7
from 61.9% to 82.1%, which suggests that participants
reached proficiency in their knowledge of tf-CBT.
Five studies measured self-reported knowledge and
independently rated therapist behavior. Following a
one-hour training workshop for nonclinical employees
(n = 76) in the QPR suicide prevention program
(Cross et al., 2007), participants reported satisfaction
with training, and significant increases in both per-
ceived knowledge (from 36% to 62%) and declarative
knowledge (from 69% to 85%). A subset of participants
(n = 26) completed a behavioral role-play from which
skill was coded. Fifty-five percent of participants
reached a satisfactory skill level (a score of 12 of 15),
whereas 45% did not.
Similar findings were observed after 20 trainees read
a manual and attended a 2.5-hour CBT workshop for
youth anxiety (Beidas et al., 2009). Participants showed
significant increases in knowledge (all reached the 80%
criterion). Following training, participants completed a
behavioral role-play from which adherence and skill
were coded. After training, none of the participants
reached 80% adherence, whereas 67% reached profi-
cient levels of skill in CBT for child anxiety. A similar
study compared the effectiveness of differing training
modalities (i.e., computer training versus a workshop)
on BT for anxiety. Following training, nursing stu-
dents (n = 92) showed comparable improvement in
knowledge, skills, and satisfaction in both conditions.
Note that although knowledge improved significantly
after training, participants were below the proficiency
level (average 71%). Additionally, skill was rated on
average as 4.3 of 8 points (Gega et al., 2006).
In a different treatment modality (i.e., MI), addiction
and mental health counselors (n = 22) received 24 hours
of training. After training, 53% of clinicians were rated
as proficient in their MI skills, and at two-month fol-
low-up, 42% were rated as proficient (Baer et al., 2004).
A study that trained general practitioners in the Triple P
program for externalizing youth found that a brief train-
ing emphasizing active learning produced significant
improvements in rated skill. Clinicians also reported
increased satisfaction and confidence in treatment deliv-
ery (Sanders, Tully, et al., 2003).
Conclusions. Both perceived and declarative knowledge
increase after receiving training in an EBP. Change in
declarative knowledge is especially important given the
implications it may have on treatment delivery. How-
ever, it remains unclear if knowledge gains indicate
proficiency in treatment delivery (e.g., Hawkins &
Sinha, 1998), and further empirical study is necessary.
Of those studies that included independently rated
behavior, proficiency in therapist skill ranged from 54%
to 67% at post-training and 42% at follow-up (Beidas
et al., 2009; Cross et al., 2007; Gega et al., 2006,
Sanders, Tully, et al., 2003). After training, none of the
participants reached proficiency in adherence (see
Beidas et al., 2009). This finding is alarming when
considering that skill and adherence (Perpepletchikova
& Kazdin, 2005) are crucial to the transportation of a
treatment from research to practice.
Limitations. Study-specific limitations include high
attrition rates (Beidas et al., 2009; National Crime Vic-
tims Research & Treatment Center, 2007), practice
effects, low content validity (e.g., only four questions
per section to assess knowledge; National Crime
Victims Research & Treatment Center, 2007), partici-
pants receiving differential training collapsed into one
larger sample (Hawkins & Sinha, 1998; McVey et al.,
2005), the examination of skill in only a subset of the
sample (Cross et al., 2007), and an inability to procure
all outcome variables (Baer et al., 2004).
Training and Organizational Support
Description of Studies. Six studies focused on both
training and organizational support (see Table 3). The
EBP training included (a) CBT for adult substance use
(Sholomskas et al., 2005), (b) CT, dynamic therapy
(DP), and drug counseling (DC) for adult substance
abuse (Crits-Christoph et al., 1998), (c) group drug
counseling (GDC) for adult substance abuse (Luoma
et al., 2007), (d) Triple P for youth behavior problems
(Sanders, Murphy-Brennan, & McAuliffe, 2003), (e)
time-limited dynamic psychotherapy (TLDP) for adults
(Henry, Strupp, Butler, Schacht, & Binder, 1993), and
(f) MI for substance abuse (Moyers et al., 2008). Three
studies used a nonrandomized, convenience-sample,
pre–post, quasi-experimental design (Crits-Christoph
et al., 1998; Henry, Strupp, et al., 1993; Sanders,
Murphy-Brennan, et al., 2003). Two studies randomly
assigned participants to a training condition and included
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 8
T
a
b
le
3
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
a
n
d
o
rg
a
n
iz
a
ti
o
n
a
l
su
p
p
o
rt
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
C
ri
ts
-C
h
ri
st
o
p
h
e
t
a
l.
(1
9
9
8
)
6
5
C
T
,
D
P
,
D
C
A
d
u
lt
s
u
b
st
.
u
se
T
h
e
ra
p
is
ts
a
n
d
co
u
n
se
lo
rs
M
a
n
u
a
l
+
4
tw
o
–
d
a
y
w
o
rk
sh
o
p
s
(d
id
a
ct
ic
,
ro
le
–
p
la
y
d
is
cu
ss
io
n
)
+
su
p
e
rv
is
io
n
R
o
le
-p
la
y
s
1
.
S
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
S
M
;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
f
⁄u
;
n
o
R
A
1
.
C
T
sh
o
w
e
d
p
e
r
tr
a
in
in
g
ca
se
(
a
cr
o
ss
ca
se
).
2
.
D
C
a
n
d
D
P
sh
o
w
e
d
le
a
rn
in
g
w
it
h
in
ca
se
s
b
u
t
n
o
t
a
cr
o
ss
.
H
e
n
ry
,
S
tr
u
p
p
,
e
t
a
l.
(1
9
9
3
)
1
6
T
L
D
P
A
d
u
lt
s
A
x
is
I
a
n
d
A
x
is
II
P
sy
ch
ia
tr
is
ts
a
n
d
p
sy
ch
o
lo
g
is
ts
5
0
w
e
e
k
ly
2
-h
o
u
r
w
o
rk
sh
o
p
s
(d
id
a
ct
ic
),
m
a
n
u
a
l,
su
p
e
rv
is
io
n
N
o
n
e
1
.
S
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
S
M
;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
f
⁄u
;
n
o
R
A
1
.
S
o
m
e
S
in
cr
e
a
se
d
a
n
d
so
m
e
d
e
cr
e
a
se
d
L
u
o
m
a
e
t
a
l.
(2
0
0
7
)
3
0
G
D
C
A
d
u
lt
su
b
st
.
u
se
C
o
m
m
u
n
it
y
cl
in
ic
ia
n
s
6
-h
o
u
r
w
o
rk
sh
o
p
(d
id
a
ct
ic
s,
q
⁄a
,
ro
le
–
p
la
y
s)
+
e
ig
h
t
1
.5
–
h
o
u
r
co
n
su
lt
a
ti
o
n
s
fr
o
m
a
n
A
C
T
a
n
d
r
e
la
p
se
p
re
v
e
n
ti
o
n
m
o
d
e
l
R
o
le
-p
la
y
s
1
.
S
a
2
.
S
e
lf
-r
e
p
o
rt
e
d
a
d
o
p
ti
o
n
3
.
B
u
rn
o
u
t
P
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
2
–
to
4
-m
o
n
th
f
⁄u
;
R
A
;
co
n
tr
o
l
g
ro
u
p
;
IC
M
a
n
d
S
M
1
.
S
a
h
ig
h
in
b
o
th
g
ro
u
p
s
2
.
A
d
o
p
ti
o
n
a
n
d
p
e
rs
o
n
a
l
a
cc
o
m
p
lis
h
m
e
n
t
h
ig
h
e
r
in
in
te
rv
e
n
ti
o
n
M
o
y
e
rs
e
t
a
l.
(2
0
0
8
)
1
2
9
M
I
A
d
u
lt
su
b
st
.
u
se
B
e
h
a
v
io
ra
l
h
e
a
lt
h
p
ro
v
id
e
rs
S
e
lf
-d
ir
e
ct
e
d
tr
a
in
in
g
v
s.
w
o
rk
sh
o
p
v
s.
w
o
rk
sh
o
p
+
tr
a
in
in
g
e
n
ri
ch
m
e
n
t
V
a
ri
e
d
p
e
r
tr
a
in
in
g
co
n
d
it
io
n
1
.
M
I
co
m
p
e
te
n
ce
P
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
4
-m
o
n
th
f
⁄u
;
R
A
;
co
m
p
a
ri
so
n
g
ro
u
p
;
S
M
1
.
Im
p
ro
v
e
d
co
m
p
e
te
n
ce
in
a
ll
g
ro
u
p
s
2
.
N
o
d
if
fe
re
n
ce
b
e
tw
e
e
n
w
o
rk
sh
o
p
a
n
d
w
o
rk
sh
o
p
+
tr
a
in
in
g
e
n
ri
ch
m
e
n
t
3
.
D
e
ca
y
in
co
m
p
e
te
n
ce
a
t
f
⁄u
S
a
n
d
e
rs
,
M
u
rp
h
y
–
B
re
n
n
a
n
,
e
t
a
l.
(2
0
0
3
)
3
3
1
T
ri
p
le
P
A
t-
ri
sk
y
o
u
th
G
e
n
e
ra
l
th
e
ra
p
is
ts
R
e
a
d
in
g
,
2
-d
a
y
w
o
rk
sh
o
p
,
1
-d
a
y
a
cc
re
d
it
a
ti
o
n
,
a
cc
e
ss
to
w
e
b
su
p
p
o
rt
n
e
tw
o
rk
A
ct
iv
e
sk
ill
s
tr
a
in
in
g
1
.
P
e
rc
e
iv
e
d
S
2
.
S
a
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
p
re
–
p
o
st
a
ss
e
ss
m
e
n
t;
IC
M
;
n
o
co
n
tr
o
l
g
ro
u
p
;
n
o
f
⁄u
;
n
o
R
A
1
.
H
ig
h
S
a
2
.
In
cr
e
a
se
d
p
e
rc
e
iv
e
d
S
S
h
o
lo
m
sk
a
s
e
t
a
l.
(2
0
0
5
)
7
8
C
B
T
A
d
u
lt
su
b
st
.
u
se
C
o
m
m
u
n
it
y
cl
in
ic
ia
n
s
M
a
n
u
a
l
o
n
ly
v
s.
m
a
n
u
a
l
+
2
0
–
h
o
u
r
w
e
b
tr
a
in
in
g
v
s.
3
-d
a
y
d
id
a
ct
ic
w
o
rk
sh
o
p
+
th
re
e
1
-h
o
u
r
su
p
e
rv
is
io
n
W
e
b
-b
a
se
d
ro
le
-p
la
y
s
a
n
d
in
v
iv
o
ro
le
–
p
la
y
s
1
.
R
a
te
d
A
2
.
R
a
te
d
S
3
.
K
N
o
t
fu
lly
ra
n
d
o
m
iz
e
d
;
p
re
–
p
o
st
g
ro
u
p
a
ss
e
ss
m
e
n
t;
co
n
tr
o
l
g
ro
u
p
;
n
o
f
⁄u
(p
o
st
-S
u
p
);
S
M
1
.
In
cr
e
a
se
d
S
a
n
d
A
w
o
rk
sh
o
p
+
su
p
e
rv
is
io
n
w
h
e
n
co
m
p
a
re
d
w
it
h
m
a
n
u
a
l
+
w
e
b
a
t
p
o
st
+
f
⁄u
.
2
.
In
cr
e
a
se
d
S
,
a
n
d
A
in
M
a
n
u
a
l
+
w
e
b
C
o
m
p
a
re
d
w
it
h
M
a
n
u
a
l
o
n
ly
.
3
.
N
o
D
if
fe
re
n
ce
in
K
n
o
w
le
d
g
e
N
o
te
.
C
T
,
co
g
n
it
iv
e
th
e
ra
p
y
;
D
P
,
d
y
n
a
m
ic
p
sy
ch
o
th
e
ra
p
y
;
D
C
,
d
ru
g
co
u
n
se
l
in
g
;
S
,
sk
ill
;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
;
R
A
,
ra
n
d
o
m
a
ss
ig
n
m
e
n
t;
f
⁄u
,
fo
llo
w
-u
p
;
T
L
D
P
,
ti
m
e
-l
im
it
e
d
d
y
n
a
m
ic
p
sy
ch
o
th
e
ra
p
y
;
G
D
C
,
g
ro
u
p
d
ru
g
co
u
n
se
lin
g
;
q
⁄a
,
q
u
e
st
io
n
s
a
n
d
a
n
sw
e
rs
;
A
C
T
,
A
cc
e
p
ta
n
ce
a
n
d
C
o
m
m
it
m
e
n
t
T
h
e
ra
p
y
;
S
a
,
sa
ti
sf
a
ct
io
n
;
IC
M
,
in
v
e
st
ig
a
to
r-
cr
e
a
te
d
m
e
a
su
re
;
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
C
B
T
,
co
g
n
it
iv
e
-b
e
h
a
v
io
ra
l
th
e
ra
p
y
;
A
,
a
d
h
e
re
n
ce
;
K
,
k
n
o
w
le
d
g
e
;
p
o
st
-S
u
p
,
p
o
st
su
p
e
rv
is
io
n
.
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 9
a comparison condition (Luoma et al., 2007; Moyers
et al., 2008), whereas another study attempted random
assignment but was unable to do so (Sholomskas et al.,
2005). Study samples ranged from 16 to 331 therapist
participants, with educational levels ranging from bache-
lor’s to postgraduate degrees (e.g., MD, PhD, and
PsyD). Most were community mental health providers.
Training Method and Content. All training included
passive learning (e.g., didactic presentation). Five studies
included active learning strategies (e.g., experiential
learning, in vivo and ⁄ or computer role-plays, active
learning skills; Crits-Christoph et al., 1998; Luoma
et al., 2007; Moyers et al., 2008; Sanders, Murphy-
Brennan, et al., 2003; Sholomskas et al., 2005). Training
content included a focus on reviewing each session of
the treatment protocol (Crits-Christoph et al., 1998;
Sholomskas et al., 2005) or a focus on principles
(Henry, Strupp, et al., 1993; Moyers et al., 2008).
Training time varied from 6 (Luoma et al., 2007) to
100 hours (Henry, Strupp, et al., 1993). Five studies
required the use of manuals to supplement the didactic
presentation (Crits-Christoph et al., 1998; Henry,
Strupp, et al., 1993; Moyers et al., 2008; Sanders,
Murphy-Brennan, et al., 2003; Sholomskas et al., 2005).
Organizational Support. One study provided peer and
web-based support (Sanders, Murphy-Brennan, et al.,
2003), whereas another used group consultation to
overcome therapist barriers in the use of newly
acquired skills (Luoma et al., 2007). Other work
(Crits-Christoph et al., 1998; Henry, Strupp, et al.,
1993; Sholomskas et al., 2005) included supervision as
part of the training, ranging from 3 one-hour supervi-
sions (Sholomskas et al., 2005) to 50 two-hour weekly
supervisions (Henry, Strupp, et al., 1993). One study
provided supervision that concentrated on feedback on
specific techniques and also provided additional didactic
training
(Moyers et al., 2008).
Outcome Measures. Most studies used self-reported
outcome measures, with the exception of independently
rated adherence and skill. Self-reported outcomes
included knowledge, satisfaction, therapist perception
of alliance, adoption, and burnout. Five studies
(Crits-Christoph et al., 1998; Henry, Strupp, et al.,
1993; Moyers et al., 2008; Sanders, Murphy-Brennan,
et al., 2003; Sholomskas et al., 2005) used standardized
psychometrically sound measures, and Luoma et al.
(2007) used a combination of investigator-created non-
standardized measures and standardized psychometrically
sound measures.
Summary of Studies. Physicians (n = 331) were
trained in Triple P (Sanders, Murphy-Brennan, et al.,
2003) and had access to peer support networks and web-
based support. After training, participants reported a
statistically significant increase in how well they believed
they were trained to manage behavior problems,
increased confidence in conducting parent consultation,
and high satisfaction with the training. In another study,
therapists (n = 30) were randomly assigned to a psycho-
logically focused group consultation after attending a
one-day workshop to overcome psychological barriers
in the use of new treatment techniques (Luoma et al.,
2007). In relation to the comparison group, the inter-
vention group reported more adoption of the treatment
at two- and four-month follow-ups, and a greater sense
of personal accomplishment at four-month follow-up.
Two interventions focused on the effects of EBP
training on therapist behavior as part of larger treat-
ment outcome studies (Crits-Christoph et al., 1998;
Henry, Strupp, et al., 1993). Both studies used manu-
als, didactic workshops, and ongoing supervision as part
of training, although one study provided significantly
more supervision (50 two-hour weekly sessions; Henry,
Strupp, et al., 1993). After receiving training and
supervision in TLDP (n = 16), therapist adherence and
general skills (e.g., greater use of open-ended questions)
were more highly rated. Unexpectedly, certain thera-
pist skills decreased (e.g., less optimistic, less supportive,
and more authoritative; Henry, Strupp, et al., 1993).
By contrast, Crits-Christoph et al. (1998) found that
following training in both DP and DC, therapist skill
increased as each case progressed (i.e., within case),
while CT therapists performed more skillfully across
cases (n = 65; Crits-Christoph et al., 1998). In other
words, only CT therapists were able to transfer their
learning from case to case. By the fourth training case,
CT therapists were scoring an average of 46 out of a
possible 48 points, suggesting great improvement and
proficiency in comparison with their first training case.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 10
The most methodologically rigorous investigations
in this category both included random assignment to
varying training methods. One study employed an
investigation of which condition: (a) manual only,
(b) manual + web-based training, and (c) manual +
didactic training + supervision) was most effective in
improving therapist knowledge, adherence, and skill in
CBT for substance abuse (Sholomskas et al., 2005).
The highest dosage of training (manual + didactic
training + supervision) produced the highest levels of
therapist adherence and skill, with the manual + web
training evidencing intermediate scores and the manual
alone having the lowest levels of adherence and skill
after training and at follow-up. It is of note that in the
highest dosage of training, only 54% of clinicians
reached proficiency levels in adherence and skill
(Sholomskas et al., 2005). Knowledge was not signifi-
cantly different between the three groups. Another
study randomly assigned therapists to one of three con-
ditions: (a) workshop only, (b) workshop + training
enrichments (i.e., six supervision calls, specific feedback
on behavior), and (c) self-directed training (Moyers
et al., 2008). All conditions showed gains in compe-
tence from baseline to post-training with effect sizes in
the medium to large range; however, these gains
declined at four-month follow-up. Contrary to expec-
tations, improved competence was not observed in the
group that received training enrichments (i.e., feedback
and consultation calls).
Conclusions. After receiving training and follow-up
organizational support, therapists’ perceptions of their
behavior (e.g., confidence and personal accomplish-
ment) increase (Luoma et al., 2007; Sanders, Murphy-
Brennan, et al., 2003). In some studies, the perception
of behavior change is matched by actual therapist
behavior change; however, these changes in behavior
are not maintained at follow-up. When considering
specific EBP packages, some evidence supports the
notion that MI competence can be gained after attend-
ing a one-day workshop. However, these gains were
not maintained at follow-up, and a number of training
enrichments did not result in expected increased skill.
Contradictory evidence exists regarding the effect of
training in DP on therapist adherence. One study sug-
gests that certain DP-related skills improve, while
others deteriorate after training, particularly skills that
influence the therapeutic relationship (Henry, Strupp,
et al., 1993). A follow-up study suggests that DP skills
influencing the alliance may decrease in the first train-
ing case following training, but that this effect may
diminish as the therapist treats more clients (Crits-
Christoph et al., 1998). Thus, further supervision and
more than one training case may reverse an initial
awkward phase as the therapist grows comfortable
implementing the EBP.
Similarly, contradictory evidence exists regarding the
effect of CT and CBT training on therapist behavior.
One study demonstrates that CT training plus supervi-
sion allows skills to improve, suggesting that CT thera-
pists are able to apply what they have learned in training
and supervision to new cases. However, in another
study of CBT training, approximately half of the thera-
pists were not trained to an acceptable criterion in
adherence and skill, despite receiving the gold standard
in the field of training (Sholomskas et al., 2005).
Limitations. Study-specific issues include limited data
on supervisory practices, self-reported skill (Luoma
et al., 2007; Sanders, Murphy-Brennan, et al., 2003),
biased skill ratings from supervisors (Crits-Christoph
et al., 1998), comparisons across training interventions
that differ in time, difficulty in randomization
(Sholomskas et al., 2005), and difficulty in procuring
samples of therapist sessions and follow-up assessment
(Moyers et al., 2008).
Training and Therapist
Variables
Description of Studies. Few studies focused on both
training and therapist variables (see Table 4).
3
The
EBP training included (a) MI for adult substance use
(Rubel, Sobell, & Miller, 2000; Saitz, Sullivan, &
Samet, 2000), (b) behavioral family therapy (BFT) for
families caring for a relative with schizophrenia
(Brooker & Butterworth, 1993), and (c) an interven-
tion training program for youth suicide prevention
(Chagnon, Houle, Marcoux, & Renaud, 2007). Three
studies used a nonrandomized, convenience-sample,
pre–post, quasi-experimental design (Brooker &
Butterworth, 1993; Rubel et al., 2000; Saitz et al.,
2000); only one study randomly assigned participants
to a training condition and included a comparison
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 11
T
a
b
le
4
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
a
n
d
th
e
ra
p
is
t
v
a
ri
a
b
le
s
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
E
le
m
e
n
ts
O
u
tc
o
m
e
V
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
B
ro
o
k
e
r
a
n
d
B
u
tt
e
rw
o
rt
h
(1
9
9
3
)
8
B
F
T
S
ch
iz
o
.
p
a
ti
e
n
ts
a
n
d
th
e
ir
fa
m
ili
e
s
C
o
m
m
u
n
it
y
p
sy
ch
ia
tr
ic
n
u
rs
e
s
1
.
2
-d
a
y
in
tr
o
.
2
.
1
-w
e
e
k
sk
ill
s
tr
a
in
in
g
u
si
n
g
ro
le
-p
la
y
a
n
d
v
id
e
o
-f
e
e
d
b
a
ck
1
.
R
o
le
-p
la
y
2
.
V
id
e
o
ta
p
e
d
fe
e
d
b
a
ck
co
n
ce
rn
in
g
p
ro
g
re
s
s
in
sk
ill
s.
1
.
R
a
te
d
S
2
.
A
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
6
–
a
n
d
1
2
-m
o
n
th
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
S
M
1
.
C
o
m
p
e
te
n
t—
v
e
ry
g
o
o
d
S
2
.
6
-m
o
n
th
f
⁄u
sk
ill
im
p
ro
v
e
d
3
.
S
tr
e
n
g
th
e
n
A
h
e
ld
p
ri
o
r
to
tr
a
in
in
g
4
.
C
h
a
n
g
e
d
A
to
B
F
T
a
s
b
e
st
tx
5
.
In
cr
e
a
se
in
h
o
u
rs
sp
e
n
t
w
it
h
fa
m
ily
C
h
a
g
n
o
n
e
t
a
l.
(2
0
0
7
)
7
1
S
A
M
A
t-
ri
sk
y
o
u
th
C
o
m
m
u
n
it
y
m
e
m
b
e
rs
3
-d
a
y
w
o
rk
sh
o
p
R
o
le
-p
la
y
1
.
A
2
.
K
3
.
R
a
te
d
S
R
a
n
d
o
m
iz
e
d
;
co
m
p
a
ri
so
n
g
ro
u
p
;
6
-m
o
n
th
f
⁄u
;
IC
M
a
n
d
S
M
1
.
A
t
p
o
st
-t
ra
in
in
g
,
im
p
ro
v
e
m
e
n
t
in
A
,
K
,
a
n
d
S
2
.
A
t
f
⁄u
,
A
m
a
in
ta
in
s
b
u
t
K
a
n
d
S
d
e
cr
e
a
se
R
u
b
e
l
e
t
a
l.
(2
0
0
0
)
4
4
M
I
A
d
u
lt
su
b
st
.
a
b
u
se
M
e
n
ta
l
h
e
a
lt
h
th
e
ra
p
is
ts
2
-d
a
y
w
o
rk
sh
o
p
(d
id
a
ct
ic
&
e
x
p
e
ri
e
n
ti
a
l)
&
re
co
m
m
e
n
d
e
d
m
a
n
u
a
l
1
.
R
o
le
-p
la
y
2
.
F
is
h
b
o
w
l
e
x
e
rc
is
e
s
1
.
K
2
.
R
a
te
d
S
3
.
A
*
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
a
n
d
S
M
1
.
K
a
n
d
S
im
p
ro
v
e
d
fr
o
m
p
re
–
to
p
o
st
–
tr
a
in
in
g
S
a
it
z
e
t
a
l.
(2
0
0
0
)
7
0
M
I
A
d
u
lt
su
b
st
.
a
b
u
se
H
e
a
lt
h
-c
a
re
p
ro
v
id
e
rs
2
0
0
-m
in
w
o
rk
sh
o
p
(5
0
m
in
d
id
a
ct
ic
,
1
2
0
m
in
ro
le
–
p
la
y
,
3
0
m
in
d
is
cu
ss
io
n
)
R
o
le
-p
la
y
s
w
it
h
fe
e
d
b
a
ck
1
.
S
e
lf
-r
e
p
o
rt
e
d
ch
a
n
g
e
in
cl
in
ic
a
l
p
ra
ct
ic
e
2
.
K
*
*
3
.
A
*
*
4
.
C
*
*
5
.
S
*
*
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
1
.
P
o
st
-t
ra
in
in
g
o
v
e
ra
ll
A
w
e
re
h
ig
h
e
r
2
.
S
e
lf
-r
e
p
o
rt
la
rg
e
im
p
a
ct
o
n
cl
in
ic
a
l
p
ra
ct
ic
e
3
.
N
o
ch
a
n
g
e
in
K
,
S
,
o
r
C
N
o
te
.
B
F
T
,
b
e
h
a
v
io
ra
l
fa
m
ily
th
e
ra
p
y
;
sc
h
iz
o
.
sc
h
iz
o
p
h
re
n
ia
;
S
,
sk
ill
;
A
,
a
tt
it
u
d
e
s;
f
⁄u
,
fo
llo
w
-u
p
;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
tx
,
tr
e
a
tm
e
n
t;
S
A
M
,
S
u
ic
id
e
A
ct
io
n
M
o
n
tr
e
a
l;
K
,
k
n
o
w
le
d
g
e
;
IC
M
,
in
v
e
st
ig
a
to
r-
cr
e
a
te
d
m
e
a
su
re
s;
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
A
*
,
m
e
a
su
re
d
a
t
p
re
,
b
u
t
d
o
e
s
n
o
t
a
p
p
e
a
r
to
h
a
v
e
b
e
e
n
re
a
d
m
in
is
te
re
d
a
t
p
o
st
;
C
,
co
n
fi
d
e
n
ce
;
*
*
o
n
ly
co
lle
ct
e
d
p
re
–
p
o
st
fo
r
a
sa
m
p
le
o
f
th
e
co
h
o
rt
.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 12
condition (Chagnon et al., 2007). Sample sizes ranged
from 8 to 87 therapist participants, with educational
levels ranging from bachelor’s to postgraduate degrees
(e.g., MD, PhD, and PsyD). Participants included psy-
chiatric nurses, mental health clinicians, community
members, and health-care workers.
Training Method and Content. All of the studies
included both passive learning (e.g., didactic presenta-
tion) and active learning strategies (e.g., role-plays with
feedback, experiential learning, and fishbowl exercises).
When sufficiently described, training content included
a focus on principles (Rubel et al., 2000). Training
duration varied from 200 min (Chagnon et al., 2007)
to seven days (Brooker & Butterworth, 1993). One
study recommended a manual to supplement the didac-
tic presentation (
Rubel et al., 2000).
Therapist Variables. Studies measured therapist atti-
tudes and theoretical orientation. Two studies surveyed
substance abuse attitudes (Rubel et al., 2000; Saitz
et al., 2000), one study surveyed attitudes about schizo-
phrenia and its treatment (Brooker & Butterworth,
1993), and another measured attitudes towards inter-
vening with suicidal individuals
(Chagnon et al., 2007).
Two studies assessed theoretical orientation (Brooker &
Butterworth, 1993; Rubel et al., 2000).
3
Outcome Measures. For the majority of the studies,
self-reported outcome measures were used, with the
exception of independently rated skill. Self-reported
outcomes included knowledge, attitudes, and change in
practice. Saitz et al. (2000) used investigator-created
nonstandardized measures, Brooker and Butterworth
(1993) used standardized measures, and two studies uti-
lized both types of measures (Chagnon et al., 2007;
Rubel et al., 2000).
Summary of Studies. A survey of practicing clinicians
(n = 70) trained on MI indicated that training made an
impact on their practice with substance abuse patients,
particularly in regard to asking formal alcohol screening
questions and providing substance abuse counseling
(Saitz et al., 2000). Those participants who completed
pre- and post-training measures showed slightly higher
attitudes towards substance abuse after training,
although knowledge, confidence in ability to take a
substance history, and self-reported skillfulness did not
change.
More methodologically rigorous studies included
independent ratings of skill. Results from a 12-hour
MI training workshop indicated that both knowledge
and rated skill (i.e., percentage of motivational state-
ments to overall statements) improved from pre- to
post-training in mental health therapists (n = 44; Rubel
et al., 2000). However, participants only scored 67%
on the knowledge test—which does not indicate train-
ing to proficiency. Attitudes, measured pretraining,
indicated a psychosocial conceptualization of substance
abuse. A seven-day BFT workshop for community
psychiatric nurses demonstrated that rated skills were at
least satisfactory two months after training, with several
skills improving further at six-month follow-up
(Brooker & Butterworth, 1993). At six-month post-
training, nurses were proficient in both core and adap-
tive skills. Attitudes also changed following training,
such that belief in a psychosocial theory of schizophre-
nia and the usefulness of BFT programs increased.
The most methodologically rigorous study investi-
gated the effects of an intervention training in commu-
nity members who frequently interacted with youth at
risk of suicidal behavior (n = 78). Strengths of this
study included randomization and a comparison group.
In comparison with control subjects, participants in the
intervention group showed significant knowledge, atti-
tude, and skill improvement. At follow-up, knowledge
and skill improvement significantly diminished,
although change in attitudes was maintained. Although
participants improved in knowledge and skill at post-
training, scores were below proficiency level (i.e.,
knowledge 69%, skill 67%).
Conclusions. Survey data suggest that training in an
EBP has a lasting impact on clinical practice and self-
reported skill (i.e., Saitz et al., 2000), but actual behav-
ior change (e.g., rated skill) does not necessarily take
place when studies provide training without taking into
account the different facets of the SC model—provid-
ing training and measuring therapist variables are not
sufficient for DI efforts. Additionally, there appears to
be a lack of therapist proficiency reached after training.
The reported results of three studies indicated that
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 13
training successfully changed knowledge and indepen-
dently rated skill to a proficient level, but in two of
these studies, exploration of the reported means sug-
gests that this was not the case.
Attitudes shifted following training, and were main-
tained at follow-up. Attitudes improved towards EBP
in all studies that included a pre- to post-training
assessment (Brooker & Butterworth, 1993; Chagnon
et al., 2007; Saitz et al., 2000). Attitude change was
also sustained even when other behaviors diminished at
follow-up (Chagnon et al., 2007). It may be that cur-
rent training efforts engender shifts in participant per-
ceptions and attitudes, but are unable to bring about
lasting skill change.
Limitations. Study-specific limitations include small
sample sizes, highly motivated participants (Brooker &
Butterworth, 1993), low participant response rate
(Rubel et al., 2001), and the use of a nonvalidated vid-
eotape technique to assess for skill acquisition
(Chagnon et al., 2007).
Training and Client Variables
Description of Studies. Two studies focused on train-
ing and client variables (see Table 5). The EBP train-
ing included (a) MI for adult substance use (Miller &
Mount, 2001) and (b) QPR for youth suicide pre-
vention (Wyman et al., 2008). One study used a
nonrandomized, convenience-sample, pre–post, quasi-
experimental design (Miller & Mount, 2001), whereas
the other study randomly assigned participants to a
training condition and included a comparison condition
(Wyman et al., 2008). Study sample sizes ranged from
22 to 249 participants, with education levels at the
bachelor or master’s level. Participants included proba-
tion officers, community corrections officers, and
secondary school staff.
Training Method and Content. Both studies included
passive learning (e.g., didactic presentation), whereas
one included active learning (e.g., small group practice;
Miller & Mount, 2001). Training content was not suf-
ficiently described in either study. Training duration
varied from 2 (Wyman et al., 2008) to 15 hours (Miller
& Mount, 2001). Miller and Mount (2001) used a
manual to supplement the didactic presentation. T
a
b
le
5
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
a
n
d
cl
ie
n
t
v
a
ri
a
b
le
s
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
M
ill
e
r
a
n
d
M
o
u
n
t
(2
0
0
1
)
2
2
M
I
A
d
u
lt
su
b
st
.
a
b
u
se
P
O
a
n
d
C
C
O
1
.
2
-d
a
y
w
o
rk
sh
o
p
2
.
M
a
n
u
a
l
3
.
6
o
p
ti
o
n
a
l
(9
0
m
in
)
f
⁄u
d
is
cu
ss
io
n
*
S
m
a
ll
g
ro
u
p
p
ra
ct
ic
e
1
.
S
e
lf
-r
e
p
o
rt
e
d
S
a
n
d
C
2
.
R
a
te
d
S
3
.
C
lie
n
t
R
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
4
-m
o
n
th
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
S
M
1
.
In
cr
e
a
se
in
se
lf
-r
e
p
o
rt
e
d
S
a
n
d
C
p
o
st
-t
ra
in
in
g
2
.
M
o
d
e
st
in
cr
e
a
se
s
in
ra
te
d
S
a
t
p
o
st
-t
ra
in
in
g
,
w
h
ic
h
w
e
re
so
m
e
w
h
a
t
m
a
in
ta
in
e
d
a
t
4
-m
o
n
th
f
⁄u
o
n
cl
ie
n
t
3
.
N
o
e
ff
e
ct
re
sp
o
n
se
s
W
y
m
a
n
e
t
a
l.
(2
0
0
8
)
2
4
9
Q
P
R
Y
o
u
th
su
ic
id
e
p
re
v
e
n
ti
o
n
S
e
co
n
d
a
ry
sc
h
o
o
l
st
a
ff
1
.
1
.5
-h
o
u
r
w
o
rk
sh
o
p
2
.
3
0
-m
in
re
fr
e
sh
e
r
co
u
rs
e
se
v
e
ra
l
m
o
n
th
s
la
te
r
N
o
n
e
1
.
K
2
.
S
e
lf
-r
e
p
o
rt
e
d
A
,
B
,
a
n
d
C
o
3
.
S
tu
d
e
n
t
su
rv
e
y
R
a
n
d
o
m
iz
e
d
;
co
m
p
a
ri
so
n
g
ro
u
p
;
1
-y
e
a
r
f
⁄u
;
IC
M
1
.
In
cr
e
a
se
in
K
,
A
,
B
2
.
S
m
a
ll
e
ff
e
ct
in
st
a
ff
a
sk
in
g
st
u
d
e
n
ts
re
:
su
ic
id
e
-r
e
la
te
d
b
e
h
a
v
io
rs
N
o
te
.
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
P
O
,
p
ro
b
a
ti
o
n
o
ffi
ce
rs
;
C
C
O
,
co
m
m
u
n
it
y
co
rr
e
ct
io
n
s
o
ffi
ce
rs
;
*
N
o
t
a
tt
e
n
d
e
d
b
y
p
a
rt
ic
ip
a
n
ts
;
f
⁄u
,
fo
llo
w
-u
p
;
S
,
sk
ill
;
C
,
co
n
fi
d
e
n
ce
;
R
,
re
sp
o
n
se
s;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
Q
P
R
,
q
u
e
st
io
n
,
p
e
rs
u
a
d
e
,
re
fe
r;
K
,
k
n
o
w
le
d
g
e
;
A
,
a
p
p
ra
is
a
ls
;
B
,
B
e
h
a
v
io
r;
C
o
,
C
o
m
m
u
n
ic
a
ti
o
n
;
IC
M
,
in
v
e
st
ig
a
to
r-
c
re
a
te
d
m
e
a
su
re
s.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 14
Client Variables. In one study, client in-session state-
ments were used as a proxy for treatment outcome
(Miller & Mount, 2001), whereas in the other study,
students were surveyed regarding school staff commu-
nication in relation to suicidal ideation (Wyman et al.,
2008). Note that neither study utilized a measure of
severity, risk factors, and ⁄ or resiliency of therapists’
client population as predictor variables for training
efficacy (as recommended by Sanders & Turner,
2005); instead measures of client factors were included
as outcome variables.
Outcome Measures. The outcome measures included
self-report (Wyman et al., 2008) and independently
rated behavior (Miller & Mount, 2001). Self-reported
outcomes included knowledge, skill, appraisals, behav-
ior, and staff-student communication. Independently
rated behavior included rated MI skill. One study
utilized investigator-created nonstandardized measures
(Wyman et al., 2008), whereas the other study utilized
both investigator-created nonstandardized and standard-
ized psychometrically sound measures (Miller &
Mount,
2001).
Summary of Studies. Wyman et al. (2008) measured
the effect of QPR training on therapist knowledge and
behavior. Secondary school staff (n = 249) received
two hours of didactic training on suicide prevention.
In comparison with nontrained staff, knowledge, self-
reported appraisals, and behavior changes were reported
at one-year follow-up. Student responses (i.e., client
variables) suggested a small effect (d = 0.18) in being
asked more frequently about suicide by staff members
(one of the main skills of QPR). Although a statistically
significant effect was present in terms of knowledge
acquisition (d = 0.41), trained staff scored an average of
76% on the knowledge test, while nontrained staff
scored an average of 72% (both below proficiency
levels).
Miller and Mount (2001) investigated the effect of
training in MI on community corrections and proba-
tion officers working with adult substance abusers
(n = 22). Participants received 15 hours of didactic
training, which included small group practice and a
manual. Self-reports by therapists indicated large
increases in MI skills, while observational measures
reflected more modest skill changes after training that
were somewhat retained at four-month follow-up. Cli-
ents did not show the response changes found to be
predictive of better outcome with MI.
Conclusions. The findings suggest that self-reported
perceptions of change are frequently not matched by
actual behavior change. Neither study was able to
engender significant change at the client level, suggest-
ing that the main point of initiating these training
studies (i.e., to improve client response to treatment)
may not be occurring. Lack of therapist behavior
change may help explain this finding. This is concern-
ing given that therapist confidence was very high in
regard to their own skill, suggesting that they may not
feel that they need further training or consultation in
the implementation of the EBP (Miller & Mount,
2001).
An important consideration for both of these studies
is that client response was included as an outcome vari-
able. However, client variables (e.g., severity and resil-
iency) were not considered as moderators of training
effectiveness. Such data need to be co-varied in statisti-
cal analyses to depict the interactions between training
and client variables. For example, a severe population
(such as suicidal youth) may be more difficult to access;
so, while training may have succeeded in therapist
behavior change, client variables may make the treat-
ment more difficult to implement.
Limitations. Study-specific limitations included low
staff enrollment (Wyman et al., 2008) and a small sam-
ple size with participants choosing to not attend
optional follow-up discussion sessions that may have
contributed valuable organizational support (Miller &
Mount, 2001). High therapist attrition and ⁄ or low par-
ticipation in follow-up training in DI research must be
studied systemically due to the frequency of this occur-
rence in research studies (e.g., Baer et al., 2004; Miller
& Mount, 2001).
Training, Organizational Support, and Therapist Variables
Description of Studies. Several studies (n = 5) focused
on training, organizational support, and therapist vari-
ables (see Table 6).
3
The EBP training studied
included (a) BFT for families (Fadden, 1997), (b) CBT
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 15
T
a
b
le
6
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
,
o
rg
a
n
iz
a
ti
o
n
a
l
su
p
p
o
rt
,
a
n
d
th
e
ra
p
is
t
v
a
ri
a
b
le
s
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
F
a
d
d
e
n
(1
9
9
7
)
8
6
B
F
T
F
a
m
ili
e
s
w
it
h
sc
h
iz
o
.
m
e
m
b
e
r
N
u
rs
in
g
-l
e
v
e
l
cl
in
ic
ia
n
s
1
.
O
ri
e
n
ta
ti
o
n
2
.
M
a
n
u
a
l
3
.
3
-d
a
y
sk
ill
s
w
o
rk
sh
o
p
4
.
T
e
n
1
.5
-h
o
u
r
su
p
e
rv
is
io
n
s
5
.
O
n
g
o
in
g
m
o
n
th
ly
su
p
e
rv
is
io
n
R
o
le
-p
la
y
s,
v
id
e
o
ta
p
e
d
d
e
m
o
n
st
ra
ti
o
n
s
o
f
se
ss
io
n
s
1
.
N
u
m
b
e
r
o
f
fa
m
ili
e
s
se
e
n
2
.
B
a
rr
ie
rs
to
u
se
o
f
tx
3
.
Im
p
a
ct
o
f
B
F
T
o
n
w
o
rk
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
f
⁄u
;
n
o
p
re
-;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
1
.
7
0
%
re
p
o
rt
e
d
u
si
n
g
B
F
T
2
.
M
e
a
n
fa
m
ili
e
s
se
e
n
=
1
.7
3
.
6
6
%
re
p
o
rt
e
d
d
if
fi
cu
lt
to
u
se
4
.
T
h
e
ra
p
is
ts
in
th
e
co
m
m
.
o
r
w
h
e
re
m
o
re
st
a
ff
m
e
m
b
e
rs
w
e
re
tr
a
in
e
d
in
B
F
T
sa
w
m
o
re
fa
m
ili
e
s
5
.
L
it
tl
e
a
tt
it
u
d
e
ch
a
n
g
e
H
e
n
g
g
e
le
r,
C
h
a
p
m
a
n
,
e
t
a
l.
(2
0
0
8
)
4
3
2
C
M
S
u
b
st
.
a
b
u
se
in
a
d
o
l.
P
u
b
lic
se
ct
o
r
cl
in
ic
ia
n
s
1
.
M
a
n
u
a
l
2
.
1
-d
a
y
d
id
a
ct
ic
a
n
d
e
x
p
e
ri
e
n
ti
a
l
w
o
rk
sh
o
p
E
x
p
e
ri
e
n
ti
a
l
ro
le
-p
la
y
s
1
.
A
d
o
p
2
.
A
3
.
O
rg
*
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
6
-m
o
n
th
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
+
S
M
1
.
5
8
%
re
p
o
rt
e
d
u
se
2
.
P
ra
ct
.
v
a
ri
a
b
le
s
p
re
d
ic
te
d
a
d
o
p
3
.
P
ra
ct
.
a
n
d
o
rg
.
v
a
ri
a
b
le
s
p
re
d
ic
te
d
A
M
a
u
n
d
e
r
e
t
a
l.
(2
0
0
8
)
2
5
C
B
T
A
d
u
lt
a
n
d
y
o
u
th
in
P
C
M
D
s
1
.
3
–
to
4
-h
o
u
r
w
o
rk
sh
o
p
2
.
M
a
n
u
a
l
3
.
F
o
u
r
1
.5
-h
o
u
r
ca
se
d
is
cu
ss
io
n
s
C
a
se
d
is
cu
ss
io
n
g
ro
u
p
s
1
.
K
2
.
S
e
lf
-r
e
p
o
rt
e
d
u
se
3
.
A
tt
a
n
d
S
a
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
+
S
M
1
.
H
ig
h
S
a
2
.
In
cr
e
a
se
d
K
3
.
In
cr
e
a
se
d
u
se
M
o
rg
a
n
st
e
rn
e
t
a
l.
(2
0
0
1
)
2
9
C
B
T
A
d
u
lt
su
b
st
.
a
b
u
se
S
u
b
st
.
a
b
u
se
co
u
n
se
lo
rs
1
.
1
0
0
h
o
u
rs
tr
a
in
in
g
(3
5
-h
o
u
r
d
id
a
ct
ic
tr
a
in
in
g
a
n
d
fe
e
d
b
a
ck
,
su
p
e
rv
is
io
n
,
a
n
d
m
a
n
u
a
l)
R
o
le
-p
la
y
s
a
n
d
fe
e
d
b
a
ck
1
.
R
a
te
d
A
2
.
R
a
te
d
S
3
.
A
tt
a
n
d
S
a
R
a
n
d
o
m
iz
e
d
;
co
m
p
a
ri
so
n
g
ro
u
p
;
n
o
f
⁄u
;
IC
M
a
n
d
S
M
1
.
H
ig
h
S
a
2
.
H
ig
h
A
tt
to
w
a
rd
C
B
T
3
.
P
ro
fi
ci
e
n
t
A
&
S
S
iq
u
e
la
n
d
e
t
a
l.
(2
0
0
0
)
6
2
C
T
,
D
P
,
D
C
A
d
u
lt
su
b
st
.
a
b
u
se
S
u
b
st
.
a
b
u
se
co
u
n
se
lo
rs
1
.
M
a
n
u
a
l
2
.
F
o
u
r
2
-d
a
y
w
o
rk
sh
o
p
s
3
.
U
n
sp
e
ci
fi
e
d
su
p
e
rv
is
io
n
R
o
le
-p
la
y
s
1
.
R
a
te
d
A
2
.
R
a
te
d
C
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
f
⁄u
;
n
o
co
n
tr
o
l
g
ro
u
p
;
IC
M
a
n
d
S
M
1
.
In
C
T
g
e
n
e
ra
l
e
x
p
e
ri
e
n
ce
a
n
d
sp
e
ci
fi
c
e
x
p
e
ri
e
n
ce
in
C
T
p
re
d
ic
te
d
C
N
o
te
.
B
F
T
,
b
e
h
a
v
io
ra
l
fa
m
ily
th
e
ra
p
y
;
sc
h
iz
o
.,
sc
h
iz
o
p
h
re
n
ia
;
tx
,
tr
e
a
tm
e
n
t;
f
⁄u
,
fo
llo
w
-u
p
;
IC
M
,
in
v
e
st
ig
a
to
r-
cr
e
a
te
d
m
e
a
su
re
s;
C
M
,
co
n
ti
n
g
e
n
cy
m
a
n
a
g
e
m
e
n
t;
su
b
st
.,
su
b
st
a
n
ce
;
a
d
o
l.
,
a
d
o
le
sc
e
n
t;
A
d
o
p
,
a
d
o
p
ti
o
n
;
A
,
a
d
h
e
re
n
ce
;
O
rg
,
o
rg
a
n
iz
a
ti
o
n
a
l
v
a
ri
a
b
le
s;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
C
B
T
,
co
g
n
it
iv
e
-b
e
h
a
v
io
ra
l
th
e
ra
p
y
;
P
C
,
p
ri
m
a
ry
ca
re
;
M
D
s,
p
h
y
si
ci
a
n
s;
K
,
k
n
o
w
le
d
g
e
;
A
tt
,
a
tt
it
u
d
e
s;
S
a
,
sa
ti
sf
a
ct
io
n
;
S
,
sk
ill
;
C
,
co
m
p
e
te
n
ce
;
C
T
,
co
g
n
it
iv
e
th
e
ra
p
y
;
D
P
,
d
y
n
a
m
ic
th
e
ra
p
y
;
D
C
,
d
ru
g
co
u
n
se
lin
g
.
*
n
o
t
in
cl
u
d
e
d
a
s
a
n
o
u
tc
o
m
e
v
a
ri
a
b
le
,
b
u
t
m
e
a
su
re
d
o
rg
a
n
iz
a
ti
o
n
a
l
ch
a
ra
ct
e
ri
st
ic
s
a
s
p
re
d
ic
to
rs
.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 16
in primary care (Maunder, Milne, & Cameron, 2008),
(c) CBT for adult substance abuse (Morganstern, Mor-
gan, McCrady, Keller, & Carroll, 2001), (d) contin-
gency management (CM) for youth substance abuse
(Henggeler, Chapman, et al., 2008), and (e) CT, DP,
and DC for adult substance abuse (Siqueland et al.,
2000). Three studies used a nonrandomized, conve-
nience-sample, pre–post, quasi-experimental design
with no comparison group (Henggeler, Chapman,
et al., 2008; Maunder et al., 2008; Siqueland et al.,
2000), whereas one study surveyed participants after
training (Fadden, 1997). The most rigorous study
included randomization and a comparison group (Mor-
ganstern et al., 2001). Sample sizes ranged from 25 to
432 participants. Educational level ranged from bache-
lor to postgraduate level (i.e., PhD or MD), and parti-
cipants included community mental health therapists,
nurses, and physicians.
Training Method and Content. All studies included
both passive learning (e.g., didactic presentation) and
active learning strategies (e.g., experiential role-plays:
Fadden, 1997; Henggeler, Chapman, et al., 2008; Mor-
ganstern et al., 2001; Siqueland et al., 2000; case dis-
cussion groups: Maunder et al., 2008). Training
content included going through session by session
(Henggeler, Chapman, et al., 2008; Siqueland et al.,
2000) and a focus on principles of the treatment
(Maunder et al., 2008), with one study including both
a focus on session-by-session administration and princi-
ples of the treatment (Morganstern et al., 2001). Train-
ing duration varied from one day (Henggeler,
Chapman, et al., 2008) to 100 hours (Morganstern
et al., 2001). All studies used a manual to supplement
the didactic presentation.
Organizational Support. Most studies (Fadden, 1997;
Maunder et al., 2008; Morganstern et al., 2001;
Siqueland et al., 2000) included ongoing supervision as
part of the training intervention. Supervision time
ranged from four 1.5-hour case discussion groups
(Maunder et al., 2008) to 65 hours of supervision
(Morganstern et al., 2001). One study did not include
supervision but included measures of organizational
characteristics (i.e., organizational readiness for change;
Henggeler, Chapman, et al., 2008).
Therapist Variables. Two studies surveyed participant
attitudes towards the patient population before and
after training (Fadden et al., 1997; Morganstern et al.,
2001), and two studies assessed participant attitudes
towards the training received and treatment modality
(i.e., CBT; Maunder et al., 2008; Morganstern et al.,
2001). One study measured pretraining experience
(e.g., number of cases and supervision hours received)
as a potential predictor of post-training competence
(Siqueland et al., 2000), whereas another study mea-
sured pretraining demographics and experience (e.g.,
years of experience and caseload characteristics) and
therapist attitudes towards EBP as a predictor of
adherence, adoption, and implementation of an EBP
(Henggeler, Chapman, et al., 2008).
3
Outcome Measures. Outcome measures included self-
report (Fadden, 1997; Henggeler, Chapman, et al.,
2008; Maunder et al., 2008) or self-report and inde-
pendently rated behavior (Morganstern et al., 2001;
Siqueland et al., 2000). Self-reported outcomes
included declarative knowledge, implementation,
acceptability of treatment, use of treatment, barriers to
use, attitudes towards patient population ⁄ treatment
modality, and adoption. Independently rated behavior
included adherence, skill, and competence. Four studies
used both investigator-created nonstandardized and
standardized psychometrically sound measures (which
were often modified for the purposes of each study;
Henggeler, Chapman, et al., 2008; Maunder et al.,
2008; Morganstern et al., 2001; Siqueland et al., 2000),
and one study used an investigator-created nonstan-
dardized survey (Fadden, 1997).
Summary of Studies. Three studies utilized only self-
report questionnaires to observe the impact of training
on therapist knowledge, attitudes, and behavior. Thera-
pist participants trained in BFT (n = 86) were surveyed
after completing a 39-hour four-phase training
9 months to 3.5 years after completing the training
(Fadden, 1997). No pretraining assessment was com-
pleted. Seventy percent of therapists reported they had
used BFT in their work since training; however, the
average number of families seen was 1.7. Forty percent
of families were seen by 8% of the trained therapists,
indicating that a small proportion of trainees was seeing
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 17
a large percentage of the families. Therapist variables
influencing the number of families receiving BFT
included therapist location (community vs. inpatient
unit) and the number of therapists trained in each
service area. Little attitudinal change was observed, and
did not predict the number of families seen. In a more
recent study, primary care physicians (n = 25) trained
in CBT (i.e., three- to four-hour workshop and four
follow-up case discussions; Maunder et al., 2008)
reported high satisfaction with the training, as well as
an increase in the use of CBT techniques with patients.
Declarative knowledge scores increased after training
(Maunder et al., 2008) to proficiency levels.
Mental health therapists (n = 432) received a one-
day workshop on CM with adolescent substance abus-
ers (Henggeler, Chapman, et al., 2008). Although
supervision was not provided, important organizational
and therapist variables were identified. Fifty-eight per-
cent of workshop attendees attempted to use the treat-
ment post-training and therapist variables predicted
adoption of the treatment: More educated and more
experienced therapists who held favorable attitudes
towards manualized therapy and lacked expertise in the
treatment were more likely to implement the treat-
ment. Self-reported adherence was also investigated.
Therapist variables predicted self-reported adherence:
Adherence was higher for younger therapists certified
in addictions, with larger caseloads, higher numbers of
youth on their caseloads, with and who held more
positive views regarding treatment manuals. Organiza-
tional characteristics, specifically, organizational motiva-
tional readiness to change, and greater organizational
training exposure and utilization were associated with
increased adherence to the treatment modality.
More methodologically rigorous studies included
independent ratings of skill ⁄ competence. Two studies
investigated differing treatment modalities for substance
abuse. One study conducted training (manual and four-
day workshops) in three different treatment modali-
ties—CT, DP, and DC (n = 62; Siqueland et al.,
2000)—and included supervision focusing on feedback
from taped sessions. General experience as a therapist
and specific experience in treating patients in CT had a
positive impact on change in competence post-training,
whereas those having had more previous supervision
showed less change in competence after training.
The most rigorous study included random assign-
ment and a comparison condition, and investigated
CBT training (�100 hours of didactics and supervision)
on independently rated adherence and skill in substance
abuse counselors (n = 29; Morganstern
et al., 2001).
Participants reported high levels of training satisfaction
and also endorsed high ratings for the utility of CBT as
a treatment. Attitudes towards the conceptualization of
substance abuse changed in the intervention group.
Most participants reached independently rated adher-
ence levels of somewhat to extensively adherent and
independently rated skill levels of poor to good.
Conclusions. One important conclusion is the lack of
consensus on the role of therapist variables on compe-
tence and adherence in cognitive and ⁄ or behavioral
approaches (i.e., BFT, CM, and CT). With regard to
therapist competence post-training, it is unclear
whether or not pretraining competence predicts post-
training competence, and may differ by treatment
modality (e.g., CT). Interestingly, multiple studies
report that therapists with more previous supervision
show less change in competence, perhaps due to more
allegiance to their own conceptualizations. When con-
sidering therapist self-reported adherence to CM, sev-
eral therapist and organizational predictors emerged,
but only one study investigated this question, thus
making it difficult to make any conclusions other than
the importance of future replication and study.
Another conclusion emerges: When three levels of
the SC model are addressed (i.e., training, organiza-
tional, and therapist levels), training in CBT may be
more successful as evidenced by two studies (Maunder
et al., 2008; Morganstern et al., 2001). After training in
CBT, participant outcomes included high satisfaction,
attitudinal change, utilization, increased knowledge,
and rated proficiency in adherence and skill (Maunder
et al., 2008; Morganstern et al., 2001).
Limitations. Study-specific limitations include lack of
pretraining measurement of therapist behavior and
inconsistency in survey administration (Fadden, 1997),
low response rates (Maunder et al., 2008), and small
sample sizes (Maunder et al., 2008; Morganstern et al.,
2001; Siqueland et al., 2000). The only study that
utilized a control condition did not compare the
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 18
control group with the intervention group on rated
skillfulness or adherence in delivery of CBT, thus
reducing the internal validity of the study (Morganstern
et al., 2001).
Training, Organizational Support, and Client Variables
Description of Studies. Four studies focused on train-
ing, organizational support, and client variables (see
Table 7). The EBP training included (a) group CBT for
adult substance abuse (Watkins, Osilla, Hepner, Sandres,
& Thompson, 2008), (b) MI for substance abuse (Scho-
ener, Madeja, Henderson, Ondersma, & Janisse, 2006),
(c) TLDP for adults (Bein et al., 2000), and (d) MST for
adolescent substance abuse (Henggeler, Sheidow,
Cunningham, Donohue, & Ford, 2008). Three studies
used a nonrandomized, convenience-sample, pre–post,
quasi-experimental design (Bein et al., 2000; Schoener
et al., 2006), one study did not include pretraining mea-
sures (included a comparison group for client outcomes;
Watkins et al., 2008), and one study used a randomized
design with a comparison group (Henggeler, Sheidow,
et al., 2008). Sample sizes ranged from 5 to 30 partici-
pants. Educational level ranged from bachelor to post-
graduate level (i.e., PhD or MD), and participants
included community mental health therapists, psycholo-
gists, physicians, and substance abuse counselors.
Training Method and Content. All studies included
passive learning (e.g., didactic presentation), whereas
two included active learning strategies (e.g., practice
with feedback; Henggeler, Sheidow, et al., 2008;
Schoener et al., 2006). One study did not include any
active training strategies (Bein et al., 2000), whereas
another did not provide enough of a description to
characterize method (Watkins et al., 2008). Training
content included a focus on principles of the treatment
(Bein et al., 2000), a focus on principles and skills acqui-
sition (Schoener et al., 2006), or a focus on session-by-
session instruction (Henggeler, Sheidow, et al., 2008).
One study did not provide an adequate description of
training content (Watkins et al., 2008). Training dura-
tion varied from a two-day workshop and eight supervi-
sions (Schoener et al., 2006) to 100 hours of seminar
and supervision (Bein et al., 2000). Two studies used a
manual to supplement the didactic presentation (Bein
et al., 2000; Henggeler, Sheidow, et al., 2008).
Organizational Support. All studies included ongoing
supervision as part of the training intervention, ranging
from eight supervision sessions (Schoener et al., 2006)
to 100 hours of supervision (Bein et al., 2000). In one
study, the level of organizational support was manipu-
lated, where following a workshop, therapists received
standard consultation or intensive quality assurance
consisting of weekly consultation and quarterly booster
training (Henggeler, Sheidow, et al., 2008).
Client Variables. Studies measured client in-session
statements or treatment outcome to indicate whether
or not therapist training effected client behavior
change. In one study, client change talk was used as a
proxy for treatment outcome (Schoener et al., 2006).
One study included client ratings of therapist adherence
as the primary outcome measure (Henggeler, Sheidow,
et al., 2008).
Outcome Measures. The outcome measures for two
studies included self-report and independently rated
behavior (Bein et al., 2000; Watkins et al., 2008),
whereas two studies included only independently rated
behavior as the outcome measure (Henggeler,
Sheidow, et al., 2008; Schoener et al., 2006). Self-
reported outcomes included client psychopathology
(Bein et al., 2000; Watkins et al., 2008). Independently
rated behavior included adherence (Henggeler, Shei-
dow, et al., 2008), competence (Watkins et al., 2008),
and skill (Bein et al., 2000; Schoener et al., 2006). All
four studies used a standardized psychometrically sound
measure (albeit adapted for each study; Bein et al.,
2000; Henggeler, Sheidow, et al., 2008; Schoener
et al., 2006; Watkins et al., 2008).
Summary of Studies. Clinicians (n = 30) were trained
in MST through a manual and workshop and then
were randomized to a workshop-only condition (access
to materials and phone access to an MST expert as
needed) or an intensive supervision condition (weekly
supervision and consultation, booster training quarterly,
improvement of skills incorporated into clinician devel-
opment plans; Henggeler, Sheidow, et al., 2008).
Supervisors were also evaluated to augment therapists’
use of the intervention. Significant differences between
youth-reported clinician adherence to MST techniques
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 19
T
a
b
le
7
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
,
o
rg
a
n
iz
a
ti
o
n
a
l
su
p
p
o
rt
,
a
n
d
cl
ie
n
t
v
a
ri
a
b
le
s
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
B
e
in
e
t
a
l.
(2
0
0
0
)
1
6
T
L
D
P
A
d
u
lt
p
sy
ch
.
M
D
⁄
P
h
D
1
.
5
0
w
e
e
k
ly
2
–
h
o
u
r
se
m
in
a
rs
a
n
d
su
p
e
rv
is
io
n
(f
o
cu
s
o
n
p
ri
n
ci
p
le
s)
2
.
M
a
n
u
a
l
3
.
O
n
e
tr
a
in
in
g
ca
se
N
o
n
e
1
.
C
lie
n
t
p
sy
ch
.
2
.
T
h
e
ra
p
is
t
p
ro
fi
ci
e
n
cy
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
1
-y
e
a
r
f
⁄u
;
p
re
tr
a
in
in
g
co
m
p
a
ri
so
n
;
S
M
1
.
N
o
d
if
fe
re
n
ce
s
b
e
tw
e
e
n
p
re
–
a
n
d
p
o
st
-t
ra
in
in
g
cl
ie
n
t
p
sy
ch
.
a
t
p
o
st
–
a
n
d
1
-y
e
a
r
f
⁄u
2
.
O
n
ly
2
8
%
re
a
ch
e
d
m
in
im
a
l
le
v
e
l
o
f
p
ro
fi
ci
e
n
cy
H
e
n
g
g
e
le
r,
S
h
e
id
o
w
,
e
t
a
l.
(2
0
0
8
)
3
0
M
S
T
A
d
o
l.
su
b
st
.
a
b
u
se
M
a
st
e
r’
s-
le
v
e
l
cl
in
ic
ia
n
1
.
M
a
n
u
a
l
2
.
W
o
rk
sh
o
p
3
.
R
a
n
d
o
m
iz
e
d
to
w
o
rk
sh
o
p
o
n
ly
o
r
in
te
n
si
v
e
q
u
a
lit
y
a
ss
u
ra
n
ce
(s
u
p
e
rv
is
io
n
a
n
d
q
u
a
rt
e
rl
y
b
o
o
st
e
r
tr
a
in
in
g
)
R
o
le
-p
la
y
w
it
h
fe
e
d
b
a
ck
a
n
d
p
o
si
ti
v
e
re
in
fo
rc
e
m
e
n
t
1
.
Y
o
u
th
–
a
n
d
ca
re
g
iv
e
r-
re
p
o
rt
e
d
th
e
ra
p
is
t
A
B
a
se
lin
e
,
p
o
st
w
o
rk
sh
o
p
th
e
n
ra
n
d
o
m
iz
e
d
;
co
m
p
a
ri
so
n
g
ro
u
p
;
4
-m
o
n
th
f
⁄u
;
S
M
1
.
S
ig
n
ifi
ca
n
t
a
d
h
e
re
n
ce
re
p
o
rt
e
d
b
y
y
o
u
th
a
t
p
o
st
a
n
d
d
if
fe
re
n
ce
b
e
tw
e
e
n
a
d
h
e
re
n
ce
to
M
S
T
a
n
d
C
B
T
a
t
f
⁄u
2
.
S
ig
n
ifi
ca
n
t
d
if
fe
re
n
ce
b
e
tw
e
e
n
M
S
T
a
n
d
C
B
T
te
ch
n
iq
u
e
s
re
p
o
rt
e
d
b
y
ca
re
g
iv
e
r
a
t
p
o
st
b
u
t
n
o
t
f
⁄u
3
.
N
o
ch
a
n
g
e
in
u
se
o
f
M
S
T
y
o
u
th
o
r
m
o
n
it
o
ri
n
g
b
y
ca
re
g
iv
e
r
re
p
o
rt
S
ch
o
e
n
e
r
e
t
a
l.
(2
0
0
6
)
1
0
M
I
A
d
u
lt
su
b
st
.
a
b
u
se
a
n
d
C
O
D
F
ro
n
tl
in
e
cl
in
ic
ia
n
s
1
.
2
-d
a
y
w
o
rk
sh
o
p
2
.
E
ig
h
t
su
p
e
rv
is
io
n
s
S
u
p
e
rv
is
e
d
p
ra
ct
ic
e
a
n
d
fe
e
d
b
a
ck
d
u
ri
n
g
w
o
rk
sh
o
p
1
.
T
h
e
ra
p
is
t
S
2
.
C
lie
n
t
ch
a
n
g
e
ta
lk
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
p
re
–
to
p
o
st
d
e
si
g
n
;
n
o
f
⁄u
;
n
o
co
m
p
a
ri
so
n
g
ro
u
p
;
S
M
1
.
T
h
e
ra
p
is
t
im
p
ro
v
e
d
M
I-
co
n
si
st
e
n
t
sk
ill
s*
2
.
T
h
e
ra
p
is
t
d
e
cr
e
a
se
d
M
I-
in
co
n
si
st
e
n
t
sk
ill
s
3
.
O
b
se
rv
e
d
cl
ie
n
t
ch
a
n
g
e
ta
lk
W
a
tk
in
s
e
t
a
l.
(2
0
0
8
)
5
C
B
T
A
d
u
lt
su
b
st
.
a
b
u
se
S
u
b
st
.
a
b
u
se
a
d
d
ic
ti
o
n
s
co
u
n
se
lo
rs
1
.
2
-d
a
y
w
o
rk
sh
o
p
2
.
W
e
e
k
ly
su
p
e
rv
is
io
n
3
.
1
-d
a
y
b
o
o
st
e
r
tr
a
in
in
g
N
o
t
d
e
sc
ri
b
e
d
1
.
A
2
.
C
3
.
C
lie
n
t
o
u
tc
o
m
e
C
o
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
n
ra
n
d
o
m
iz
e
d
;
n
o
p
re
-;
n
o
f
⁄u
;
co
m
p
a
ri
so
n
g
ro
u
p
fo
r
tx
;
S
M
1
.
9
1
%
A
2
.
4
.3
⁄6
C
3
.
C
lie
n
t
d
e
p
re
ss
io
n
im
p
ro
v
e
d
N
o
te
.
T
L
D
P
,
ti
m
e
-l
im
it
e
d
d
y
n
a
m
ic
p
sy
ch
o
th
e
ra
p
y
;
p
sy
ch
.,
p
sy
ch
o
p
a
th
o
lo
g
y
;
f
⁄u
,
fo
llo
w
-u
p
;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
M
S
T
,
m
u
lt
is
y
st
e
m
ic
th
e
ra
p
y
;
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
su
b
st
.,
su
b
st
a
n
ce
;
C
O
D
,
co
-o
cc
u
rr
in
g
d
is
o
rd
e
rs
;
S
,
sk
ill
;
C
B
T
,
co
g
n
it
iv
e
-b
e
h
a
v
io
ra
l
th
e
ra
p
y
;
A
,
a
d
h
e
re
n
ce
;
C
,
co
m
p
e
te
n
ce
;
tx
,
tr
e
a
tm
e
n
t.
*
S
ti
ll
b
e
lo
w
p
ro
fi
ci
e
n
cy
le
v
e
ls
.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 20
emerged when comparing the two conditions after
training. Both youth-reported adherence (75%) and
caregiver-reported adherence (65%) were higher in
the intensive supervision condition. However, the
caregiver-reported adherence effect was not sustained
at follow-up.
Schoener et al. (2006) investigated the effect of
therapist behavior on client change talk following
training (i.e., independently coded from actual therapy
sessions). Community clinicians (n = 10) were trained
in MI through a two-day workshop and eight supervi-
sion sessions for patients with co-occurring substance
abuse and Axis I disorders. After training, indepen-
dently rated behavior suggested that therapists showed
improved MI skill (empathy, MI-spirit, and reflective
listening) and decreased MI-inconsistent behavior
(closed-ended questions and advising without permis-
sion). Additionally, change in therapist MI skill was
accompanied by a change in client self-talk, a variable
associated with subsequent client behavior change.
However, therapists exhibited lower average MI profi-
ciency in comparison with past MI training trials and
did not reach the recommended proficiency level (5 ⁄ 7
Likert; Miller, 2000). Organizational and ⁄ or therapist
variables influenced training response: Therapists who
had been employed in the same agencies for long peri-
ods of time appeared less capable of benefitting from
training for certain MI skills (i.e., open-ended ques-
tioning). Poststudy interviews provided contextual
environmental information that may help explain these
results: Many therapists reported high levels of anxiety
and a number of systemic and structural challenges to
the application of newly acquired MI skills.
7
Two studies investigated therapist training effects on
client treatment outcome in differing therapy modali-
ties. Substance abuse counselors (n = 5) received two
days of didactic training, ongoing weekly supervision,
and a one-day booster training for group CBT for
depression (Watkins et al., 2008). Counselors treated
61 clients and 35% of the sessions were coded for
adherence and competence. Therapists demonstrated
91% adherence (two or three on a 0–3 scale) across
coded sessions. Additionally, therapists delivered com-
petent CBT with a mean competence rating of 4.3 (of
6). Client depression scores improved with treatment
when compared with a comparison group. In another
treatment modality, clinicians (n = 16) received 50
weekly two-hour seminars and supervision in TLDP
for adult psychopathology. Training in TLDP did not
improve patient outcome at post-training or at one-
year follow-up. Follow-up analyses examined therapist
proficiency at TLDP by independently rating two cases
for each therapist. Only 9 of the 32 training cases
(28%) were judged to have been conducted with a
minimal level of skill (Bein et al., 2000).
Conclusions. If therapists reach proficient levels in
adherence ⁄ competence, and have adequate consultation
and organizational support, it is possible to elicit behav-
ior change in client outcomes. In three of the four
studies (Bein et al., 2000; Henggeler, Sheidow, et al.,
2008; Schoener et al., 2006), therapists did not reach
proficient levels in adherence and ⁄ or competence. This
is concerning, particularly given that appropriate super-
vision and training seems to have been provided, par-
ticularly in the MST and TLDP studies. Given the
striking amount of intervention, specifically targeting
problem-solving barriers to MST implementation, these
results are surprising. Similarly, in the study of TLDP,
an adequate dosage of supervision was provided (one
year of supervision—approximately 100 hours). How-
ever, this study only included one training case, which
may not have been sufficient for gaining mastery over
the skills needed to administer TLDP.
The importance of examining contextual variables
at the level of therapist and organizational support
becomes clear. What was it about these therapists that
made it difficult for them to reach proficiency levels
in MI, MST, or TLDP? One possibility may be their
lack of experience. In previous studies of MI, thera-
pist participants had prior experience in the treatment
modality, suggesting that training further consolidated
this experience (e.g., Miller & Mount, 2001; Miller
et al., 2004). Similarly, in the study that reported
positive client outcomes, therapists endorsed past
experience with the treatment and high motivation to
learn (Watkins et al., 2008). Perhaps therapists who
are naı̈ve to the fundamental principles of a treatment
may require further training and follow-up supervi-
sion. Other therapist variables may also be important,
such as allegiance to current therapeutic approaches
and commitment to learning a new treatment
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 21
modality. In one study, follow-up interviews sug-
gested that systemic and contextual issues made it dif-
ficult to implement an EBP, highlighting the
importance of organizational variables.
Limitations. Study-specific limitations include the
small sample size of all the studies and the manner in
which client outcome was operationalized—as a change
in either self-talk (Schoener et al., 2006) or self-report
rather than structured interviews (Bein et al., 2000;
Watkins et al., 2008). Additionally, independently rated
adherence from a youth and caregiver perspective only,
without the inclusion of an expert perspective, was a
weakness (Henggeler, Sheidow, et al., 2008).
Training, Organizational Support, Therapist, and Client
Variables
Description of Studies. Few studies focused on all lev-
els of the SC model (see Table 8). The EBP training
included (a) TLDP for adults (Henry, Schacht, Strupp,
Butler, & Binder, 1993), (b) MI for addictions (Miller
et al., 2004), and (c) a comparison of supportive mental
health counseling, MI, and group CBT for substance
abuse and comorbid depression (Hunter, Watkins,
Wenzel, Gilmore, Sheehe, & Griffin, 2005). One study
used a nonrandomized, convenience-sample, pre–post,
quasi-experimental design (Henry, Schacht, et al.,
1993), whereas another study included a comparison
group (Hunter et al., 2005). The most rigorous study
included randomization to one of five groups and a
comparison group (Miller et al., 2004). Study sample
sizes ranged from 13 to 140 participants. Educational
level ranged from bachelor to postgraduate level (i.e.,
PhD or MD), and participants included community
mental health therapists, licensed substance abuse coun-
selors, and medical professionals.
Training Method and Content. All studies included
both passive learning (e.g., didactic presentation) and
two included active learning strategies (e.g., interactive
educational meetings, Hunter et al., 2005; and feedback
and coaching, Miller et al., 2004). Training content
included a focus on principles of the treatment for all
three studies. Training duration varied from two days
(Miller et al., 2004) to 100 hours (Henry, Schacht,
et al., 1993). Two studies used a manual to supplement Ta
b
le
8
.
S
y
st
e
m
s-
co
n
te
x
tu
a
l
le
v
e
l:
T
ra
in
in
g
,
o
rg
a
n
iz
a
ti
o
n
a
l,
cl
ie
n
t,
a
n
d
th
e
ra
p
is
t
v
a
ri
a
b
le
s
R
e
fe
re
n
ce
s
n
E
S
T
P
a
ti
e
n
t
T
h
e
ra
p
is
t
T
ra
in
in
g
A
ct
iv
e
e
le
m
e
n
ts
O
u
tc
o
m
e
v
a
ri
a
b
le
s
D
e
si
g
n
R
e
su
lt
s
H
e
n
ry
,
S
ch
a
ch
t,
e
t
a
l.
(1
9
9
3
)
1
6
T
L
D
P
A
d
u
lt
p
sy
ch
.
M
D
a
n
d
P
h
D
1
.
M
a
n
u
a
l
2
.
5
0
w
e
e
k
ly
se
m
in
a
rs
a
n
d
su
p
e
rv
is
io
n
3
.
T
ra
in
in
g
ca
se
N
o
n
e
1
.
T
h
e
ra
p
is
t
A
2
.
T
h
e
ra
p
is
t
S
P
re
–
to
p
o
st
d
e
si
g
n
;
co
n
v
e
n
ie
n
ce
sa
m
p
le
;
n
o
f
⁄u
;
n
o
co
m
p
a
ri
so
n
g
ro
u
p
1
.
T
h
e
ra
p
is
t
v
a
ri
a
b
le
s
in
fl
u
e
n
ce
d
A
2
.
C
lie
n
t
v
a
ri
a
b
le
s
in
fl
u
e
n
ce
d
S
H
u
n
te
r
e
t
a
l.
(2
0
0
5
)
1
3
M
I,
g
ro
u
p
C
B
T
A
d
u
lt
su
b
st
.
+
C
O
D
M
e
n
ta
l
h
e
a
th
co
u
n
se
lo
rs
1
.
2
.5
-h
o
u
r
1
2
-w
e
e
k
tr
a
in
in
g
2
.
B
iw
e
e
k
ly
3
.
S
u
b
se
t
re
ce
iv
e
d
d
e
p
re
ss
io
n
tr
a
in
in
g
In
te
ra
ct
iv
e
e
d
u
ca
ti
o
n
a
l
m
e
e
ti
n
g
s
(n
o
t
sp
e
ci
fi
e
d
)
1
.
K
2
.
A
3
.
Jo
b
S
a
4
.
Jo
b
M
P
re
–
to
p
o
st
d
e
si
g
n
;
co
n
v
e
n
ie
n
ce
sa
m
p
le
;
1
-y
e
a
r
f
⁄u
;
co
m
p
a
ri
so
n
g
ro
u
p
1
.
K
in
cr
e
a
se
d
*
2
.
A
in
cr
e
a
se
d
*
3
.
Jo
b
S
a
+
M
M
ill
e
r
e
t
a
l.
(2
0
0
4
)
1
4
0
M
I
A
d
u
lt
su
b
st
.
a
b
u
se
L
ic
e
n
se
d
su
b
st
.
a
b
u
se
p
ro
fe
ss
1
.
W
S
2
.
W
S
F
3
.
W
S
C
4
.
W
S
C
+
F
5
.
S
G
T
V
a
ri
e
d
a
cr
o
ss
tr
a
in
in
g
(W
S
F
,
W
S
C
,
a
n
d
W
S
C
+
F
)
1
.
C
2
.
C
lie
n
t
ch
a
n
g
e
ta
lk
R
a
n
d
o
m
iz
e
d
;
co
m
p
a
ri
so
n
g
ro
u
p
;
4
-,
8
-,
1
2
-m
o
n
th
f
⁄u
;
S
M
1
.
A
ll
fo
u
r
w
o
rk
sh
o
p
s
sh
o
w
e
d
in
cr
e
a
se
in
C
p
re
–
p
o
st
2
.
W
S
g
ro
u
p
re
v
e
rs
e
d
g
a
in
s
a
t
4
-m
o
n
th
f
⁄u
3
.
R
e
d
u
ct
io
n
in
M
I-
in
co
n
st
.
b
e
h
a
v
io
r
N
o
te
.
T
L
D
P
,
ti
m
e
-l
im
it
e
d
d
y
n
a
m
ic
p
sy
ch
o
th
e
ra
p
y
;
p
sy
ch
.,
p
sy
ch
o
p
a
th
o
lo
g
y
;
A
,
a
d
h
e
re
n
ce
;
S
,
S
k
ill
;
f
⁄u
,
fo
llo
w
-u
p
;
S
M
,
st
a
n
d
a
rd
iz
e
d
m
e
a
su
re
s;
M
I,
m
o
ti
v
a
ti
o
n
a
l
in
te
rv
ie
w
in
g
;
C
B
T
,
co
g
n
it
iv
e
-b
e
h
a
v
io
ra
l
th
e
ra
p
y
;s
u
b
st
.,
su
b
st
a
n
ce
;
C
O
D
,
co
-o
cc
u
rr
in
g
d
is
o
rd
e
rs
;
K
,
k
n
o
w
le
d
g
e
;
S
a
,
sa
ti
sf
a
ct
io
n
;
M
,
m
o
ra
le
;
W
S
,
w
o
rk
sh
o
p
o
n
ly
;
W
S
F
,
w
o
rk
sh
o
p
p
lu
s
fe
e
d
b
a
ck
;
W
S
C
,
w
o
rk
sh
o
p
p
lu
s
co
a
ch
in
g
;
W
S
C
+
F
,
w
o
rk
sh
o
p
p
lu
s
co
a
ch
in
g
a
n
d
fe
e
d
b
a
ck
;
S
G
T
,
se
lf
-g
u
id
e
d
tr
a
in
in
g
;
C
,
co
m
p
e
te
n
ce
.
*
N
o
st
a
ti
st
ic
a
l
a
n
a
ly
se
s
co
m
p
le
te
d
b
e
tw
e
e
n
co
m
p
a
ri
so
n
a
n
d
in
te
rv
e
n
ti
o
n
g
ro
u
p
b
e
ca
u
se
o
f
5
0
%
st
a
ff
a
tt
ri
ti
o
n
a
n
d
sm
a
ll
sa
m
p
le
si
ze
.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 22
the didactic presentation (Henry, Schacht, et al., 1993;
Miller et al., 2004).
Organizational Support. Two studies (Henry, Schacht,
et al., 1993; Hunter et al., 2005) included ongoing
supervision as part of the training intervention, ranging
from biweekly supervision (Hunter et al., 2005) to
100 hours of supervision and a training case (Henry,
Schacht, et al., 1993). One study included two training
enhancement procedures (ongoing feedback and coach-
ing), which were considered to be most in line with
organizational support given their similarity to supervi-
sion
(Miller et al., 2004).
Therapist Variables. Hunter et al. (2005) surveyed
participant attitudes towards mental illness, job satisfac-
tion, and job morale pre- and post-training (Hunter
et al., 2005); Miller et al. (2004) measured pretraining
characteristics, history of substance abuse, self-esteem,
and interpersonal style as predictors of post-training
competence and client change outcome; and Henry,
Schacht, et al. (1993) measured pretraining demograph-
ics and experience (e.g., years of experience and prior
competence) as mediators of therapists’ response to
training.
3
Client Variables. Client characteristics were examined
as mediators of therapist training response in two stud-
ies (Henry, Schacht, et al., 1993; Hunter et al., 2005),
whereas in Miller et al. (2004), client change talk was
used as a proxy for treatment outcome.
Outcome Measures. The outcome measures included
self-report only (Hunter et al., 2005) or self-report and
independently rated behavior (Henry, Schacht, et al.,
1993; Miller et al., 2004). Self-reported outcomes
included knowledge, attitudes about mental health, job
satisfaction, and job morale. Independently rated
behavior included interviewing style, adherence, inter-
personal processes (Henry, Schacht, et al., 1993), and
MI competence (e.g., MI-consistent behaviors, reflec-
tion:question ratio; Miller et al., 2004). One study used
an investigator-created nonstandardized survey measure
(Hunter et al., 2005), whereas two studies utilized stan-
dardized psychometrically sound measures (Henry,
Schacht, et al., 1993; Miller et al., 2004).
Summary of Studies. One study used only self-report
questionnaires to assess the effect of training on thera-
pist knowledge, attitudes, and behavior. Mental health
counselors (n = 13) trained in supportive mental health
counseling and MI for addictions received 12 weeks of
training (2.5 hours each) and biweekly supervision
(Hunter et al., 2005). Note that a subset of counselors
received 20 hours of training in group CBT for
depression. Client characteristics were collected.
Although the study included a comparison group, only
descriptive analyses were completed due to high staff
attrition (50%) in both the intervention and compari-
son site and the resulting very small sample. Declarative
knowledge about substance abuse and co-occurring dis-
orders increased in the intervention site after training
(M = 83%) and was sustained over time (M = 81%) in
comparison with the control site (post-training
M = 68%; follow-up M = 74%). Attitudes became
more positive at the intervention site at post-training
and follow-up. Client characteristics were reported but
not analyzed.
More methodologically rigorous studies included
the effect of therapist training on independent ratings
of adherence and competence. TLDP training con-
sisted of 50 weekly two-hour in-person seminar and
supervision sessions including didactic presentations of
principles, a manual, and treatment of a training case
with supervision (n = 16; Henry, Schacht, et al.,
1993). Individual differences were quantified amongst
the two trainers—the better trainer was directive and
specific regarding the learning task, focused on thera-
pist rather than patient dynamics, and provided posi-
tive reinforcement regarding specific therapist action.
Therapist variables influenced training response—
therapists with more prior supervision were less
adherent, while therapists with certain interpersonal
styles showed greatest technical adherence. Client
variables also influenced training response—therapists
showed greater improvements in skill when working
with patients traditionally deemed less suitable for
short-term techniques.
The gold standard for studies conducted in this liter-
ature includes random assignment and a comparison
condition (Miller et al., 2004). Therapists were ran-
domized to one of five training conditions (n = 140):
(a) two-day workshop only, (b) two-day workshop
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 23
plus feedback on tapes, (c) two-day workshop plus six
individual coaching sessions, (d) two-day workshop
plus coaching and feedback, and (e) a control condi-
tion—self-guided learning (therapist manual and train-
ing videotapes). Therapist variables did not predict
therapist training response. All four intervention condi-
tions (i.e., a–d) produced increased competence at
post-training. At four-month follow-up, the work-
shop-only group lost their gains and returned near the
levels of the comparison group. Only the groups
receiving feedback and/or coaching reached profi-
ciency levels in global MI-spirit (five of a seven-point
Likert scale) and MI-consistent responses (95%) at post-
training and follow-up. Client response only improved
in the most intensive training (workshop, coaching,
and feedback). The biggest effect in training was not
an increase in therapist MI-consistent responses but a
reduction in MI-inconsistent responses.
Conclusions. Intervening at all four levels of the SC
model may be the key to producing effective out-
comes. Therapist variables are influenced by training
when measured as outcome variables. For example,
attitudes and job satisfaction can be improved following
training (Hunter et al., 2005). However, when examin-
ing therapist variables as predictor variables or mediat-
ing variables, contradictory evidence exists. One study
found that therapist variables did influence response to
training (Henry, Schacht, et al., 1993), while the most
rigorous study found no effect of therapist variables
(Miller et al., 2004).
Support for client variables as predictors of training
and outcome variables emerges. When examined as a
predictor of training response, it appears that therapist
training improved when the client population was
more difficult and more educated. There may be a
complex relationship with supervision present here—
perhaps more difficult clients call for more supervision
time. In terms of outcomes, clients improved when
therapists received the most intensive training interven-
tion (Miller et al., 2004).
An interesting and important finding implicates the
importance of training and organizational factors.
Training style produced differential outcomes in thera-
pist behavior in one study, suggesting that certain
methods of training are preferential. Further, training
method emerged as an important variable when manip-
ulated—the only training that produced proficiency in
MI at long-term follow-up included active learning
strategies (i.e., coaching and ⁄ or feedback). The only
training to elicit actual client change was the one that
included the highest dosage of active learning strate-
gies—feedback and coaching. This suggests the impor-
tance of studying training method (e.g., active versus
passive) in future studies.
An issue that emerges from these studies is the iden-
tification of the barriers and challenges faced in com-
munity research. Hunter et al. (2005) published a
follow-up article documenting barriers to DI research,
including recruitment falling behind schedule, staff
attrition, a comparison site instituting new practices
that duplicated the intervention site, and the increase
in patients already receiving mental health treatment
when presenting to the intervention site (Wenzel,
Ebener, Hunter, Watkins, & Gilmore, 2005). Follow-
up client outcome research was not published due to
difficulties in recruitment, although the intervention
site continues to use the treatment in the community
(S. Hunter, personal communication). These barriers
make it difficult to disseminate and implement EBP in
the community.
Limitations. Study-specific limitations include very
high staff attrition that precluded the use of statistical
analyses and difficulty in recruitment for client treat-
ment outcome investigations (Hunter et al., 2005).
None of these studies measured client outcome using
the preferred technique of semi-structured interviews.
GENERAL DISCUSSION
The most definitive conclusion (see Table 9) is that
training influences therapist knowledge, attitudes, and
perceived behavior. Therapist behavior change (e.g.,
adherence and skill) can occur following training, but a
number of conditions must be met. First, it is necessary
for training to address most, if not all, levels of the SC
model (the therapist is nested within a context and
organizational, therapist, and client variables all interact
transactionally with training to influence skillful imple-
mentation). Additionally, training must utilize active
learning strategies to influence therapist behavior
change.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 24
Knowledge acquisition follows training. Both per-
ceived and declarative knowledge increase after receiv-
ing training in EBP, and this finding appears to hold
across treatment modalities and therapists. Therapist
attitudes also change and this change is maintained over
time following training. Importantly, training engen-
ders self-reported behavior change that does not always
match actual behavior change—pointing to the impor-
tance of including independently rated behavior in all
future assessments of EBP training. The mismatch in
perception and actual behavior is highly problematic
and has important implications because clinicians may
believe they are implementing a treatment with fidelity
and skill (Miller & Mount, 2001). Additionally, this has
deleterious consequences for client treatment outcome
given the finding that better outcomes are observed in
clients when a treatment is applied with fidelity (Elliot
& Mihalic, 2004).
A most surprising finding is the lack of proficiency in
treatment adherence, competence, and skill reached by
therapists trained in the current gold standard (i.e.,
workshop, manual, and clinical supervision; Sholomskas
et al., 2005). Multiple studies across differing treatments
found that training (workshop, manual, and supervision)
was not enough to produce proficient change in thera-
pist adherence, competence, and skill. This is
concerning, considering the importance of these
constructs in administering a treatment with fidelity
(Perpepletchikova & Kazdin, 2005). In turn, therapists
were not necessarily able to engender client change. If
therapists lack proficiency in a treatment, perhaps linked
to inadequate training, then it is unlikely that clients will
experience the benefits associated with a particular EBP.
Although proficiency in therapist behavior was not
often achieved, when studies intervened at the levels of
training, organizational, and therapist variables, thera-
pists did reach proficiency levels in adherence, compe-
tence, and skill, particularly in CBT. Similarly, when
all levels of the SC model (i.e., Miller et al., 2004)
were addressed and active learning was used, both ther-
apist and client change occurred. As posited by the SC
model, therapist, client, and organizational variables
interplay and influence the effects of training. To
achieve client change, it is necessary for therapists to
reach proficiency levels in knowledge, adherence,
competence, and skill. This perspective speaks to the
importance of training therapists to criteria prior to
implementing treatments.
What occurs within training that may produce dif-
ferential outcomes? An intriguing finding highlights the
quality (i.e., content and method) of training. Active
learning appears to be most effective—the only study
to evidence client change included two active learning
processes (i.e., coaching and feedback).
Most aspects of the SC model were understudied.
An SC perspective dictates consideration of the organi-
zational forces and factors that create the climate for
successful DI efforts. Research that measures ways to
understand organizations (see Organizational Social
Context; Glisson et al., 2008) will inform needed orga-
nizational change for DI efforts. Zazzali et al. (2008)
interviewed administrators of state organizations where
an EBP had been implemented and found that organi-
zational characteristics (e.g., interest in EBP and avail-
able resources) and organizational structures influenced
the adoption and implementation of EBP. Similarly,
low workplace support predicted less utilization of the
Triple P program following training in service
providers (Sanders, Prinz, & Shapiro, 2009). Further
examination of the organizational context in the imple-
mentation of EBP is needed.
Table 9. General conclusions
Across treatment modalities and therapists, perceived and declarative
knowledge increase following training in EBP.
Across treatment modalities and therapists, attitudes improve after
training in EBP and this is maintained at follow-up.
Across treatment modalities and therapists, perceived (self-reported)
therapist behavior change does not match actual behavior change.
Generally speaking, therapists trained in the current format (i.e.,
workshop, manual, and brief supervision) do not reach proficiency in
treatment adherence, competence, and skill.
There is insufficient information about how therapist variables, client
characteristics, and organizational variables influence therapist
behavior following training (adherence, competence, and skill).
Generally speaking, therapist training in EBP does not currently
engender improved client outcomes.
The quality of training is important to engender client change: Active
learning during training is integral to influence both therapist and
client change.
Provisional evidence suggests that when addressing all levels of the
systems-contextual model, therapists reach proficiency levels in
adherence, competence, and skill, particularly in CBT, and in turn
influence client change.
Note. EBP, evidence-based practice.
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 25
The incomplete literature leaves an absence of
conclusions regarding therapist variables. Consistent
measurement is a needed first step. One measure of ther-
apist attitudes, the Evidence Based Practice Attitude
Scale (EBPAS; see Aarons, 2004), provides a beginning
and may help to identify those therapist variables associ-
ated with adherence to and competence with EBP.
Client characteristics were rarely investigated,
despite the consensus that they are probably important.
The influence of client variables cannot be answered
adequately at this time. Future research needs to
include measures of client risk, resiliency, and symptom
severity. Importantly, future research should occur in
tandem with RCTs as such a step would permit exam-
ining whether variations in therapist training engender
client change.
Future Directions
Future DI research will benefit from addressing organi-
zational, therapist, and client variables to demonstrate
how these important contextual factors interact with
training. RCTs with adequate samples and standardized
measures, regardless of the EBP being studied, are
encouraged. Investigations are needed to assess whether
training on one EBP generalizes to training on other
EBPs, and studies are needed to evaluate whether uni-
form guidelines can be created regarding best practices
for training across treatment modalities.
The following questions regarding best practices for
training require research:
1. What elements (e.g., manual, workshop, and super-
vision) should be included in training?
2. What is the optimal duration of training?
3. What is the optimal focus of training (i.e., general
principles of a treatment or session by session)?
4. What type of active learning methods should be
included?
5. What role does ‘‘training to criteria’’ play? Should
trainees be certified in a treatment when they reach
prespecified levels of competency (Sanders,
Murphy-Brennan, et al., 2003; Sanders, Tully, et
al., 2003)?
6. How much supervision is needed to achieve thera-
pist behavior change and competent administration
of an EBP?
Based on this review, we make the following rec-
ommendations:
1. Future training efforts focus on active learning and
behavioral rehearsal with less emphasis on didactics.
2. Follow the SC model. Influencing one variable (e.g.,
therapist training) within a system is unlikely to result
in effective implementation without addressing con-
textual factors. It is unlikely that training and DI will
succeed without the understanding that therapists
function within a context and that multiple variables
(i.e., organizational support, client factors, and thera-
pist factors) affect this context.
3. To assess that actual behavior change is occurring,
future investigations of training must include direct
measures of therapist behavior (e.g., adherence and
skill) in addition to assessments of knowledge and
perceived behavior change.
4. Standardized measurement is necessary to make cross-
study comparisons. For example, a psychometrically
reliable (Moyers, Martin, Manuel, Hendrickson, &
Miller, 2005) system that is treatment specific includes
the Motivational Interviewing Treatment Integrity
scale (MITI; Moyers, Martin, Catley, Harris, & Ah-
luwalia, 2003). Studies of training in MI could use this
measure rather than investigator-created measures.
Additionally, developing measures that can be used
across treatment programs would be useful.
5. The competencies for each treatment program
should be identified so that it is clear what types of
competencies are necessary for each EBP (see Roth
& Pilling, 2008). For instance, for CBT for child
anxiety, active treatment components could be
identified (e.g., exposure and cognitive restructur-
ing), and therapists trained in this treatment should
achieve competencies in these domains.
6. Identifying the barriers to training and utilization of
treatment is important and may be addressed early
in training to problem-solve perceived barriers
(Seng et al., 2006).
7. Supervision is crucial for skillful treatment delivery,
and understanding the role of supervision and its
key features are valuable areas for future research.
Despite the importance of EBP, we know less than
preferred regarding how to best train therapists in EBP.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 26
Training efforts in EBP are underway, yet we are not
informed by how best to proceed. If those who under-
take EBP are not adequately trained in EBP implementa-
tion, will a subsequent evaluation of the benefits of EBP
be unwittingly and unfairly compromised? Evaluations
of training methods and variables, within contextual
variables, will be informative. Without such an undertak-
ing, one’s best EBP intentions may go unfulfilled.
NOTES
1. Going forward, EBP will be used as the terminology of
choice, rather than empirically supported treatments
(ESTs), given that it is a less restrictive term and allows for
a consideration of both rigorous research applied with
clinical judgment. However, when studies explicitly refer
to ESTs rather than EBP, it will be noted in the text.
2. Studies were included if they met criteria as an evidence-
based practice by an external review (e.g., National Regis-
try of Evidence Based Programs and Practice; Chambless
& Hollon, 1998; Chambless & Ollendick, 2001). For a
listing of all treatments reviewed, see Table 1.
3. Studies that just included one question on a demographics
questionnaire were not operationalized as measuring thera-
pist variables.
4. To be included in this review, all studies had to include
training as a variable of interest.
5. Note that certain studies distinguished between perceived
knowledge (e.g., perception of knowledge gained) and
declarative knowledge (e.g., direct measure of knowledge
gained), and we reported on this when this distinction was
made.
6. Direct access to the conclusions can be reached by refer-
ring to the General Discussion section.
7. Note that these were not statistically examined.
REFERENCES
Aarons, G. (2004). Mental health provider attitudes toward
adoption of evidence-based practice: The Evidence-Based
Practice Attitude Scale (EBPAS). Mental Health Services
Research, 6, 61–74.
Abramowitz, J. (2006). Toward a functional analytic approach
to psychologically complex patients: A comment on
Ruscio and Holohan. Clinical Psychology: Science and Prac-
tice, 13, 163–166.
Addis, M., & Krasnow, A. (2000). A national survey of prac-
ticing psychologists’ attitudes toward psychotherapy treat-
ment manuals. Journal of Consulting and Clinical Psychology,
68, 331–339.
American Academy of Child and Adolescent Psychiatry. (2006).
American Academy of Child and Adolescent Psychiatry
policy statement on evidence-based practice in psychiatry.
Retrieved July 5, 2007, from http://www.aacap.
org/cs/root/policy_statements/evidence_based_practice
American Psychological Association. (2005, August). Ameri-
can Psychological Association policy statement on evi-
dence-based practice in psychology. Retrieved March 6,
2006, from http://www.apa.org/practice/ebpreport
*Baer, J. S., Rosengren, D. B., Dunn, C. W., Wells, E. A.,
& Ogle, R. L. (2004). An evaluation of workshop train-
ing in motivational interviewing for addiction and mental
health clinicians. Drug and Alcohol Dependence, 73, 99–
106.
Bazelmans, E., Prins, J., Hoogveld, S., & Bleijenberg, G.
(2004). Manual-based cognitive behavior therapy for
chronic fatigue syndrome: Therapists’ adherence and per-
ceptions. Cognitive Behavior Therapy, 33, 143–1
50.
*Beidas, R. S., Barmish, A. J., & Kendall, P. C. (2009).
Training as usual: Can therapist behavior change after
reading a manual and attending a brief workshop on cog-
nitive behavioral therapy for youth anxiety? The Behavior
Therapist, 32, 97–101.
*Bein, E., Anderson, T., Strupp, H. H., Henry, W. P.,
Schacht, T. E., Binder, J. L., et al. (2000). The effects of
training in time-limited dynamic psychotherapy: Changes
in therapeutic outcome. Psychotherapy Research, 10, 119–
132.
*Brooker, C., & Butterworth, T. (1993). Training in psycho-
social intervention: The impact on the role of community
psychiatric nurses. Journal of Advanced Nursing, 18, 583–
590.
*Chagnon, F., Houle, J., Marcoux, I., & Renaud, J. (2007).
Control-group study of an intervention training program
for youth suicide prevention. Suicide and Life-Threatening
Behavior, 37, 135–144.
Chambless, D., & Hollon, S. (1998). Defining empirically
supported therapies. Journal of Consulting and Clinical Psy-
chology, 66, 7–
18.
Chambless, D., & Ollendick, T. (2001). Empirically sup-
ported psychological interventions: Controversies and evi-
dence. Annual Review of Psychology, 52, 685–716.
Crits-Christoph, P., Frank, E., Chambless, D., Brody, C., &
Karp, J. (1995). Training in empirically-validated treat-
ments: What are clinical psychology students learning?
Professional Psychology, 26, 514–522.
Crits-Christoph, P., Siqueland, L., Chittams, J., Barber, J. P.,
Beck, A. T., Frank, A., et al. (1998). Training in cogni-
tive, supportive-expressive, and drug counseling therapies
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 27
for cocaine dependence. Journal of Consulting and Clinical
Psychology, 66, 484–492.
*Cross, W., Matthieu, M., Cerel, J., & Knox, K. (2007).
Proximate outcomes of gatekeeper training for suicide
prevention in the workplace. Suicide and Life-Threatening
Behavior, 37, 659–670.
DeViva, J. (2006). The effects of full-day and half-day work-
shops for health care providers in techniques for increasing
resistant clients’ motivation. Professional Psychology: Research
and Practice, 37, 83–90.
Elliot, D., & Mihalic, S. (2004). Issues in disseminating and
replicating effective prevention programs. Prevention Sci-
ence, 5, 47–53.
Ellis, M., Krengel, M., Ladany, N., & Schult, D. (1996).
Clinical supervision research from 1981–1993: A method-
ological critique. Journal of Counseling Psychology, 43, 35–
50.
El-Tannir, A. (2002). The corporate university model for
continuous learning, training, and development. Education
& Training, 44, 76–81.
*Fadden, G. (1997). Implementation of family interventions
in routine clinical practice following staff training pro-
grams: A major cause for concern. Journal of Mental Health,
6, 599–612.
Gega, L., Norman, I., & Marks, I. (2007). Computer-aided
vs. tutor-delivered teaching of exposure therapy for phobia ⁄
panic: randomized controlled trial with pre-registration
nursing students. International Journal of Nursing Studies, 44,
397–405.
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K.,
Hoagwood, K., Mayberg, S., et al. (2008). Assessing the
organizational social context (OSC) of mental health ser-
vices: Implications for research and practice. Administration
and Policy in Mental Health and Mental Health Services
Research, 35, 98–113.
*Hawkins, K. A., & Sinha, R. (1998). Can front-line clini-
cians master the conceptual complexities of dialectical
behavior therapy? An evaluation of a State Department on
Mental Health training program. Journal of Psychiatric
Research, 32, 379–384.
Hayes, S. (2002). Getting to dissemination. Clinical Psychology:
Science and Practice, 9, 410–415.
*Henggeler, S., Chapman, J., Rowland, M., Halliday-
Boykins, C., Randall, J., Shackelford, J., et al. (2008).
Statewide adoption and initial implementation of contin-
gency management for substance-abusing adolescents. Jour-
nal of Consulting and Clinical Psychology, 76, 556–567.
Henggeler, S., Schoenwald, S., Liao, J., Letourneau, E., &
Edwards, D. (2002). Transporting efficacious treatments to
field settings: The link between supervisory practices and
therapist fidelity in MST programs. Journal of Clinical Child
and Adolescent Psychology, 31, 155–167.
*Henggeler, S., Sheidow, A., Cunningham, P., Donohue,
B., & Ford, J. (2008). Promoting the implementation of
an evidence-based intervention for adolescent marijuana
abuse in community settings: Testing the use of intensive
quality assurance. Journal of Clinical Child and Adolescent
Psychology, 37, 682–689.
*Henry, W. P., Schacht, T. E., Strupp, H. H., Butler, S. F.,
& Binder, J. L. (1993). Effects of training in time-limited
dynamic psychotherapy: Mediators of therapists’ responses
to training. Journal of Consulting and Clinical Psychology, 61,
441–447.
*Henry, W. P., Strupp, H. H., Butler, S. F., Schacht, T. E.,
& Binder, J. L. (1993). Effects of training in time-limited
dynamic psychotherapy: Changes in therapist behavior.
Journal of Consulting and Clinical Psychology, 61, 434–440.
Herschell, A., McNeil, C., & McNeil, D. (2004). Clinical
child psychology’s progress in disseminating empirically
supported treatments. Clinical Psychology: Science and Prac-
tice, 11, 267–288.
Holloway, E. L., & Neufeldt, S. A. (1995). Supervision: Its
contributions to treatment efficacy. Journal of Consulting
and Clinical Psychology, 63, 207–213.
*Hunter, S., Watkins, K., Wenzel, S., Gilmore, J., Sheehe,
J., & Griffin, B. (2005). Training substance abuse treat-
ment staff to care for co-occurring disorders. Journal of
Substance Abuse Treatment, 28, 239–245.
James, I., Blackburn, I., Milne, D., & Reichfelt, F. (2001).
Moderators of trainee therapists’ competence in cogni-
tive therapy. British Journal of Clinical Psychology, 40,
131–141.
Karekla, M., Lundgren, J., & Forsyth, J. (2004). A survey of
graduate training in empirically supported and manualized
treatments: A preliminary report. Cognitive and Behavioral
Practice, 11, 230–242.
Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail
for dissemination of evidence-based practices for youth:
Flexibility within fidelity. Professional Psychology: Research
and Practice, 38, 13–20.
Kendall, P. C., & Southam-Gerow, M. (1996). Long-term
follow-up of treatment for anxiety disordered youth. Jour-
nal of Consulting and Clinical Psychology, 64, 724–730.
Landis, J., & Koch, G. (1977). The measurement of observer
agreement for categorical data. Biometrics, 45, 233–268.
Lomas, J. (1993). Diffusion, dissemination and implementa-
tion: Who should do what? Annals of the New York Acad-
emy of Science, 703, 226–235.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 28
*Luoma, J., Hayes, S., Twohig, M., Roget, N., Fisher, G.,
Padilla, M., et al. (2007). Augmenting continuing educa-
tion with psychologically focused group consultation:
Effects on adoption of group drug counseling. Psychother-
apy: Theory, Research, Practice, Training, 44, 463–469.
*Matthieu, M., Cross, W., Batres, A., Flora, C., & Knox, K.
(2008). Evaluation of gatekeeper training for suicide pre-
vention in veterans. Archives of Suicide Research, 12, 148–
154.
*Maunder, L., Milne, D., & Cameron, L. (2008). Pilot
evaluation of brief training in CBT for primary care
therapists. Behavioural and Cognitive Psychotherapy, 36,
341–351.
*McVey, G., Davis, R., Kaplan, A., Katzman, D., Pinhas, L.,
Geist, R., et al. (2005). A community-based training pro-
gram for eating disorders and its contribution to a provin-
cial network of specialized services. International Journal of
Eating Disorders, 37, 35–40.
Miller, W. (2000). Rediscovering fire: Small interventions,
large effects. Psychological Addictions & Behavior, 14, 6–
18.
*Miller, W. R., & Mount, K. A. (2001). A small study of
training in motivational interviewing: Does one workshop
change clinician and client behavior? Behavioural and Cog-
nitive Psychotherapy, 29, 457–471.
Miller, W., Sorensen, J., Selzer, J., & Brigham, G. (2006).
Disseminating evidence-based practices in substance abuse
treatment: A review with suggestions. Journal of Substance
Abuse Treatment, 31, 25–39.
*Miller, W., Yahne, C., Moyers, T., Martinez, J., & Pirritano,
M. (2004). A randomized trial of methods to help clinicians
learn motivational interviewing. Journal of Consulting and
Clinical Psychology, 72, 1050–1062.
*Morganstern, J., Morgan, T., McCrady, B., Keller, D., &
Carroll, K. (2001). Manual-guided cognitive-behavioral
therapy training: A promising method for disseminating
empirically supported substance abuse treatments to the
practice community. Psychology of Addictive Behaviors, 15,
83–88.
*Moyers, T., Manual, J., Wilson, P., Hendrickson, S.,
Talcott, W., & Durand, P. (2008). A randomized trial
investigating training in motivational interviewing for
behavioral health providers. Behavioural and Cognitive Psy-
chotherapy, 36, 149–162.
Moyers, T., Martin, T., Catley, D., Harris, K., & Ahluwalia,
J. (2003). Assessing the integrity of motivational inter-
viewing interventions: Reliability of the Motivational
Interviewing Skills Code. Behavioural and Cognitive Psycho-
therapy, 31, 177–184.
Moyers, T., Martin, T., Manuel, J., Hendrickson, S., & Miller,
W. (2005). Assessing competence in motivational inter-
viewing. Journal of Substance Abuse Treatment, 28, 19–26.
Najavits, L., Weiss, R., Shaw, S., & Dierberger, A. (2000).
Psychotherapists’ views of manuals. Professional Psychology:
Research and Practice, 31, 404–408.
*National Crime Victims Research & Treatment Center.
(2007). TF-CBT web: First year report. Charleston, SC:
Medical University of South Carolina.
Perpepletchikova, F., & Kazdin, A. (2005). Treatment integrity
and therapeutic change: Issues and research recommenda-
tions. Clinical Psychology: Science and Practice, 12, 365–383.
Roth, A., & Pilling, S. (2008). Using an evidence-based
methodology to identify the competencies required to
deliver effective cognitive and behavioral therapy for
depression and anxiety disorders. Behavioural and Cognitive
Psychotherapy, 36, 129–147.
*Rubel, E. C., Sobell, L. C., & Miller, W. R. (2000). Do
continuing education workshops improve participants’
skills? Effects of a motivational interviewing workshop on
substance-abuse counselors’ skills and knowledge. Behavior
Therapist, 23, 73–77.
*Saitz, R., Sullivan, L. M., & Samet, J. H. (2000). Training
community-based clinicians in screening and brief inter-
vention for substance abuse problems: Translating evi-
dence into practice. Substance Abuse, 21, 21–31.
*Sanders, M., Murphy-Brennan, M., & McAuliffe, C.
(2003). The development, evaluation, and dissemination
of a training programme for general therapists in evi-
dence-based parent consultation skills. International Journal
of Mental Health Promotion, 5, 13–20.
*Sanders, M., Prinz, R., & Shapiro, C. (2009). Predicting
utilization of evidence-based parenting interventions with
organizational, service-provider and client variables.
Administrative Policy and Mental Health, 36, 133–143.
*Sanders, M., Tully, L., Turner, K., Maher, C., &
McAuliffe, C. (2003). Training GPs in parent consultation
skills. Australian Family Physician, 32, 763–768.
Sanders, M., & Turner, K. (2005). Reflections on the chal-
lenges of effective dissemination of behavioural family
intervention: Our experience with the Triple P—Positive
parenting program. Child and Adolescent Mental Health, 10,
158–169.
*Schoener, E. P., Madeja, C. L., Henderson, M. J.,
Ondersma, S. J., & Janisse, J. (2006). Effects of motiva-
tional interviewing training on mental health therapist
behavior. Drug and Alcohol Dependence, 82, 269–275.
*Seng, A., Prinz, R., & Sanders, M. (2006). The role of
training variables in effective dissemination of evidence-
TRAINING IN EVIDENCE-BASED PRACTICE: A REVIEW • BEIDAS & KENDALL 29
based parenting interventions. International Journal of Mental
Health Promotion, 8, 19–27.
*Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J.,
Ball, S. A., & Nuro, K. F. (2005). We don’t train in vain:
A dissemination trial of three strategies of training clini-
cians in cognitive behavioral therapy. Journal of Consulting
and Clinical Psychology, 73, 106–115.
Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008).
Evidence based psychological treatment for phobic and
anxiety disorders in children and adolescents. Journal of
Clinical Child and Adolescent Psychology, 37, 105–130.
*Siqueland, L., Crits-Christoph, P., Barber, J. P., Butler,
S. F., Thase, M., Najavits, L., et al. (2000). The role of
therapist characteristics in training effects in cognitive,
supportive expressive, and drug counseling therapies for
cocaine dependence. Journal of Psychotherapy Practice &
Research, 9, 123–130.
Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., &
Rothman, A. (2005). Can the randomized controlled trial
literature generalize to non-randomized patients? Journal of
Consulting and Clinical Psychology, 73, 127–135.
Turner, K., & Sanders, M. (2006). Dissemination of evidence-
based parenting and family support strategies: Learning from
the Triple P—Positive Parenting Program system approach.
Aggression and Violent Behavior, 11, 176–193.
United States Surgeon General. (1999). Mental health: A report
of the surgeon general. Washington, DC: U.S. Government
Printing Office.
Walkup, J., Albano, A. M., Piacentini, J., Birmaher, B.,
Compton, S., Sherrill, J., et al. (2008). Cognitive behavioral
therapy, sertraline, or a combination in childhood anxiety.
New England Journal of Medicine, 359, 2753–2766.
*Watkins, K., Osilla, K., Hepner, K., Sandres, P., &
Thompson, J. (2008, February). Project BRIGHT: Build-
ing recovery by improving goals, habits and thoughts.
Symposium conducted at the Co-occurring Disorders
Conference.
Wenzel, S., Ebener, P., Hunter, S., Watkins, K., & Gilmore,
J. (2005). Research-practice partners assess their first joint
project. Science & Practice Perspectives, 3, 38–45.
Westen, D., Novotny, C., & Thompson-Brenner, H. (2004).
The empirical status of empirically supported psychothera-
pies: Assumptions, findings, and reporting in controlled
clinical trials. Psychological Bulletin, 130, 631–663.
*Wyman, P., Brown, C., Inman, J., Cross, W., Schmeelk-
Cone, K., Guo, J., et al. (2008). Randomized trial of a
gatekeeper program for suicide prevention: 1-year impact
on secondary school staff. Journal of Consulting and Clinical
Psychology, 76, 104–115.
Zazzali, J., Sherbourne, C., Hoagwood, K., Greene, D.,
Bigley, M., & Sexton, T. (2008). The adoption and
implementation of an evidence based practice in child and
family mental health service organizations: A pilot study of
functional family therapy in New York State. Administra-
tion and Policy in Mental Health and Mental Health Services
Research, 35, 38–49.
*References marked with an asterisk indicate studies included
as reviewed articles.
Received February 14, 2009; revised June 8, 2009; accepted
June 10, 2009.
CLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE • V17 N1, MARCH 2010 30
Copyright of Clinical Psychology: Science & Practice is the property of Blackwell Publishing Limited and its
content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder’s
express written permission. However, users may print, download, or email articles for individual use.
Articl
e
Measurement and Evaluation in
Counseling and Developmen
t
43(1) 3 –1
5
© The Author(s) 2010
Reprints and permission: http://www.
sagepub.com/journalsPermissions.nav
DOI: 10.1177/0748175610362237
http://mec.sagepub.com
Assessment and
Self-Injury: Implications
for Counselo
r
s
Laurie M. Craigen1, Amanda C. Healey2,
Cynthia T. Walley3, Rebekah Byrd1,
and Jennifer Schuster1
Abstract
This article provides readers with an understanding of self-injury assessment. The article begins
with a critical revi
ew
of a number of self-injury assessments. The latter section of the article
introduces a comprehensive two-tiered approach to accurately assessing self-injury. Implications
for counselors related to the assessment of self-injury are also provided.
Keywords
self-injury, assessment, self-injurious behavio
r
Self-injurious behavior is an increasing issue
among adolescents and young adults. Accord-
ing to current research, self-injurious behavior
occurs in 4% to 39% of adolescents in the
general population and the numbers are pre-
dicted to rise, due to various reasons, ranging
from levels and quality of social interactions
with peers to the availability and assimilation
of coping behaviors through access to the
Internet (Briere & Gil, 1998; Favazza, 1996;
Gratz, 2001; Gratz, Conrad, & Roemer, 2002;
Muehlenkamp & Guiterrez, 2004; Nock &
Prinstein, 2005; Ross & Heath, 2002). Statis-
tics on the incidence of self-injury can be
unreliable, underestimating the true incidence
of self-injury. The reality is that many inci-
dents will be dealt with by the individual, in
private, and will never reach the attention of
medical services or mental health profession-
als (McAllister, 2003). Recently, there has
been a surge in the literature related to defin-
ing and explaining the behavior (Gratz, 2006).
Conversely, very little is known about the
assessment of self-injury, and therefore, a gap
exists between understanding the behavior and
implementing focused counseling interventions
and treatment (White Kress, 2003). The
purpose of this article is to provide readers
with knowledge about the difficulties related
to accurately evaluating self-injury and the
history of self-injury assessments, while also
introducing a comprehensive two-tiered
app roach to assessing self-injury, emphasiz-
ing a holistic perspective.
Review of Self-Injury
Assessments
The development of inventories to evaluate
self-injury began in the early 1990s and con-
tinues today. As the conceptualizations and
definitions of self-injury have evolved, so too
has the focus of the assessments tailored for
its evaluation. Although the newer scales appear
to assess the behaviors and attitudes associated
1Old Dominion University, Norfolk, Virginia, USA
2East Tennessee State University, Johnson City,
Tennessee, USA
3Hunter College, New York City, New York, USA
Corresponding Author:
Laurie M. Craigen, PhD, LPC, Old Dominion University,
110 Education Building, Norfolk, VA 23529 USA
Email: lcraigen@odu.edu
4 Measurement and Evaluation in Counseling and Development 43(1)
with self-injury, many have not been through
the rigorous testing necessary to fully evaluate
their efficacy, reliability, and validity. Thus, when
selecting and administering assessments, it is
necessary for counselors to understand the evolv-
ing nature and continuing development of the
instrument they select for evaluating self-injury.
In the following section, a brief overview of
the inventories available for assessing self-
injurious behaviors is provided (see Table 1).
Self-Injury Trauma Scale (SITS)
One of the first inventories to be developed
for the assessment of self-injurious behaviors
is the SITS created by Iwata, Pace, and Kissel
(1990). It was created to evaluate the extent of
tissue damage caused by self-injury. This inven-
tory examines categories including location,
type, number, and severity of the tissue damage
as well as a summary evaluation of severity and
current risk for continued self-injury. SITS
defines its typical use in terms of quantifying
tissue damage directly. It also permits differ-
entiation of self-injury according to topography,
location of the injury on the body, type of injury,
number of injuries, and estimates of severity
through evaluation of the injuries themselves.
Test-retest reliability was reported at r = .68
(Iwata et al., 1990). This assessment was later
used to evaluate self-injury in conjunction
with physical pain as based on the proposition
that the experience and expression of pain is
somehow different among those individuals who
self-injure, therefore leading to the acceptabil-
ity and tolerability of self-injury as a behavior
(Symons & Danov, 2005).
The SITS was later used in a study to
det ermine the effects of a psychopharmacologi-
cal treatment on those with intellectual
disabilities who engaged in self-injury. In this
study, the SITS inventory was found to be reli-
able when used in conjunction with the
Non-Communication Children’s Pain Check-
list–Revised (NCCPC-R) in recognizing and
tracking self-injury from the perspective of an
outside observer—in this case, the parent
(McDonough, Hillery, & Kennedy, 2000). No
specific data were reported related to concurrent
validity beyond the statement that “the mean
NCCPC-R score was 20.1 for time intervals
scored with self-injurious behavior (SIB) and
2.5 for time intervals scored without SIB” (p.
474) as indicated by the SITS. The initial evalu-
ation of the inventor’s efficacy and subsequent
usage found the scale to be a reliable method for
collecting data on surface tissue damage caused
by self-injury. However, the use of this scale
might not be practical for counselors but could
be useful for professionals who intervene with
the physical consequences of self-injury, such as
school nursing staff or medical professionals.
Self-Harm Inventory (SHI)
The SHI was developed by Sansone, Wiederman,
and Sansone (1998) in the context of screen-
ing for Borderline Personality Disorder (BPD).
It was the belief of the instrument developers
that BPD exists on a continuum in which self-
injury is the most severe manifestation of self-
sabotaging behaviors. With regard to the uses
of the SHI, self-harm is defined as the deliber-
ate, direct destruction of body tissue without
conscious suicidal intent but results in injury
severe enough for tissue damage to occur. The
SHI assesses frequency, severity, duration, and
type of self-injurious behavior. The SHI was
found to be highly related to the Diagnostic
Interview for Borderlines (DIB) at a correla-
tion of r = .76 and the Personality Diagnostic
Questionnaire–Revised at r = .71 with regard
to non-psychotic adults (Sansone et al., 1998).
The developers of this inventory also showed
that the SHI was able to predict the diagnosis
of BPD as based on its convergent validity. This
inventory is made up of 22 items that were
selected due to their correlation with the DIB,
and each question begins with the phrase, “Have
you ever on purpose, or intentionally . . . ,” and
respondents were asked to give a “yes” or
“no” answer (Sansone, Songer, Douglas, &
Sellbom, 2006, p. 976). The final score is a
simple summation of the items endorsed by
the client. In developing and testing the mea-
sure, it showed acceptable levels of clinical
accuracy as a measure for the diagnosis of
BPD by assessing a pattern of self-destructive
5
T
a
b
le
1
.
St
re
ng
th
s
an
d
W
ea
kn
es
se
s
o
f
C
ur
re
nt
S
ca
le
In
ve
nt
o
ri
es
A
ut
ho
r(
s)
C
re
at
e
d
R
e
l
ia
bi
l
it
y
V
al
id
it
y
U
se
/F
ac
to
rs
Pr
ed
ic
ti
ve
A
bi
lit
y
Su
ic
id
al
it
y
SI
T
S
Iw
at
a,
P
ac
e,
&
K
is
se
l
19
90
Te
st
-r
et
es
t
A
ss
es
si
ng
t
is
su
e
da
m
ag
e
as
r
es
ul
t
o
f
se
l
f-
in
ju
ry
A
bl
e
to
p
re
di
ct
c
ur
re
nt
r
is
k
N
o
t
ev
al
ua
te
d
S
H
I
Sa
ns
o
ne
,
W
ie
de
rm
an
, &
Sa
ns
o
ne
19
98
Pr
ed
ic
ti
ve
co
nv
er
ge
nt
Id
en
ti
fy
in
g
se
lf-
in
ju
ry
in
co
nj
un
ct
io
n
w
it
h
B
PD
Pr
ed
ic
t
pr
es
en
ce
o
f
b
o
rd
er
lin
e
pe
rs
o
na
lit
y
fe
at
ur
es
C
an
d
iff
er
en
ti
at
e
be
tw
ee
n
hi
gh
a
nd
lo
w
le
th
al
it
y
SI
Q
A
le
xa
nd
er
19
99
In
te
rn
al
co
ns
is
te
nc
y;
te
st
-r
et
es
t
Fa
ce
a
nd
co
nv
er
ge
nt
di
ve
rg
en
t
U
se
w
it
h
th
o
se
w
ho
ha
ve
s
uf
fe
re
d
tr
au
m
a
M
ea
su
re
s
in
te
nt
t
o
s
el
f-
ha
rm
M
ea
su
re
s
fo
r
m
aj
o
r
su
ic
id
e
co
nc
ep
ts
D
SH
I
G
ra
tz
20
01
Te
st
-r
et
es
t
In
te
rn
al
co
ns
is
te
nc
y
co
ns
tr
uc
t
co
nv
er
ge
nt
a
nd
di
sc
ri
m
in
at
e
B
eh
av
io
ra
lly
b
as
ed
;
cl
in
ic
al
p
o
pu
la
ti
o
ns
A
bl
e
to
p
re
di
ct
t
he
fe
at
ur
es
o
f
se
lf-
in
ju
ri
o
us
b
eh
av
io
rs
Su
ic
id
al
in
te
nt
as
se
ss
ed
SI
-I
A
T
N
o
ck
&
B
an
ja
i
20
07
Pr
ed
ic
ti
ve
A
ss
es
si
ng
b
el
ie
fs
a
nd
id
en
ti
fic
at
io
n
w
it
h
se
lf-
in
ju
ry
Pr
ed
ic
t
su
ic
id
al
id
ea
ti
o
n
an
d
be
ha
vi
o
rs
Ev
al
ua
te
d
an
d
di
ffe
re
nt
ia
te
d
SA
SI
I
Li
ne
ha
n,
C
o
m
to
is
,
B
ro
w
n,
H
ea
rd
, &
W
ag
ne
r
20
07
In
te
rr
at
er
Pr
ed
ic
ti
ve
co
nt
en
t
Pr
o
vi
de
d
es
cr
ip
ti
ve
in
fo
o
n
su
ic
id
al
a
nd
s
el
f-
in
ju
ri
o
us
b
eh
av
io
rs
Ev
al
ua
te
s
pa
st
b
eh
av
io
r;
b
as
ed
o
n
PH
I
Su
ic
id
al
in
te
nt
a
nd
le
th
al
it
y
o
f
se
lf-
in
ju
ri
o
us
b
eh
av
io
rs
SI
T
B
I
N
o
ck
, H
o
lm
be
rg
,
Ph
o
to
s,
&
M
ic
he
l
20
07
In
te
r-
ra
te
r
te
st
-r
et
es
t
C
o
ns
tr
uc
t
To
a
ss
es
s
a
w
id
e
ra
ng
e
o
f
se
lf-
in
ju
ry
-r
el
at
ed
co
ns
tr
uc
ts
N
o
ne
s
ta
te
d
A
ss
es
se
d
ge
st
ur
es
,
pl
an
, i
de
at
io
ns
, a
nd
at
te
m
pt
s
SI
T
S
=
Se
lf-
In
ju
ry
T
ra
um
a
Sc
al
e;
S
H
I
=
S
el
f-
H
ar
m
In
ve
nt
o
ry
; S
IQ
=
S
el
f-
In
ju
ry
Q
ue
st
io
nn
ai
re
; D
SH
I =
D
el
ib
er
at
e
Se
lf-
H
ar
m
In
ve
nt
o
ry
; S
I-
IA
T
=
S
el
f-
In
ju
ry
Im
pl
ic
it
A
ss
o
ci
at
io
n
Te
st
;
SA
SI
I =
S
ui
ci
de
A
tt
em
pt
S
el
f-
In
ju
ry
I
nt
er
vi
ew
; S
IT
B
I
=
Se
lf-
In
ju
ri
o
us
T
ho
ug
ht
s
an
d
B
eh
av
io
rs
I
nt
er
vi
ew
; B
PD
=
B
o
rd
er
lin
e
Pe
rs
o
na
lit
y
D
is
o
rd
er
; P
H
I
=
Pa
ra
su
ic
id
e
H
is
to
ry
I
nt
er
vi
ew
6 Measurement and Evaluation in Counseling and Development 43(1)
behaviors (Sansone, Whitecare, Meier, & Murry,
2001). Additionally, the SHI has been shown to
have an acceptable level of internal consistency
with Cronbach’s α = .80 (Sansone et al., 2006).
The developers have stated that the inventory
could help clinicians identify and distinguish
high-lethality and low-lethality self-injury.
Self-Injury Questionnaire (SIQ)
The SIQ was developed by Alexander (1999)
and later evaluated by Santa Mina, Gallop,
and Links (2006). This inventory was created
to evaluate and differentiate the intentions behind
self-injurious behaviors as based on a history
of childhood physical and/or sexual abuse. The
questionnaire was developed using a guiding
definition of self-injury as simply self-destructive
behaviors without the intent to die. Preliminary
findings of the initial research study that used
the SIQ showed good face validity and ade-
quate test-retest reliability in nonclinical
populati ons. Test-rest reliability over a 2-week
period of the behavioral items ranged from
r = .29 to r = 1.0, with a total correlation of
test-retest of r = .91 (Alexander, 1999). A sep-
arate study also revealed similar results for
the SIQ in acute populations, with the addi-
tion of statistical analysis resulting in findings
of high internal consistency of the total scale
(α = .83; 95% Confidence Interval [CI]) and an
adequate Cronbach’s alpha for each subscale
(α = .72 to .77) (Santa Mina et al., 2006).
Convergent validity analyses were also con-
ducted by Santa Mina et al. (2006) between
the SIQ and the Suicide Intent Scale (SIS), the
Beck Depression Inventory II (BDI II), and the
Self-Inflicted Injury Severity Form (SIISF).
The convergent validity between the SIQ and
the scales was reported to be r = –.37 with
regard to the factor of stimulation and the SIS,
r = .23 with regard to the affect regulation
factor of the SIQ as compared to the BDI II,
and r = –.25 with regard to the dissociation
factor of the SIQ and the SIISF. The SIQ is a
30-item self-report instrument conceptualized
from developments in trauma research. This
questionnaire measures the intent of self-injury
through evaluation methods across various
subscales, including body alterations, indirect
self-injury, failure to care for oneself, and
overt self-injury. The SIQ measures the func-
tions, types, and frequency of self-injuring
behaviors in association with a trauma history.
Questions on the SIQ related to agreement to
engagement in behaviors such as tattooing
and the frequency and number of self-injurious
acts related to these behaviors. Following each
behavioral item, if agreement was stated, par-
ticipants were then asked to circle further
items related to the reason contributing to the
behavior. At the time of this publication, this
inventory was yet to be tested in a clinical
setting; therefore, its efficacy with regard to
counseling is unclear and needs to be tested
further.
Deliberate Self-Harm Inventory (DSHI)
The DSHI was developed using an integrated
definition of self-injury in order to help pro-
vide a clear foundation for the instrument, given
that previous assessments lacked consensus
in definition (Gratz, 2001). It is based on the
notion that self-harm is the deliberate, direct
destruction of body tissue without conscious
suicidal intent but results in injury severe enough
for tissue damage to occur (Fliege et al., 2006).
This measure evaluates various features of self-
injury, including frequency, severity, duration,
and types of self-injurious behaviors. The
inventory consists of 17 items that are behav-
iorally based and reliant on self-report. The
DSHI has been found to be reliable and valid
for assessing self-injury and past suicidal
beh aviors (Gratz, 2006; Gratz & Chapman,
2007; Gratz et al., 2002; Lundh, Karim, &
Quilisch, 2007), with adequate internal reliabil-
ity at α = .62 (Fliege et al., 2006) and adequate
test-retest reliability during a 2- to 4-week
period of φ= .68 (p = .001) (Gratz, 2001). In
the study by Gratz (2001), adequate construct,
convergent, and discriminant reliability was
also found. This assessment is in wide use,
and its brief length lends itself to application
in clinical and outpatient settings. This assess-
ment could be useful in mental health as well
as school settings to determine the need,
Craigen et al. 7
immediacy, and level of intervention needed
with regard to a client or student presenting
self-injurious behaviors.
Suicide Attempt Self-Injury
Interview (SASII)
The SASII was designed to evaluate factors
involved in what the authors referred to as
“nonfatal suicide attempts and intentional self-
injury” (Linehan, Comtois, Brown, Heard, &
Wagner, 2006, p. 304). This measure, once
referred to as the Parasuicide History Inven-
tory, was developed to better understand the
methods involved in self-injury—the motiva-
tions, consequences, ritual, and impulsivity of
the act itself. Its validity and reliability mea-
sures were taken using an inpatient population.
In defining suicidal behavior, this instrument
includes all general definitions pertaining to
parasuicide, fatal and nonfatal suicide, and
self-injury without the intent to die. Therefore,
it does provide descriptive details about self-
injurious and suicidal behaviors but does not
differentiate between the two beyond lethality.
This instrument has been used in several
recent studies that confirm its usability and
importance in assessing the multiple aspects
of suicidal and self-injurious behaviors
(Brown, Comtois, & Linehan, 2002; Koons
et al., 2001). Six scales were developed based
on factor analysis with factors loading at .4 or
above. These six scales evaluated lethality of
the method, suicidal and nonsuicidal intent
associated with an episode, communication of
suicide intent prior to the episode, impulsiv-
ity, physical condition, and level of medical
treatment. The assessment showed high inter-
rater reliability at r = .918 for classification of
suicidality components and r = .843 for epi-
sodes classified as a single event versus a
cluster of self-injurious events (Linehan
et al., 2006). The SASII instrument is useful
in that it provides a rating concerning the
lethality of the act in question in terms of
several com ponents including medical and
other con sequences. This instrument can also
be used to evaluate treatment outcomes
through pre- and postassessment.
Self-Injury Implicit Association
Test (SI-IAT)
The SI-IAT was developed by Nock and Banjai
(2007) to assess self-injury in terms of the
identity with and beliefs surrounding the act
itself. This test was based on the Implicit Asso-
ciation Test (IAT), developed by Greenwald,
McGhee, and Schwartz (1998). To understand
the SI-IAT, it is important to know a little bit
about the test from which it was developed.
The IAT is primarily used for evaluating asso-
ciations to nonclinical constructs and beliefs.
The IAT itself has been shown to have strong
reliability, construct validity, and the capacity
to distinguish clinical changes caused by treat-
ment and attempts to mask feelings. The SI-IAT
was created in order to integrate the advantages
of the IAT in an attempt to assess self-injury
without relying on explicit self-report. The
test measures the implicit associations indi-
viduals have concerning self-injury in terms
of identification with the behavior as well as
attitudes about it.
The research studies conducted by Nock
and Banjai (2007) using the SI-IAT showed
that the assessment was able to strongly predict
recent suicidal ideation and suicide attempts,
with good incremental predictive validity ranging
from .74 to .77 with the participating ado-
lescent population. The assessment could
also distinguish between groups of nonsuicidal
ado lescents who had negative beliefs about
self-injury, adolescents with suicidal ideations
who showed some positive identification, and
adolescents who had attempted suicide while
having strong identification with self-injurious
behaviors. Because of the interpretive nature
of this assessment, it would be important for
counselors to use this in conjunction with mul-
tiple informal assessment techniques to evaluate
the client’s perceptions with regard to his or
her statements. This would help avoid coun-
selor bias in determining the client’s level of
identification with the behaviors. This assess-
ment is also helpful in evaluating how useful the
client views his or her self-injurious behav-
iors in managing symptomology. The level at
which a client integrates self-injury into his or
8 Measurement and Evaluation in Counseling and Development 43(1)
her identity and views self-injury as assistive
to his or her functioning could drastically affect
the approach and interventions the counselor
ultimately decides to use in the process of
treatment. For example, if the client views
self-injury as an effective coping strategy to
reduce stress, the counselor and client could
explore alternative stress-reduction strategies
in counseling sessions.
Self-Injurious Thoughts and
Behaviors Interview (SITBI)
The SITBI was developed by Nock, Holmberg,
Photos, and Michel (2007) as a 169-item
str uctured interview that assesses the pres-
ence, frequency, severity, age-of-onset, and
general characteristics associated with the
thoughts and behaviors of suicidal ideations
and suicide attempts. The SITBI assumes that,
by definition, self-injury does not include the
intent to die and thus differentiates self-injury
from suicidal intent and action. In assessing the
strengths of the interview as an assessment
tool, the authors found it to have strong inter-
rater reliability (Nock et al., 2007), good
test-retest reliability (average k = .70) after 6
months, good construct validity in relation to
suicide measures and suicide attempts (k =
.65), and concurrent validity with measures of
suicidal ideations and gestures. However, it
did have weak reliability in assessing suicide
gestures and plans. Predictive validity for sui-
cidal ideation or future self-injury was not
addressed in the study conducted by Nock et
al. (2007). It is the belief of the authors that
the interview could be used easily in a variety
of clinical settings to get an overview of current
and recent self-injurious behaviors; however,
because of the length of the assessment, there
are time constraints to consider with regard to
the pra cticality of its use.
The self-injury assessment tools that have
been developed over recent years have clear
strengths and weaknesses. For counselors, it is
important to consider the population you are
using before selecting a particular self-injury
assessment tool as well as the setting in which
you will be implementing it. Also, it is critical
to realize that the aforementioned formal assess-
ments are only one piece of the assessment
process. Counselors should never use these
measures in isolation for determining the course
of treatment, outcomes, or need for intervention.
The following section outlines a recommended
approach for assessing self-injury and using
formal assessments in conjunction with addi-
tional evaluation methods.
Comprehensive Assessment
Approach
The need for a comprehensive and multilevel
approach to the assessment and evaluation of
self-injury is clear because of the multifaceted
nature of self-injury. The following section out-
lines a two-tiered process of assessing self-injury.
This process includes the use of both formal and
informal assessment procedures (see Figure 1).
Formal Assessment
The first step in this integrated approach
inv olves the formal assessment of self-injury
(as introduced above) as well as other possi-
bly related concerns, such as depression,
traumatic history, or anxiety. These mental
health concerns necessitate mentioning
because of independent empirical indications
of association with self-injurious behaviors
(Conaghan & Davidson, 2002; Herpertz, Sass,
& Favazza, 1997; Klonsky & Olino, 2008;
Sansone, Chu, & Wiederman, 2007; Sansone
& Levitt, 2002). Overall, formal assessment
measures allow for more accurate diagnoses
and appropriate evaluation and enhance the
formulation of an informed treatment plan.
Self-Injury assessment measures. Many self-
injury assessment tools are available for
con sideration during the implementation of a
formal assessment process as previously pre-
sented (see Table 1). Selecting an appropriate
tool based on population, validity, and reli-
ability is necessary in treating self-injurious
behavior.
Additional formal assessments. Self-injury
rarely occurs in isolation. As stated previously,
many mental health disorders coexist with
Craigen et al. 9
self-injury. Thus, a combination of formal
assessments is fundamental, as it is imperative
to examine the intent behind each act of self-
injury to carefully evaluate which elements of
concern or distress are present for each unique
individual. Because of the complex nature of
self-injury, the more accurate the evaluation,
the better suited and successful the treatment
will be (White Kress, 2003). Thus, it would
behoove counselors to also use standardized
assessments that evaluate areas such as (but
not limited to) suicide, trauma, depression,
anxiety, and eating disorders. The following
are examples of assessments that could address
these indicators. Although this list is not com-
prehensive, other assessments may be selected
and should be matched to the unique needs of
the client:
Self-Injury
Assessment
• Self-Injury Assessment/Inventory
• Suicidality Protocol/Inventory
• Trauma Inventory
• Beck Depression Inventory
Anxiety Scales
Tier One: Formal Assessment
Tier Two: Informal Assessment (all are ongoing):
Formal Assessment
Background
Familial History
Peer Support
Social Support
Negative/Positive
Influences
Emotional Capacity
Verbal Ability to
Express Emotions
Coping Strategies
In Combination withIn Combination with
Figure 1. Two-tier model of assessment
10 Measurement and Evaluation in Counseling and Development 43(1)
• Suicidality Protocol/Inventories: that
is, Inventory of Suicide Orientation-30,
Beck Suicide Inventory, Reasons for
Living Inventory, Hopelessness Scale,
Scale for Suicide Ideation, Suicide
Probability Scale, Suicide Ideation
Questionnaire, and Suicide Probabil-
ity Scale
• Trauma Inventories: that is, Early
Trauma Inventory, Trauma Coping
Inventory, Trauma Symptom Inven-
tory, Trauma Assessment Inventories
• Depression Inventories: that is,
Inv entory of Depressive Symtoma-
tology, BDI, Children’s Depression
Inventory, Major Depression Inven-
tory, Inventory of Depression and
Anxiety Symptoms, Zung Self-Rating
Dep ression Scale
• Anxiety Inventories: that is, Beck
Anxiety Inventory, Spielberger State-
Trait Anxiety Scales, Anxiety Status
Inventory
• Eating Disorder Inventories: that is,
Eating Disorders Inventories, Eating
Attitudes Test, Eating Disorder Exa-
mination, and additional measures
sui ted for the particular client
The aforementioned formal assessments vary
according to reliability and validity. Thus, prior
to selecting a measure, it is important to exa-
mine its strengths as well as the population
being served.
Informal Assessment
The second step in this approach involves
using informal assessment measures. Infor-
mal assessment techniques are subjective and
provide counselors with additional tools for
understanding clients (Neukrug & Fawcett,
2005). The majority of informal assessments
are used in a formative evaluative manner, rather
than through a pretreatment or posttreatment
(summative) evaluation. Informal assessment
techniques combined with formal assessments
allow the clinician to gain a comprehensive,
holistic, and in-depth understanding of the
client and his or her presenting concerns. For
example, gaining an understanding of past and
current familial and relational connections as
well as relational conflicts could lead to greater
insight into the client’s reasoning for his or
her self-injurious behaviors and the structure
of his or her current support network. With all
informal assessment techniques, it is neces-
sary to consistently be aware of cultural context
and how this could be a factor for each client.
Although many techniques can be used to con-
duct informal assessments, only those most
pertinent to the treatment of self-injurious behav-
iors are addressed in this section.
Intakes. Many informal assessment measures
exist and should be used during intake and
also throughout the treatment process for each
individual. At intake, it is important to add a
section or line dedicated to self-injury. This is
an area that is often left off of intakes and is
important in the initial assessment. For exam-
ple, “Have you ever intentionally hurt yourself
for any reason?”
Interviews. Parent and teacher interviews are
a great tool to access valuable information
about your client and his or her experiences
with self-injury. Although many individuals go
to great lengths to hide their self-injury from
parents and teachers, valuable information
can be garnered from speaking with these
individuals, as they may play an important
role in the client’s self-injury and might also
serve as an ally for the client as he or she
explores issues related to his or her behaviors
in counseling. Some questions that might
garner useful treatment information include
the following: “Is the client’s behavior consis-
tent at home and school?” “Does the client
engage in isolative behaviors?” “How does the
client normally express his or her feelings or
needs?” “What type of internalizing or exter-
nalizing behaviors are the parents or teachers
aware of in your client?”
Observations. Observations are an important
assessment tool, providing counselors with an
additional mechanism for understanding the
client (Neukrug & Fawcett, 2005). Although
not all clients who self-injure present in the
same way, there may be consistent behaviors,
Craigen et al. 11
appearances, or nuances that could provide
counselors with helpful information to sup-
plement their understanding of the client. For
example, a client who self-injures may often-
times wear clothes that hide his or her injuries
or have many unexplained cuts, scars, or burns
(White Kress, Gibson, & Reynolds, 2004).
Additionally, clients may avoid conversations
about self-injury or deny their personal expe-
riences with self-injury.
Background information. Acquiring back-
gro und information is a vital aspect of self-
injury assessment and can potentially provide
the counselor with valuable information about
the contributing factors related to the client’s
self-injurious behavior. When obtaining back-
ground information, it is necessary to focus
on all aspects of the individual and not limit
the assessment to the behavior itself. This knowl-
edge provides counselors with valuable
information about what lies beneath the sur-
face of the wounds, a focus of treatment that
has been ignored in the past (Craigen &
Foster, 2009; Walsh, 2006).
Familial history is one aspect of background
information that is often overlooked. Gather-
ing information about an individual’s family
history avoids pathologizing the behavior and
views the presenting behaviors through more
of a systemic lens. Seeking to understand all
contributing factors such as a client’s per-
spectives and experiences regarding his or her
family might not have been considered in the
past; however, it is necessary (McAllister, 2003;
Selekman, 2002). For example, the counselor
may ask, “Who do you talk to in your family
about your feelings?” “How does your family
typically deal with their emotions?” “What
feelings do you have for different members of
your family?” or “What events in your past
family history have affected you negatively?”
In addition to familial information, it is also
important to discuss with the client his or her
peer and social supports (Walsh, 2006). This
is particularly relevant in the adolescent popu-
lation because at this developmental milestone,
peer supports are highly valued. For example,
counselors may say, “Tell me about your
friends.” Or they may ask, “When you are
upset, do you typically talk with your friends?”
“Do your friends know about your self-injurious
behavior?” Other factors that affect the indivi-
dual and need to be assessed are negative
or positive influences that could facilitate
self-injury. These could include Internet sites
ded icated to perpetuating self-injurious behav-
ior, friends who self-injure, and/or media role-
models who self-injure or have self-injured.
Emotional capacity. Evaluating the emotional
capacity of the individual using informal
ass essment techniques is an essential process
in developing effective treatment interven-
tions and conceptualizing the issues related to
the self-injurious behaviors. Examining an indi-
vidual’s ability to outwardly express and
understand his or her feelings involves an
ongoing process of assessment, evaluation,
and treatment with clients who self-injure.
One’s ability to express emotions is a concern
for many but particularly those who self-injure.
Since this is the case, it may be important to
ask clients, “If your wounds could speak,
what would they say about you?” (Levenkron,
1998). Additionally, basic questions that assess
one’s feelings voc abulary can also be benefi-
cial in the informal assessment process.
Coping strategies. In addition to assessing
the emotional capacity of clients who self-injure,
coping strategies can also be assessed by using
informal assessment techniques and can be
incorporated in any treatment approach for
those who self-injure. For example, it may be
important to ask clients, “What do you do
when you feel angry, anxious, or upset?” or
“What function does self-injury serve for you?”
These two questions allow the counselor to
examine how and to what extent that self-injury
serves as a maladaptive coping strategy for
clients presenting with self-injurious behaviors.
Typically, the use of self-injury is seen as an
effective method for dealing with overwhelm-
ing emotions associated with traumatic memories
or other issues occurring in the client’s life
(Gratz, 2007). Therefore, it is necessary to
determine how invested the client is in the
counseling process and how interested he or
she is in working toward a change with regard
to this pattern of behavior. Clients may be
12 Measurement and Evaluation in Counseling and Development 43(1)
fearful that any attempt to alter their current
way of coping could result in an increased
level of instability that would result in hospi-
talization or worse. Evaluating the fear and
anxiety clients may be associating with change
could be critical in determining an effective
treatment approach. Determining a client’s
concerns, commitment, and understanding with
regard to the counseling process is an integral
component of any assessment process and is
particularly crucial with regard to the issue of
self-injury.
Synthesis of Approaches
This article serves to illuminate the benefits of
both a formal and informal approach to assess-
ing self-injury. Although each approach is
important, the integration of both approaches is
vital (see Figure 1). In the comprehensive
two-tiered model of assessment, the formal ass-
essments serve as the first step in evaluating
self-injury; formal assessments provide coun-
selors with a standardized and quantifiable
way of determining the seriousness of the
problem and can also reflect progress or regres-
sion in treatment. The informal assessments,
as described above, serve to support, enhance,
and depict a comprehensive view of self-
injury. In addition to using the perspectives of
others, the informal assessment also widens
the lens in which self-injury has been examined
in the past. Although the formal assessments
focus on the behavior of self-injury, the infor-
mal assessments exa mine context, background,
and emotional cap acities. Thus, although both
approaches are important, counselors will ben-
efit from using them in tandem when assessing
self-injury to focus treatment and hopefully
improve short- and long-term outcomes.
Counselor Implications
Counselors will inevitability encounter individ-
uals who self-injure, creating instances whereby
they may have a responsibility to properly
assess and evaluate self-injury in their clients.
Alth ough the assessment of self-injury is
clearly in the early stages, further research on
new and established assessment tools is
needed. Conceptualization of self-injurious
behaviors is multidimensional; therefore,
assessment of these behaviors needs to be
complementary. For mental health profession-
als, to accurately assess focusing on frequency,
severity (tissue damage and intention), dura-
tion, type, thoughts and attitudes, and age of
onset is essential in treatment. Professionals
must also be aware of culture when assessing
those who self-injury. Cultural considerations
would include, but not be limited to, family
experiences, religion, ethnicity, and gender.
Additionally, qualitative research methods
that examine counselors’ and client’s percep-
tions about self-injury assessment tools as well
as their perceived usefulness could be helpful.
In addition, cultural considerations need to
be included in current research. Cultural dimen-
sions may contribute to the variability of
acc urately assessing those who self-injure,
which would eventually affect treatment. In
addition to research, counselors must begin to
expand their knowledge base on the topic of
assessment and self-injury. Because the defi-
nition of self-injury continues to be debated,
which affects the consistency of assessment,
further research is needed in this area.
Trainings that increase awareness about
self-injury assessment scales are imperative.
Because suicide is often discussed in counselor
education programs, incorporating self-inju-
rious behavior into the curriculum could be a
way to dialogue about this topic. By encom-
passing self-injurious behavior into counseling
programs, students will be exposed to charac-
teristics and features of this behavior that are
vital to assessment and intervention. In addi-
tion, training may also be in the form of
community-wide or in-service trainings that
focus on assessment. Training and practice
must comprise numerous difficulties in assess-
ment of self-injury, such as various nomenclature,
conflicting theoretical definitions, and incon-
sistencies with other disorders. In addition,
training must inc lude the comprehensive
ass essment approach, which includes formal
and informal assessment measures. On a broader
level, the topic of self-injury and assessment
Craigen et al. 13
should be presented at local, regional, and
national counseling conferences.
Given the review of the current self-injury
assessments, there are notable limitations and
weaknesses within these scales. For example,
all of the reviewed inventories were either
developed in conjunction with a diagnosis of
BPD or they assessed a component of suicidal
ideation. Furthermore, the assessments reviewed
failed to consider cultural context and were
normed on homogeneous samples, ignoring
diverse populations. Thus, to accurately assess
self-injury, it is imperative for counselors
and researchers to develop a scale that (a) is
nor med on a heterogeneous sample, (b) is inde-
pendent from the criteria of BPD, and (c)
evaluates self-injury without the inclusion of
suicidal ideations. The development of a scale
like this would benefit clinicians and clients
and would contribute greatly to the accurate
assessment of self-injury.
Summary
The topic of assessment and self-injury is
quickly beginning to gain attention among
mental health professionals and researchers.
Although there are several assessment tools
available to counselors, many have method-
ological flaws (e.g., low reliability and validity
and lack of factor analytic procedures) and are
used solely for a distinct population of indi-
viduals who self-injure. Prior to selecting a
formal self-injury assessment, it is important
to examine the strength of the assessments as
well as the population being served. Addi-
tionally, it is important never to use one
instrument in isolation. Combining additional
formal assessments and using many informal
assessment methods throughout the counsel-
ing relationship is imperative. Future research
and training on the topic of self-injury is clearly
needed.
Declaration of Conflicting Interests
The authors declared no potential conflicts of inter-
ests with respect to the authorship and/or
publication of this article.
Financial Disclosure/Funding
The authors disclosed receipt of the following
financial support for the research and/or authorship
of this article: Institute for the Study of Disadvan-
tage and Disability awarded a student research
honorarium to the second author.
References
Alexander, L. (1999). The functions of self-injury
and its link to traumatic events in college students.
UMI Dissertation Services (UMI No. 9932285).
Briere, J., & Gil, E. (1998). Self-mutilation in clini-
cal and general population samples: Prevalence,
correlates, and functions. American Journal of
Orthopsychiatry, 68(4), 609–620.
Brown, M. Z., Comtois, K. A., & Linehan, M. M.
(2002). Reasons for suicide attempts and non-
suicidal self-injury in women with borderline
personality disorder. Journal of Abnormal Psy-
chology, 111, 198–202.
Conaghan, S., & Davidson, K. M. (2002). Hope-
lessness and the anticipation of positive and
negative future experiences in older parasui-
cidal adults. The British Journal of Clinical
Psychology/The British Psychological Society,
41(3), 233–242.
Craigen, L., & Foster, V. (2009). A qualitative
investigation of the counseling experiences of
adolescent women with a history of self-injury.
Journal of Mental Health Counseling, 31(1),
76–94.
Favazza, A. R. (1996). Bodies under siege: Self-
mutilation and body modification in culture
and psychiatry (2nd ed.). Baltimore: The Johns
Hopkins University Press.
Fliege, H., Kocaleventa, R. D., Waltera, O. B.,
Becka, S., Gratz, K. L., Gutierrez, P. M., et al.
(2006). Three assessment tools for deliberate
self-harm and suicide behavior: Evaluation and
psychopathological correlates. Journal of Psy-
chosomatic Research, 61, 113–121.
Gratz, K. L. (2001). Measurement of deliberate self-
harm: Preliminary data on the deliberate self-
harm inventory. Journal of Psychopathology
and Behavioral Assessment, 23(4), 253–263.
Gratz, K. L. (2006). Risk factors for deliberate
self-harm among female college students: The
14 Measurement and Evaluation in Counseling and Development 43(1)
role and interaction of childhood maltreatment,
emotional inexpressivity, and affect intensity/
reactivity. American Journal of Orthopsychia-
try, 76(2), 238–250.
Gratz, K. L. (2007). Targeting emotion dysregula-
tion in the treatment of self-injury. Journal of
Clinical Psychology, 63(11), 1091–1103.
Gratz, K. L., & Chapman, A. L. (2007). The role of
emotional responding and childhood maltreat-
ment in the development and maintenance of
deliberate self-harm among male undergradu-
ates. Psychology of Men and Masculinity, 8(1),
1–14.
Gratz, K. L., Conrad, S. D., & Roemer, L. (2002).
Risk factors for deliberate self-harm among col-
lege students. American Journal of Orthopsy-
chiatry, 72(1), 128–140.
Greenwald, A. G., McGhee, D. E., & Schwartz,
J. L. K. (1998). Measuring individual differ-
ences in implicit cognition: The implicit asso-
ciation task. Journal of Personality and Social
Psychology, 74, 1464–1480.
Herpertz, S., Sass, H., & Favazza, A. (1997).
Impulsivity in self-mutilative behavior: Psy-
chometric and biological findings. Journal of
Psychiatric Research, 31(4), 451–465.
Iwata, B. A., Pace, G. M., & Kissel, R. C. (1990).
The self-injury trauma (SIT) scale: A method for
quantifying surface tissue damage caused by
self-injurious behavior. Journal of Applied
Behavior Analysis, 23(1), 99–110.
Klonsky, E. D., & Olino, T. M. (2008). Identify-
ing clinically distinct subgroups of self-injurers
among young adults: A latent class analysis.
Journal of Consulting and Clinical Psychology,
76(1), 22–27.
Koons, C. R., Robins, C. J., Tweed, J. L., Lynch,
T. R., Gonzalez, A. M., Morse, J. Q., et al.
(2001). Efficacy of dialectical behavior therapy
in women veterans with borderline personality
disorder. Behavior Therapy, 32, 371–390.
Levenkron, S. (1998). Understanding and overcom-
ing self-mutilation. New York: W.W. Norton.
Linehan, M. M., Comtois, K. A., Brown, Z. M.,
Heard, H. L., & Wagner, A. (2006). Suicide
attempt self-injury interview (SASSI): Develop-
ment, reliability, and validity of a scale to assess
suicide attempts and intentional self-injury. Psy-
chological Assessment, 18(3), 303–312.
Lundh, L. G., Karim, J., & Quilisch, E. V. A. (2007).
Deliberate self-harm in 15-year-old adolescents:
A pilot study with a modified version of the
Deliberate Self-Harm Inventory. Scandinavian
Journal of Psychology, 48, 33–41.
McAllister, M. (2003). Multiple meanings of self-
harm: A critical review. Intentional Journal of
Mental Health Nursing, 12, 175–185.
McDonough, M., Hillery, J., & Kennedy, N. (2000,
December). Olanzapine for chronic, stereotypic
self-injurious behaviour: A pilot study in seven
adults with intellectual disability. Journal of
Intellectual Disability, 44(6), 677–684.
Muehlenkamp, J. J., & Gutierrez, P. M. (2004).
An investigation of differences between self-
injurious behavior and suicide attempts in a
sample of adolescents. Suicide & Life-Threat-
ening Behavior, 34(1), 12–23.
Neukrug, E., & Fawcett, C. (2005). Essentials of
testing and assessment: A practical guide for
counselors, social workers, and psychologists.
Belmont, CA: Thomson Brooks/Cole.
Nock, M. K., & Banjai, M. R. (2007). Prediction
of suicide ideation and attempts among ado-
lescents using a brief performance-based test.
Journal of Consulting and Clinical Psychology,
75(5), 707–715.
Nock, M. K., Holmberg, E. B., Photos, V. I., &
Michel, B. D. (2007). Self-injurious thoughts
and behaviors interview: Development, reliabil-
ity and validity in an adolescent sample. Psy-
chological Assessment, 19(3), 309–317.
Nock, M. K., & Prinstein, M. J. (2005). Contex-
tual features and behavioral functions of self-
mutilation among adolescents. Journal of Abnor-
mal Psychology, 114, 140–146.
Ross, S., & Heath, N. L. (2002). A study of the
frequency of self-mutilation in a community
sample of adolescents. Journal of Youth and
Adolescence, 31, 67–77.
Sansone, R. A., Chu, J., & Wiederman, M. (2007).
Self-inflicted bodily harm among victims of
intimate-partner violence. Clinical Psychology
& Psychotherapy, 14(5), 352–357.
Sansone, R. A., & Levitt, J. L. (2002). Self-harm
behaviors among those with eating disorders:
An overview. Eating Disorders, 10(3), 205–213.
Sansone, R. A., Songer, D. A., Douglas, A., &
Sellbom, M. (2006). The relationship between
Craigen et al. 15
suicide attempts and low-lethal self-harm behav-
ior among psychiatric inpatients. Journal of
Psychiatric Practice, 12(3), 148–152.
Sansone, R. A., Whitecare, P., Meier, B. P., &
Murry, A. (2001). The prevalence of borderline
personality among primary care patients with
chronic pain. General Hospital Psychiatry, 23(4),
193–197.
Sansone, R. A., Wiederman, M. W., & Sansone, L. A.
(1998). The self-harm inventory (SHI): Devel-
opment of a scale for identifying self-destructive
behaviors and borderline personality disorder. Jour-
nal of Clinical Psychology, 54(7), 973–983.
Santa Mina, E. E., Gallop, R., & Links, P. (2006). The
self-injury questionnaire: Evaluation of the psy-
chometric properties in a clinical population. Jour-
nal of Mental Health Nursing, 13(2), 221–227.
Selekman, M. D. (2002). Living on the razor’s
edge: Solution-oriented brief family therapy
with self-harming adolescents. New York:
Norton.
Symons, F. J., & Danov, S. E. (2005). A prospec-
tive clinical analysis of pain behavior and self-
injurious behavior. Pain, 117, 473–477.
Walsh, B. W. (2006). Treating self-injury: A practi-
cal guide. New York: Guilford.
White Kress, V. E. (2003). Self-injurious behaviors:
Assessment and diagnoses. Journal of Counsel-
ing and Development, 81, 490–496.
White Kress, V. E., Gibson, D. M., & Reynolds,
C. A. (2004). Adolescents who self-injure:
Implications and strategies for school coun-
selors. Professional School Counseling, 7(3),
195–201.
Bios
Laurie M. Craigen, PhD, LPC, is an assistant pro-
fessor in the Department of Counseling and Human
Services at Old Dominion University in Norfolk,
Virginia. She also works as a Licensed Professional
Counselor at Southside Counseling Center in Suf-
folk, VA. Laurie is actively involved in research on
mental health concerns in women, particularly with
self-injurious behavior. Additionally, she has pre-
sented at local, regional, and national conferences
on the topic of self-injury and is an Assistant Editor
of Human Service Education.
Amanda C. Healey, PhD, LPC-MHSP, NCC, is
currently a temporary fulltime counseling program
faculty member at East Tennessee State University.
She is involved in research pertaining to issues of
self injurious behaviors, professional identity
development in counseling, and burnout in mental
health and has published on these topics. Amanda
works from an Adlerian-Feminist perspective and
this is reflected in her professional and scholarly
activities.
Cynthia T. Walley, PhD, NCC, is an Assistant
Professor in the Educational Foundations and
Counseling Department at Hunter College in New
York, NY. Dr. Walley’s research interest include,
school counseling preparation, adolescent mental
health, and assessment and diagnosis.
Rebekah Byrd, MSEd, LPC, NCC, is a doctoral
candidate at Old Dominion University in Norfolk,
Virginia. She currently works as the Director of
CARE NOW, a middle school based Character
Education Program and also serves as President for
the ODU chapter of Chi Sigma Iota. Rebekah
supervises master’s counseling students and teaches
undergraduate and master’s classes. Over the last
year she has published two book chapters and two
articles; presented at the national, regional, and
state level and won a competitive research grant.
Jennifer Schuster, MEd, is a 2009 graduate of
Master’s Program in School Counseling at Old
Dominion University. Jennifer is currently work-
ing as a school counselor in Newport News,
Virginia and continues to engage in research proj-
ects at Old Dominion University.
Copyright of Measurement & Evaluation in Counseling & Development (Sage Publications Inc. ) is the
property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites or posted to a
listserv without the copyright holder’s express written permission. However, users may print, download, or
email articles for individual use.
Copyright of Measurement & Evaluation in Counseling & Development is the property of
Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted
to a listserv without the copyright holder’s express written permission. However, users may
print, download, or email articles for individual use.
Articl
e
Measurement and Evaluation in
Counseling and Developmen
t
43(1) 3 –1
5
© The Author(s) 2010
Reprints and permission: http://www.
sagepub.com/journalsPermissions.nav
DOI: 10.1177/0748175610362237
http://mec.sagepub.com
Assessment and
Self-Injury: Implications
for Counselo
r
s
Laurie M. Craigen1, Amanda C. Healey2,
Cynthia T. Walley3, Rebekah Byrd1,
and Jennifer Schuster1
Abstract
This article provides readers with an understanding of self-injury assessment. The article begins
with a critical revi
ew
of a number of self-injury assessments. The latter section of the article
introduces a comprehensive two-tiered approach to accurately assessing self-injury. Implications
for counselors related to the assessment of self-injury are also provided.
Keywords
self-injury, assessment, self-injurious behavio
r
Self-injurious behavior is an increasing issue
among adolescents and young adults. Accord-
ing to current research, self-injurious behavior
occurs in 4% to 39% of adolescents in the
general population and the numbers are pre-
dicted to rise, due to various reasons, ranging
from levels and quality of social interactions
with peers to the availability and assimilation
of coping behaviors through access to the
Internet (Briere & Gil, 1998; Favazza, 1996;
Gratz, 2001; Gratz, Conrad, & Roemer, 2002;
Muehlenkamp & Guiterrez, 2004; Nock &
Prinstein, 2005; Ross & Heath, 2002). Statis-
tics on the incidence of self-injury can be
unreliable, underestimating the true incidence
of self-injury. The reality is that many inci-
dents will be dealt with by the individual, in
private, and will never reach the attention of
medical services or mental health profession-
als (McAllister, 2003). Recently, there has
been a surge in the literature related to defin-
ing and explaining the behavior (Gratz, 2006).
Conversely, very little is known about the
assessment of self-injury, and therefore, a gap
exists between understanding the behavior and
implementing focused counseling interventions
and treatment (White Kress, 2003). The
purpose of this article is to provide readers
with knowledge about the difficulties related
to accurately evaluating self-injury and the
history of self-injury assessments, while also
introducing a comprehensive two-tiered
app roach to assessing self-injury, emphasiz-
ing a holistic perspective.
Review of Self-Injury
Assessments
The development of inventories to evaluate
self-injury began in the early 1990s and con-
tinues today. As the conceptualizations and
definitions of self-injury have evolved, so too
has the focus of the assessments tailored for
its evaluation. Although the newer scales appear
to assess the behaviors and attitudes associated
1Old Dominion University, Norfolk, Virginia, USA
2East Tennessee State University, Johnson City,
Tennessee, USA
3Hunter College, New York City, New York, USA
Corresponding Author:
Laurie M. Craigen, PhD, LPC, Old Dominion University,
110 Education Building, Norfolk, VA 23529 USA
Email: lcraigen@odu.edu
4 Measurement and Evaluation in Counseling and Development 43(1)
with self-injury, many have not been through
the rigorous testing necessary to fully evaluate
their efficacy, reliability, and validity. Thus, when
selecting and administering assessments, it is
necessary for counselors to understand the evolv-
ing nature and continuing development of the
instrument they select for evaluating self-injury.
In the following section, a brief overview of
the inventories available for assessing self-
injurious behaviors is provided (see Table 1).
Self-Injury Trauma Scale (SITS)
One of the first inventories to be developed
for the assessment of self-injurious behaviors
is the SITS created by Iwata, Pace, and Kissel
(1990). It was created to evaluate the extent of
tissue damage caused by self-injury. This inven-
tory examines categories including location,
type, number, and severity of the tissue damage
as well as a summary evaluation of severity and
current risk for continued self-injury. SITS
defines its typical use in terms of quantifying
tissue damage directly. It also permits differ-
entiation of self-injury according to topography,
location of the injury on the body, type of injury,
number of injuries, and estimates of severity
through evaluation of the injuries themselves.
Test-retest reliability was reported at r = .68
(Iwata et al., 1990). This assessment was later
used to evaluate self-injury in conjunction
with physical pain as based on the proposition
that the experience and expression of pain is
somehow different among those individuals who
self-injure, therefore leading to the acceptabil-
ity and tolerability of self-injury as a behavior
(Symons & Danov, 2005).
The SITS was later used in a study to
det ermine the effects of a psychopharmacologi-
cal treatment on those with intellectual
disabilities who engaged in self-injury. In this
study, the SITS inventory was found to be reli-
able when used in conjunction with the
Non-Communication Children’s Pain Check-
list–Revised (NCCPC-R) in recognizing and
tracking self-injury from the perspective of an
outside observer—in this case, the parent
(McDonough, Hillery, & Kennedy, 2000). No
specific data were reported related to concurrent
validity beyond the statement that “the mean
NCCPC-R score was 20.1 for time intervals
scored with self-injurious behavior (SIB) and
2.5 for time intervals scored without SIB” (p.
474) as indicated by the SITS. The initial evalu-
ation of the inventor’s efficacy and subsequent
usage found the scale to be a reliable method for
collecting data on surface tissue damage caused
by self-injury. However, the use of this scale
might not be practical for counselors but could
be useful for professionals who intervene with
the physical consequences of self-injury, such as
school nursing staff or medical professionals.
Self-Harm Inventory (SHI)
The SHI was developed by Sansone, Wiederman,
and Sansone (1998) in the context of screen-
ing for Borderline Personality Disorder (BPD).
It was the belief of the instrument developers
that BPD exists on a continuum in which self-
injury is the most severe manifestation of self-
sabotaging behaviors. With regard to the uses
of the SHI, self-harm is defined as the deliber-
ate, direct destruction of body tissue without
conscious suicidal intent but results in injury
severe enough for tissue damage to occur. The
SHI assesses frequency, severity, duration, and
type of self-injurious behavior. The SHI was
found to be highly related to the Diagnostic
Interview for Borderlines (DIB) at a correla-
tion of r = .76 and the Personality Diagnostic
Questionnaire–Revised at r = .71 with regard
to non-psychotic adults (Sansone et al., 1998).
The developers of this inventory also showed
that the SHI was able to predict the diagnosis
of BPD as based on its convergent validity. This
inventory is made up of 22 items that were
selected due to their correlation with the DIB,
and each question begins with the phrase, “Have
you ever on purpose, or intentionally . . . ,” and
respondents were asked to give a “yes” or
“no” answer (Sansone, Songer, Douglas, &
Sellbom, 2006, p. 976). The final score is a
simple summation of the items endorsed by
the client. In developing and testing the mea-
sure, it showed acceptable levels of clinical
accuracy as a measure for the diagnosis of
BPD by assessing a pattern of self-destructive
5
T
a
b
le
1
.
St
re
ng
th
s
an
d
W
ea
kn
es
se
s
o
f
C
ur
re
nt
S
ca
le
In
ve
nt
o
ri
es
A
ut
ho
r(
s)
C
re
at
e
d
R
e
l
ia
bi
l
it
y
V
al
id
it
y
U
se
/F
ac
to
rs
Pr
ed
ic
ti
ve
A
bi
lit
y
Su
ic
id
al
it
y
SI
T
S
Iw
at
a,
P
ac
e,
&
K
is
se
l
19
90
Te
st
-r
et
es
t
A
ss
es
si
ng
t
is
su
e
da
m
ag
e
as
r
es
ul
t
o
f
se
l
f-
in
ju
ry
A
bl
e
to
p
re
di
ct
c
ur
re
nt
r
is
k
N
o
t
ev
al
ua
te
d
S
H
I
Sa
ns
o
ne
,
W
ie
de
rm
an
, &
Sa
ns
o
ne
19
98
Pr
ed
ic
ti
ve
co
nv
er
ge
nt
Id
en
ti
fy
in
g
se
lf-
in
ju
ry
in
co
nj
un
ct
io
n
w
it
h
B
PD
Pr
ed
ic
t
pr
es
en
ce
o
f
b
o
rd
er
lin
e
pe
rs
o
na
lit
y
fe
at
ur
es
C
an
d
iff
er
en
ti
at
e
be
tw
ee
n
hi
gh
a
nd
lo
w
le
th
al
it
y
SI
Q
A
le
xa
nd
er
19
99
In
te
rn
al
co
ns
is
te
nc
y;
te
st
-r
et
es
t
Fa
ce
a
nd
co
nv
er
ge
nt
di
ve
rg
en
t
U
se
w
it
h
th
o
se
w
ho
ha
ve
s
uf
fe
re
d
tr
au
m
a
M
ea
su
re
s
in
te
nt
t
o
s
el
f-
ha
rm
M
ea
su
re
s
fo
r
m
aj
o
r
su
ic
id
e
co
nc
ep
ts
D
SH
I
G
ra
tz
20
01
Te
st
-r
et
es
t
In
te
rn
al
co
ns
is
te
nc
y
co
ns
tr
uc
t
co
nv
er
ge
nt
a
nd
di
sc
ri
m
in
at
e
B
eh
av
io
ra
lly
b
as
ed
;
cl
in
ic
al
p
o
pu
la
ti
o
ns
A
bl
e
to
p
re
di
ct
t
he
fe
at
ur
es
o
f
se
lf-
in
ju
ri
o
us
b
eh
av
io
rs
Su
ic
id
al
in
te
nt
as
se
ss
ed
SI
-I
A
T
N
o
ck
&
B
an
ja
i
20
07
Pr
ed
ic
ti
ve
A
ss
es
si
ng
b
el
ie
fs
a
nd
id
en
ti
fic
at
io
n
w
it
h
se
lf-
in
ju
ry
Pr
ed
ic
t
su
ic
id
al
id
ea
ti
o
n
an
d
be
ha
vi
o
rs
Ev
al
ua
te
d
an
d
di
ffe
re
nt
ia
te
d
SA
SI
I
Li
ne
ha
n,
C
o
m
to
is
,
B
ro
w
n,
H
ea
rd
, &
W
ag
ne
r
20
07
In
te
rr
at
er
Pr
ed
ic
ti
ve
co
nt
en
t
Pr
o
vi
de
d
es
cr
ip
ti
ve
in
fo
o
n
su
ic
id
al
a
nd
s
el
f-
in
ju
ri
o
us
b
eh
av
io
rs
Ev
al
ua
te
s
pa
st
b
eh
av
io
r;
b
as
ed
o
n
PH
I
Su
ic
id
al
in
te
nt
a
nd
le
th
al
it
y
o
f
se
lf-
in
ju
ri
o
us
b
eh
av
io
rs
SI
T
B
I
N
o
ck
, H
o
lm
be
rg
,
Ph
o
to
s,
&
M
ic
he
l
20
07
In
te
r-
ra
te
r
te
st
-r
et
es
t
C
o
ns
tr
uc
t
To
a
ss
es
s
a
w
id
e
ra
ng
e
o
f
se
lf-
in
ju
ry
-r
el
at
ed
co
ns
tr
uc
ts
N
o
ne
s
ta
te
d
A
ss
es
se
d
ge
st
ur
es
,
pl
an
, i
de
at
io
ns
, a
nd
at
te
m
pt
s
SI
T
S
=
Se
lf-
In
ju
ry
T
ra
um
a
Sc
al
e;
S
H
I
=
S
el
f-
H
ar
m
In
ve
nt
o
ry
; S
IQ
=
S
el
f-
In
ju
ry
Q
ue
st
io
nn
ai
re
; D
SH
I =
D
el
ib
er
at
e
Se
lf-
H
ar
m
In
ve
nt
o
ry
; S
I-
IA
T
=
S
el
f-
In
ju
ry
Im
pl
ic
it
A
ss
o
ci
at
io
n
Te
st
;
SA
SI
I =
S
ui
ci
de
A
tt
em
pt
S
el
f-
In
ju
ry
I
nt
er
vi
ew
; S
IT
B
I
=
Se
lf-
In
ju
ri
o
us
T
ho
ug
ht
s
an
d
B
eh
av
io
rs
I
nt
er
vi
ew
; B
PD
=
B
o
rd
er
lin
e
Pe
rs
o
na
lit
y
D
is
o
rd
er
; P
H
I
=
Pa
ra
su
ic
id
e
H
is
to
ry
I
nt
er
vi
ew
6 Measurement and Evaluation in Counseling and Development 43(1)
behaviors (Sansone, Whitecare, Meier, & Murry,
2001). Additionally, the SHI has been shown to
have an acceptable level of internal consistency
with Cronbach’s α = .80 (Sansone et al., 2006).
The developers have stated that the inventory
could help clinicians identify and distinguish
high-lethality and low-lethality self-injury.
Self-Injury Questionnaire (SIQ)
The SIQ was developed by Alexander (1999)
and later evaluated by Santa Mina, Gallop,
and Links (2006). This inventory was created
to evaluate and differentiate the intentions behind
self-injurious behaviors as based on a history
of childhood physical and/or sexual abuse. The
questionnaire was developed using a guiding
definition of self-injury as simply self-destructive
behaviors without the intent to die. Preliminary
findings of the initial research study that used
the SIQ showed good face validity and ade-
quate test-retest reliability in nonclinical
populati ons. Test-rest reliability over a 2-week
period of the behavioral items ranged from
r = .29 to r = 1.0, with a total correlation of
test-retest of r = .91 (Alexander, 1999). A sep-
arate study also revealed similar results for
the SIQ in acute populations, with the addi-
tion of statistical analysis resulting in findings
of high internal consistency of the total scale
(α = .83; 95% Confidence Interval [CI]) and an
adequate Cronbach’s alpha for each subscale
(α = .72 to .77) (Santa Mina et al., 2006).
Convergent validity analyses were also con-
ducted by Santa Mina et al. (2006) between
the SIQ and the Suicide Intent Scale (SIS), the
Beck Depression Inventory II (BDI II), and the
Self-Inflicted Injury Severity Form (SIISF).
The convergent validity between the SIQ and
the scales was reported to be r = –.37 with
regard to the factor of stimulation and the SIS,
r = .23 with regard to the affect regulation
factor of the SIQ as compared to the BDI II,
and r = –.25 with regard to the dissociation
factor of the SIQ and the SIISF. The SIQ is a
30-item self-report instrument conceptualized
from developments in trauma research. This
questionnaire measures the intent of self-injury
through evaluation methods across various
subscales, including body alterations, indirect
self-injury, failure to care for oneself, and
overt self-injury. The SIQ measures the func-
tions, types, and frequency of self-injuring
behaviors in association with a trauma history.
Questions on the SIQ related to agreement to
engagement in behaviors such as tattooing
and the frequency and number of self-injurious
acts related to these behaviors. Following each
behavioral item, if agreement was stated, par-
ticipants were then asked to circle further
items related to the reason contributing to the
behavior. At the time of this publication, this
inventory was yet to be tested in a clinical
setting; therefore, its efficacy with regard to
counseling is unclear and needs to be tested
further.
Deliberate Self-Harm Inventory (DSHI)
The DSHI was developed using an integrated
definition of self-injury in order to help pro-
vide a clear foundation for the instrument, given
that previous assessments lacked consensus
in definition (Gratz, 2001). It is based on the
notion that self-harm is the deliberate, direct
destruction of body tissue without conscious
suicidal intent but results in injury severe enough
for tissue damage to occur (Fliege et al., 2006).
This measure evaluates various features of self-
injury, including frequency, severity, duration,
and types of self-injurious behaviors. The
inventory consists of 17 items that are behav-
iorally based and reliant on self-report. The
DSHI has been found to be reliable and valid
for assessing self-injury and past suicidal
beh aviors (Gratz, 2006; Gratz & Chapman,
2007; Gratz et al., 2002; Lundh, Karim, &
Quilisch, 2007), with adequate internal reliabil-
ity at α = .62 (Fliege et al., 2006) and adequate
test-retest reliability during a 2- to 4-week
period of φ= .68 (p = .001) (Gratz, 2001). In
the study by Gratz (2001), adequate construct,
convergent, and discriminant reliability was
also found. This assessment is in wide use,
and its brief length lends itself to application
in clinical and outpatient settings. This assess-
ment could be useful in mental health as well
as school settings to determine the need,
Craigen et al. 7
immediacy, and level of intervention needed
with regard to a client or student presenting
self-injurious behaviors.
Suicide Attempt Self-Injury
Interview (SASII)
The SASII was designed to evaluate factors
involved in what the authors referred to as
“nonfatal suicide attempts and intentional self-
injury” (Linehan, Comtois, Brown, Heard, &
Wagner, 2006, p. 304). This measure, once
referred to as the Parasuicide History Inven-
tory, was developed to better understand the
methods involved in self-injury—the motiva-
tions, consequences, ritual, and impulsivity of
the act itself. Its validity and reliability mea-
sures were taken using an inpatient population.
In defining suicidal behavior, this instrument
includes all general definitions pertaining to
parasuicide, fatal and nonfatal suicide, and
self-injury without the intent to die. Therefore,
it does provide descriptive details about self-
injurious and suicidal behaviors but does not
differentiate between the two beyond lethality.
This instrument has been used in several
recent studies that confirm its usability and
importance in assessing the multiple aspects
of suicidal and self-injurious behaviors
(Brown, Comtois, & Linehan, 2002; Koons
et al., 2001). Six scales were developed based
on factor analysis with factors loading at .4 or
above. These six scales evaluated lethality of
the method, suicidal and nonsuicidal intent
associated with an episode, communication of
suicide intent prior to the episode, impulsiv-
ity, physical condition, and level of medical
treatment. The assessment showed high inter-
rater reliability at r = .918 for classification of
suicidality components and r = .843 for epi-
sodes classified as a single event versus a
cluster of self-injurious events (Linehan
et al., 2006). The SASII instrument is useful
in that it provides a rating concerning the
lethality of the act in question in terms of
several com ponents including medical and
other con sequences. This instrument can also
be used to evaluate treatment outcomes
through pre- and postassessment.
Self-Injury Implicit Association
Test (SI-IAT)
The SI-IAT was developed by Nock and Banjai
(2007) to assess self-injury in terms of the
identity with and beliefs surrounding the act
itself. This test was based on the Implicit Asso-
ciation Test (IAT), developed by Greenwald,
McGhee, and Schwartz (1998). To understand
the SI-IAT, it is important to know a little bit
about the test from which it was developed.
The IAT is primarily used for evaluating asso-
ciations to nonclinical constructs and beliefs.
The IAT itself has been shown to have strong
reliability, construct validity, and the capacity
to distinguish clinical changes caused by treat-
ment and attempts to mask feelings. The SI-IAT
was created in order to integrate the advantages
of the IAT in an attempt to assess self-injury
without relying on explicit self-report. The
test measures the implicit associations indi-
viduals have concerning self-injury in terms
of identification with the behavior as well as
attitudes about it.
The research studies conducted by Nock
and Banjai (2007) using the SI-IAT showed
that the assessment was able to strongly predict
recent suicidal ideation and suicide attempts,
with good incremental predictive validity ranging
from .74 to .77 with the participating ado-
lescent population. The assessment could
also distinguish between groups of nonsuicidal
ado lescents who had negative beliefs about
self-injury, adolescents with suicidal ideations
who showed some positive identification, and
adolescents who had attempted suicide while
having strong identification with self-injurious
behaviors. Because of the interpretive nature
of this assessment, it would be important for
counselors to use this in conjunction with mul-
tiple informal assessment techniques to evaluate
the client’s perceptions with regard to his or
her statements. This would help avoid coun-
selor bias in determining the client’s level of
identification with the behaviors. This assess-
ment is also helpful in evaluating how useful the
client views his or her self-injurious behav-
iors in managing symptomology. The level at
which a client integrates self-injury into his or
8 Measurement and Evaluation in Counseling and Development 43(1)
her identity and views self-injury as assistive
to his or her functioning could drastically affect
the approach and interventions the counselor
ultimately decides to use in the process of
treatment. For example, if the client views
self-injury as an effective coping strategy to
reduce stress, the counselor and client could
explore alternative stress-reduction strategies
in counseling sessions.
Self-Injurious Thoughts and
Behaviors Interview (SITBI)
The SITBI was developed by Nock, Holmberg,
Photos, and Michel (2007) as a 169-item
str uctured interview that assesses the pres-
ence, frequency, severity, age-of-onset, and
general characteristics associated with the
thoughts and behaviors of suicidal ideations
and suicide attempts. The SITBI assumes that,
by definition, self-injury does not include the
intent to die and thus differentiates self-injury
from suicidal intent and action. In assessing the
strengths of the interview as an assessment
tool, the authors found it to have strong inter-
rater reliability (Nock et al., 2007), good
test-retest reliability (average k = .70) after 6
months, good construct validity in relation to
suicide measures and suicide attempts (k =
.65), and concurrent validity with measures of
suicidal ideations and gestures. However, it
did have weak reliability in assessing suicide
gestures and plans. Predictive validity for sui-
cidal ideation or future self-injury was not
addressed in the study conducted by Nock et
al. (2007). It is the belief of the authors that
the interview could be used easily in a variety
of clinical settings to get an overview of current
and recent self-injurious behaviors; however,
because of the length of the assessment, there
are time constraints to consider with regard to
the pra cticality of its use.
The self-injury assessment tools that have
been developed over recent years have clear
strengths and weaknesses. For counselors, it is
important to consider the population you are
using before selecting a particular self-injury
assessment tool as well as the setting in which
you will be implementing it. Also, it is critical
to realize that the aforementioned formal assess-
ments are only one piece of the assessment
process. Counselors should never use these
measures in isolation for determining the course
of treatment, outcomes, or need for intervention.
The following section outlines a recommended
approach for assessing self-injury and using
formal assessments in conjunction with addi-
tional evaluation methods.
Comprehensive Assessment
Approach
The need for a comprehensive and multilevel
approach to the assessment and evaluation of
self-injury is clear because of the multifaceted
nature of self-injury. The following section out-
lines a two-tiered process of assessing self-injury.
This process includes the use of both formal and
informal assessment procedures (see Figure 1).
Formal Assessment
The first step in this integrated approach
inv olves the formal assessment of self-injury
(as introduced above) as well as other possi-
bly related concerns, such as depression,
traumatic history, or anxiety. These mental
health concerns necessitate mentioning
because of independent empirical indications
of association with self-injurious behaviors
(Conaghan & Davidson, 2002; Herpertz, Sass,
& Favazza, 1997; Klonsky & Olino, 2008;
Sansone, Chu, & Wiederman, 2007; Sansone
& Levitt, 2002). Overall, formal assessment
measures allow for more accurate diagnoses
and appropriate evaluation and enhance the
formulation of an informed treatment plan.
Self-Injury assessment measures. Many self-
injury assessment tools are available for
con sideration during the implementation of a
formal assessment process as previously pre-
sented (see Table 1). Selecting an appropriate
tool based on population, validity, and reli-
ability is necessary in treating self-injurious
behavior.
Additional formal assessments. Self-injury
rarely occurs in isolation. As stated previously,
many mental health disorders coexist with
Craigen et al. 9
self-injury. Thus, a combination of formal
assessments is fundamental, as it is imperative
to examine the intent behind each act of self-
injury to carefully evaluate which elements of
concern or distress are present for each unique
individual. Because of the complex nature of
self-injury, the more accurate the evaluation,
the better suited and successful the treatment
will be (White Kress, 2003). Thus, it would
behoove counselors to also use standardized
assessments that evaluate areas such as (but
not limited to) suicide, trauma, depression,
anxiety, and eating disorders. The following
are examples of assessments that could address
these indicators. Although this list is not com-
prehensive, other assessments may be selected
and should be matched to the unique needs of
the client:
Self-Injury
Assessment
• Self-Injury Assessment/Inventory
• Suicidality Protocol/Inventory
• Trauma Inventory
• Beck Depression Inventory
Anxiety Scales
Tier One: Formal Assessment
Tier Two: Informal Assessment (all are ongoing):
Formal Assessment
Background
Familial History
Peer Support
Social Support
Negative/Positive
Influences
Emotional Capacity
Verbal Ability to
Express Emotions
Coping Strategies
In Combination withIn Combination with
Figure 1. Two-tier model of assessment
10 Measurement and Evaluation in Counseling and Development 43(1)
• Suicidality Protocol/Inventories: that
is, Inventory of Suicide Orientation-30,
Beck Suicide Inventory, Reasons for
Living Inventory, Hopelessness Scale,
Scale for Suicide Ideation, Suicide
Probability Scale, Suicide Ideation
Questionnaire, and Suicide Probabil-
ity Scale
• Trauma Inventories: that is, Early
Trauma Inventory, Trauma Coping
Inventory, Trauma Symptom Inven-
tory, Trauma Assessment Inventories
• Depression Inventories: that is,
Inv entory of Depressive Symtoma-
tology, BDI, Children’s Depression
Inventory, Major Depression Inven-
tory, Inventory of Depression and
Anxiety Symptoms, Zung Self-Rating
Dep ression Scale
• Anxiety Inventories: that is, Beck
Anxiety Inventory, Spielberger State-
Trait Anxiety Scales, Anxiety Status
Inventory
• Eating Disorder Inventories: that is,
Eating Disorders Inventories, Eating
Attitudes Test, Eating Disorder Exa-
mination, and additional measures
sui ted for the particular client
The aforementioned formal assessments vary
according to reliability and validity. Thus, prior
to selecting a measure, it is important to exa-
mine its strengths as well as the population
being served.
Informal Assessment
The second step in this approach involves
using informal assessment measures. Infor-
mal assessment techniques are subjective and
provide counselors with additional tools for
understanding clients (Neukrug & Fawcett,
2005). The majority of informal assessments
are used in a formative evaluative manner, rather
than through a pretreatment or posttreatment
(summative) evaluation. Informal assessment
techniques combined with formal assessments
allow the clinician to gain a comprehensive,
holistic, and in-depth understanding of the
client and his or her presenting concerns. For
example, gaining an understanding of past and
current familial and relational connections as
well as relational conflicts could lead to greater
insight into the client’s reasoning for his or
her self-injurious behaviors and the structure
of his or her current support network. With all
informal assessment techniques, it is neces-
sary to consistently be aware of cultural context
and how this could be a factor for each client.
Although many techniques can be used to con-
duct informal assessments, only those most
pertinent to the treatment of self-injurious behav-
iors are addressed in this section.
Intakes. Many informal assessment measures
exist and should be used during intake and
also throughout the treatment process for each
individual. At intake, it is important to add a
section or line dedicated to self-injury. This is
an area that is often left off of intakes and is
important in the initial assessment. For exam-
ple, “Have you ever intentionally hurt yourself
for any reason?”
Interviews. Parent and teacher interviews are
a great tool to access valuable information
about your client and his or her experiences
with self-injury. Although many individuals go
to great lengths to hide their self-injury from
parents and teachers, valuable information
can be garnered from speaking with these
individuals, as they may play an important
role in the client’s self-injury and might also
serve as an ally for the client as he or she
explores issues related to his or her behaviors
in counseling. Some questions that might
garner useful treatment information include
the following: “Is the client’s behavior consis-
tent at home and school?” “Does the client
engage in isolative behaviors?” “How does the
client normally express his or her feelings or
needs?” “What type of internalizing or exter-
nalizing behaviors are the parents or teachers
aware of in your client?”
Observations. Observations are an important
assessment tool, providing counselors with an
additional mechanism for understanding the
client (Neukrug & Fawcett, 2005). Although
not all clients who self-injure present in the
same way, there may be consistent behaviors,
Craigen et al. 11
appearances, or nuances that could provide
counselors with helpful information to sup-
plement their understanding of the client. For
example, a client who self-injures may often-
times wear clothes that hide his or her injuries
or have many unexplained cuts, scars, or burns
(White Kress, Gibson, & Reynolds, 2004).
Additionally, clients may avoid conversations
about self-injury or deny their personal expe-
riences with self-injury.
Background information. Acquiring back-
gro und information is a vital aspect of self-
injury assessment and can potentially provide
the counselor with valuable information about
the contributing factors related to the client’s
self-injurious behavior. When obtaining back-
ground information, it is necessary to focus
on all aspects of the individual and not limit
the assessment to the behavior itself. This knowl-
edge provides counselors with valuable
information about what lies beneath the sur-
face of the wounds, a focus of treatment that
has been ignored in the past (Craigen &
Foster, 2009; Walsh, 2006).
Familial history is one aspect of background
information that is often overlooked. Gather-
ing information about an individual’s family
history avoids pathologizing the behavior and
views the presenting behaviors through more
of a systemic lens. Seeking to understand all
contributing factors such as a client’s per-
spectives and experiences regarding his or her
family might not have been considered in the
past; however, it is necessary (McAllister, 2003;
Selekman, 2002). For example, the counselor
may ask, “Who do you talk to in your family
about your feelings?” “How does your family
typically deal with their emotions?” “What
feelings do you have for different members of
your family?” or “What events in your past
family history have affected you negatively?”
In addition to familial information, it is also
important to discuss with the client his or her
peer and social supports (Walsh, 2006). This
is particularly relevant in the adolescent popu-
lation because at this developmental milestone,
peer supports are highly valued. For example,
counselors may say, “Tell me about your
friends.” Or they may ask, “When you are
upset, do you typically talk with your friends?”
“Do your friends know about your self-injurious
behavior?” Other factors that affect the indivi-
dual and need to be assessed are negative
or positive influences that could facilitate
self-injury. These could include Internet sites
ded icated to perpetuating self-injurious behav-
ior, friends who self-injure, and/or media role-
models who self-injure or have self-injured.
Emotional capacity. Evaluating the emotional
capacity of the individual using informal
ass essment techniques is an essential process
in developing effective treatment interven-
tions and conceptualizing the issues related to
the self-injurious behaviors. Examining an indi-
vidual’s ability to outwardly express and
understand his or her feelings involves an
ongoing process of assessment, evaluation,
and treatment with clients who self-injure.
One’s ability to express emotions is a concern
for many but particularly those who self-injure.
Since this is the case, it may be important to
ask clients, “If your wounds could speak,
what would they say about you?” (Levenkron,
1998). Additionally, basic questions that assess
one’s feelings voc abulary can also be benefi-
cial in the informal assessment process.
Coping strategies. In addition to assessing
the emotional capacity of clients who self-injure,
coping strategies can also be assessed by using
informal assessment techniques and can be
incorporated in any treatment approach for
those who self-injure. For example, it may be
important to ask clients, “What do you do
when you feel angry, anxious, or upset?” or
“What function does self-injury serve for you?”
These two questions allow the counselor to
examine how and to what extent that self-injury
serves as a maladaptive coping strategy for
clients presenting with self-injurious behaviors.
Typically, the use of self-injury is seen as an
effective method for dealing with overwhelm-
ing emotions associated with traumatic memories
or other issues occurring in the client’s life
(Gratz, 2007). Therefore, it is necessary to
determine how invested the client is in the
counseling process and how interested he or
she is in working toward a change with regard
to this pattern of behavior. Clients may be
12 Measurement and Evaluation in Counseling and Development 43(1)
fearful that any attempt to alter their current
way of coping could result in an increased
level of instability that would result in hospi-
talization or worse. Evaluating the fear and
anxiety clients may be associating with change
could be critical in determining an effective
treatment approach. Determining a client’s
concerns, commitment, and understanding with
regard to the counseling process is an integral
component of any assessment process and is
particularly crucial with regard to the issue of
self-injury.
Synthesis of Approaches
This article serves to illuminate the benefits of
both a formal and informal approach to assess-
ing self-injury. Although each approach is
important, the integration of both approaches is
vital (see Figure 1). In the comprehensive
two-tiered model of assessment, the formal ass-
essments serve as the first step in evaluating
self-injury; formal assessments provide coun-
selors with a standardized and quantifiable
way of determining the seriousness of the
problem and can also reflect progress or regres-
sion in treatment. The informal assessments,
as described above, serve to support, enhance,
and depict a comprehensive view of self-
injury. In addition to using the perspectives of
others, the informal assessment also widens
the lens in which self-injury has been examined
in the past. Although the formal assessments
focus on the behavior of self-injury, the infor-
mal assessments exa mine context, background,
and emotional cap acities. Thus, although both
approaches are important, counselors will ben-
efit from using them in tandem when assessing
self-injury to focus treatment and hopefully
improve short- and long-term outcomes.
Counselor Implications
Counselors will inevitability encounter individ-
uals who self-injure, creating instances whereby
they may have a responsibility to properly
assess and evaluate self-injury in their clients.
Alth ough the assessment of self-injury is
clearly in the early stages, further research on
new and established assessment tools is
needed. Conceptualization of self-injurious
behaviors is multidimensional; therefore,
assessment of these behaviors needs to be
complementary. For mental health profession-
als, to accurately assess focusing on frequency,
severity (tissue damage and intention), dura-
tion, type, thoughts and attitudes, and age of
onset is essential in treatment. Professionals
must also be aware of culture when assessing
those who self-injury. Cultural considerations
would include, but not be limited to, family
experiences, religion, ethnicity, and gender.
Additionally, qualitative research methods
that examine counselors’ and client’s percep-
tions about self-injury assessment tools as well
as their perceived usefulness could be helpful.
In addition, cultural considerations need to
be included in current research. Cultural dimen-
sions may contribute to the variability of
acc urately assessing those who self-injure,
which would eventually affect treatment. In
addition to research, counselors must begin to
expand their knowledge base on the topic of
assessment and self-injury. Because the defi-
nition of self-injury continues to be debated,
which affects the consistency of assessment,
further research is needed in this area.
Trainings that increase awareness about
self-injury assessment scales are imperative.
Because suicide is often discussed in counselor
education programs, incorporating self-inju-
rious behavior into the curriculum could be a
way to dialogue about this topic. By encom-
passing self-injurious behavior into counseling
programs, students will be exposed to charac-
teristics and features of this behavior that are
vital to assessment and intervention. In addi-
tion, training may also be in the form of
community-wide or in-service trainings that
focus on assessment. Training and practice
must comprise numerous difficulties in assess-
ment of self-injury, such as various nomenclature,
conflicting theoretical definitions, and incon-
sistencies with other disorders. In addition,
training must inc lude the comprehensive
ass essment approach, which includes formal
and informal assessment measures. On a broader
level, the topic of self-injury and assessment
Craigen et al. 13
should be presented at local, regional, and
national counseling conferences.
Given the review of the current self-injury
assessments, there are notable limitations and
weaknesses within these scales. For example,
all of the reviewed inventories were either
developed in conjunction with a diagnosis of
BPD or they assessed a component of suicidal
ideation. Furthermore, the assessments reviewed
failed to consider cultural context and were
normed on homogeneous samples, ignoring
diverse populations. Thus, to accurately assess
self-injury, it is imperative for counselors
and researchers to develop a scale that (a) is
nor med on a heterogeneous sample, (b) is inde-
pendent from the criteria of BPD, and (c)
evaluates self-injury without the inclusion of
suicidal ideations. The development of a scale
like this would benefit clinicians and clients
and would contribute greatly to the accurate
assessment of self-injury.
Summary
The topic of assessment and self-injury is
quickly beginning to gain attention among
mental health professionals and researchers.
Although there are several assessment tools
available to counselors, many have method-
ological flaws (e.g., low reliability and validity
and lack of factor analytic procedures) and are
used solely for a distinct population of indi-
viduals who self-injure. Prior to selecting a
formal self-injury assessment, it is important
to examine the strength of the assessments as
well as the population being served. Addi-
tionally, it is important never to use one
instrument in isolation. Combining additional
formal assessments and using many informal
assessment methods throughout the counsel-
ing relationship is imperative. Future research
and training on the topic of self-injury is clearly
needed.
Declaration of Conflicting Interests
The authors declared no potential conflicts of inter-
ests with respect to the authorship and/or
publication of this article.
Financial Disclosure/Funding
The authors disclosed receipt of the following
financial support for the research and/or authorship
of this article: Institute for the Study of Disadvan-
tage and Disability awarded a student research
honorarium to the second author.
References
Alexander, L. (1999). The functions of self-injury
and its link to traumatic events in college students.
UMI Dissertation Services (UMI No. 9932285).
Briere, J., & Gil, E. (1998). Self-mutilation in clini-
cal and general population samples: Prevalence,
correlates, and functions. American Journal of
Orthopsychiatry, 68(4), 609–620.
Brown, M. Z., Comtois, K. A., & Linehan, M. M.
(2002). Reasons for suicide attempts and non-
suicidal self-injury in women with borderline
personality disorder. Journal of Abnormal Psy-
chology, 111, 198–202.
Conaghan, S., & Davidson, K. M. (2002). Hope-
lessness and the anticipation of positive and
negative future experiences in older parasui-
cidal adults. The British Journal of Clinical
Psychology/The British Psychological Society,
41(3), 233–242.
Craigen, L., & Foster, V. (2009). A qualitative
investigation of the counseling experiences of
adolescent women with a history of self-injury.
Journal of Mental Health Counseling, 31(1),
76–94.
Favazza, A. R. (1996). Bodies under siege: Self-
mutilation and body modification in culture
and psychiatry (2nd ed.). Baltimore: The Johns
Hopkins University Press.
Fliege, H., Kocaleventa, R. D., Waltera, O. B.,
Becka, S., Gratz, K. L., Gutierrez, P. M., et al.
(2006). Three assessment tools for deliberate
self-harm and suicide behavior: Evaluation and
psychopathological correlates. Journal of Psy-
chosomatic Research, 61, 113–121.
Gratz, K. L. (2001). Measurement of deliberate self-
harm: Preliminary data on the deliberate self-
harm inventory. Journal of Psychopathology
and Behavioral Assessment, 23(4), 253–263.
Gratz, K. L. (2006). Risk factors for deliberate
self-harm among female college students: The
14 Measurement and Evaluation in Counseling and Development 43(1)
role and interaction of childhood maltreatment,
emotional inexpressivity, and affect intensity/
reactivity. American Journal of Orthopsychia-
try, 76(2), 238–250.
Gratz, K. L. (2007). Targeting emotion dysregula-
tion in the treatment of self-injury. Journal of
Clinical Psychology, 63(11), 1091–1103.
Gratz, K. L., & Chapman, A. L. (2007). The role of
emotional responding and childhood maltreat-
ment in the development and maintenance of
deliberate self-harm among male undergradu-
ates. Psychology of Men and Masculinity, 8(1),
1–14.
Gratz, K. L., Conrad, S. D., & Roemer, L. (2002).
Risk factors for deliberate self-harm among col-
lege students. American Journal of Orthopsy-
chiatry, 72(1), 128–140.
Greenwald, A. G., McGhee, D. E., & Schwartz,
J. L. K. (1998). Measuring individual differ-
ences in implicit cognition: The implicit asso-
ciation task. Journal of Personality and Social
Psychology, 74, 1464–1480.
Herpertz, S., Sass, H., & Favazza, A. (1997).
Impulsivity in self-mutilative behavior: Psy-
chometric and biological findings. Journal of
Psychiatric Research, 31(4), 451–465.
Iwata, B. A., Pace, G. M., & Kissel, R. C. (1990).
The self-injury trauma (SIT) scale: A method for
quantifying surface tissue damage caused by
self-injurious behavior. Journal of Applied
Behavior Analysis, 23(1), 99–110.
Klonsky, E. D., & Olino, T. M. (2008). Identify-
ing clinically distinct subgroups of self-injurers
among young adults: A latent class analysis.
Journal of Consulting and Clinical Psychology,
76(1), 22–27.
Koons, C. R., Robins, C. J., Tweed, J. L., Lynch,
T. R., Gonzalez, A. M., Morse, J. Q., et al.
(2001). Efficacy of dialectical behavior therapy
in women veterans with borderline personality
disorder. Behavior Therapy, 32, 371–390.
Levenkron, S. (1998). Understanding and overcom-
ing self-mutilation. New York: W.W. Norton.
Linehan, M. M., Comtois, K. A., Brown, Z. M.,
Heard, H. L., & Wagner, A. (2006). Suicide
attempt self-injury interview (SASSI): Develop-
ment, reliability, and validity of a scale to assess
suicide attempts and intentional self-injury. Psy-
chological Assessment, 18(3), 303–312.
Lundh, L. G., Karim, J., & Quilisch, E. V. A. (2007).
Deliberate self-harm in 15-year-old adolescents:
A pilot study with a modified version of the
Deliberate Self-Harm Inventory. Scandinavian
Journal of Psychology, 48, 33–41.
McAllister, M. (2003). Multiple meanings of self-
harm: A critical review. Intentional Journal of
Mental Health Nursing, 12, 175–185.
McDonough, M., Hillery, J., & Kennedy, N. (2000,
December). Olanzapine for chronic, stereotypic
self-injurious behaviour: A pilot study in seven
adults with intellectual disability. Journal of
Intellectual Disability, 44(6), 677–684.
Muehlenkamp, J. J., & Gutierrez, P. M. (2004).
An investigation of differences between self-
injurious behavior and suicide attempts in a
sample of adolescents. Suicide & Life-Threat-
ening Behavior, 34(1), 12–23.
Neukrug, E., & Fawcett, C. (2005). Essentials of
testing and assessment: A practical guide for
counselors, social workers, and psychologists.
Belmont, CA: Thomson Brooks/Cole.
Nock, M. K., & Banjai, M. R. (2007). Prediction
of suicide ideation and attempts among ado-
lescents using a brief performance-based test.
Journal of Consulting and Clinical Psychology,
75(5), 707–715.
Nock, M. K., Holmberg, E. B., Photos, V. I., &
Michel, B. D. (2007). Self-injurious thoughts
and behaviors interview: Development, reliabil-
ity and validity in an adolescent sample. Psy-
chological Assessment, 19(3), 309–317.
Nock, M. K., & Prinstein, M. J. (2005). Contex-
tual features and behavioral functions of self-
mutilation among adolescents. Journal of Abnor-
mal Psychology, 114, 140–146.
Ross, S., & Heath, N. L. (2002). A study of the
frequency of self-mutilation in a community
sample of adolescents. Journal of Youth and
Adolescence, 31, 67–77.
Sansone, R. A., Chu, J., & Wiederman, M. (2007).
Self-inflicted bodily harm among victims of
intimate-partner violence. Clinical Psychology
& Psychotherapy, 14(5), 352–357.
Sansone, R. A., & Levitt, J. L. (2002). Self-harm
behaviors among those with eating disorders:
An overview. Eating Disorders, 10(3), 205–213.
Sansone, R. A., Songer, D. A., Douglas, A., &
Sellbom, M. (2006). The relationship between
Craigen et al. 15
suicide attempts and low-lethal self-harm behav-
ior among psychiatric inpatients. Journal of
Psychiatric Practice, 12(3), 148–152.
Sansone, R. A., Whitecare, P., Meier, B. P., &
Murry, A. (2001). The prevalence of borderline
personality among primary care patients with
chronic pain. General Hospital Psychiatry, 23(4),
193–197.
Sansone, R. A., Wiederman, M. W., & Sansone, L. A.
(1998). The self-harm inventory (SHI): Devel-
opment of a scale for identifying self-destructive
behaviors and borderline personality disorder. Jour-
nal of Clinical Psychology, 54(7), 973–983.
Santa Mina, E. E., Gallop, R., & Links, P. (2006). The
self-injury questionnaire: Evaluation of the psy-
chometric properties in a clinical population. Jour-
nal of Mental Health Nursing, 13(2), 221–227.
Selekman, M. D. (2002). Living on the razor’s
edge: Solution-oriented brief family therapy
with self-harming adolescents. New York:
Norton.
Symons, F. J., & Danov, S. E. (2005). A prospec-
tive clinical analysis of pain behavior and self-
injurious behavior. Pain, 117, 473–477.
Walsh, B. W. (2006). Treating self-injury: A practi-
cal guide. New York: Guilford.
White Kress, V. E. (2003). Self-injurious behaviors:
Assessment and diagnoses. Journal of Counsel-
ing and Development, 81, 490–496.
White Kress, V. E., Gibson, D. M., & Reynolds,
C. A. (2004). Adolescents who self-injure:
Implications and strategies for school coun-
selors. Professional School Counseling, 7(3),
195–201.
Bios
Laurie M. Craigen, PhD, LPC, is an assistant pro-
fessor in the Department of Counseling and Human
Services at Old Dominion University in Norfolk,
Virginia. She also works as a Licensed Professional
Counselor at Southside Counseling Center in Suf-
folk, VA. Laurie is actively involved in research on
mental health concerns in women, particularly with
self-injurious behavior. Additionally, she has pre-
sented at local, regional, and national conferences
on the topic of self-injury and is an Assistant Editor
of Human Service Education.
Amanda C. Healey, PhD, LPC-MHSP, NCC, is
currently a temporary fulltime counseling program
faculty member at East Tennessee State University.
She is involved in research pertaining to issues of
self injurious behaviors, professional identity
development in counseling, and burnout in mental
health and has published on these topics. Amanda
works from an Adlerian-Feminist perspective and
this is reflected in her professional and scholarly
activities.
Cynthia T. Walley, PhD, NCC, is an Assistant
Professor in the Educational Foundations and
Counseling Department at Hunter College in New
York, NY. Dr. Walley’s research interest include,
school counseling preparation, adolescent mental
health, and assessment and diagnosis.
Rebekah Byrd, MSEd, LPC, NCC, is a doctoral
candidate at Old Dominion University in Norfolk,
Virginia. She currently works as the Director of
CARE NOW, a middle school based Character
Education Program and also serves as President for
the ODU chapter of Chi Sigma Iota. Rebekah
supervises master’s counseling students and teaches
undergraduate and master’s classes. Over the last
year she has published two book chapters and two
articles; presented at the national, regional, and
state level and won a competitive research grant.
Jennifer Schuster, MEd, is a 2009 graduate of
Master’s Program in School Counseling at Old
Dominion University. Jennifer is currently work-
ing as a school counselor in Newport News,
Virginia and continues to engage in research proj-
ects at Old Dominion University.
Copyright of Measurement & Evaluation in Counseling & Development (Sage Publications Inc. ) is the
property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites or posted to a
listserv without the copyright holder’s express written permission. However, users may print, download, or
email articles for individual use.
Copyright of Measurement & Evaluation in Counseling & Development is the property of
Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted
to a listserv without the copyright holder’s express written permission. However, users may
print, download, or email articles for individual use.
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
Copyright © 2000 All Rights Reserved
We provide professional writing services to help you score straight A’s by submitting custom written assignments that mirror your guidelines.
Get result-oriented writing and never worry about grades anymore. We follow the highest quality standards to make sure that you get perfect assignments.
Our writers have experience in dealing with papers of every educational level. You can surely rely on the expertise of our qualified professionals.
Your deadline is our threshold for success and we take it very seriously. We make sure you receive your papers before your predefined time.
Someone from our customer support team is always here to respond to your questions. So, hit us up if you have got any ambiguity or concern.
Sit back and relax while we help you out with writing your papers. We have an ultimate policy for keeping your personal and order-related details a secret.
We assure you that your document will be thoroughly checked for plagiarism and grammatical errors as we use highly authentic and licit sources.
Still reluctant about placing an order? Our 100% Moneyback Guarantee backs you up on rare occasions where you aren’t satisfied with the writing.
You don’t have to wait for an update for hours; you can track the progress of your order any time you want. We share the status after each step.
Although you can leverage our expertise for any writing task, we have a knack for creating flawless papers for the following document types.
Although you can leverage our expertise for any writing task, we have a knack for creating flawless papers for the following document types.
From brainstorming your paper's outline to perfecting its grammar, we perform every step carefully to make your paper worthy of A grade.
Hire your preferred writer anytime. Simply specify if you want your preferred expert to write your paper and we’ll make that happen.
Get an elaborate and authentic grammar check report with your work to have the grammar goodness sealed in your document.
You can purchase this feature if you want our writers to sum up your paper in the form of a concise and well-articulated summary.
You don’t have to worry about plagiarism anymore. Get a plagiarism report to certify the uniqueness of your work.
Join us for the best experience while seeking writing assistance in your college life. A good grade is all you need to boost up your academic excellence and we are all about it.
We create perfect papers according to the guidelines.
We seamlessly edit out errors from your papers.
We thoroughly read your final draft to identify errors.
Work with ultimate peace of mind because we ensure that your academic work is our responsibility and your grades are a top concern for us!
Dedication. Quality. Commitment. Punctuality
Here is what we have achieved so far. These numbers are evidence that we go the extra mile to make your college journey successful.
We have the most intuitive and minimalistic process so that you can easily place an order. Just follow a few steps to unlock success.
We understand your guidelines first before delivering any writing service. You can discuss your writing needs and we will have them evaluated by our dedicated team.
We write your papers in a standardized way. We complete your work in such a way that it turns out to be a perfect description of your guidelines.
We promise you excellent grades and academic excellence that you always longed for. Our writers stay in touch with you via email.