Publications

The science behind Outcome Referrals’ services started more than twenty years ago.

Diagnostics

The following diagnostic publications illustrate the TOP’s outstanding factor structure and sensitivity to change..

Best Outcomes

Most clinicians see patients with whom they are effective as well as patients with whom they are reliably ineffective or even harmful. It is only when we better assess and match a patient’s problems (e.g., Major Depression) with a clinician who is reliably effective in treating that problem that we can double the chances of successful treatment and bring down total healthcare costs.

Provider Friendly

Built by and for providers, TOP and its reporting and quality improvement roadmaps help providers document and improve the quality of care.

Outcome Referrals celebrates the unique strengths of each clinician. 96% of clinicians document at least one area of expertise and more than 50% have five or more areas of documented expertise.

Co-Morbidity

According to Robert Wood Johnson, 8% of the population has both chronic medical and psychiatric problems. This population is consuming 54% of healthcare dollars in the US. When these patients’ problems are successfully addressed, their total cost of care is reduced by an average of 20%.

Child Welfare

Complete Publication List

Adelman, R.(2006). The Angry Adolescent & Constructivist REBT. In Cummins, P.(Ed.),Working with Anger: A Practical Constructivist Approach, London: John Wiley& Sons.

Adelman, R.(2008). Methods of Reconstruction with Adolescent Substance Abusers: Combining REBT and Constructivism. In Raskin, J.D. & Bridges, S. (Ed.), Studies in Meaning 3: Constructivist Psychotherapy in the Real World, New York: Pace University Press.

Adelman, R. et. al, (2005). Reducing adolescent clients’ anger in a residential substance abuse treatment facility. Journal on Quality and Patient Safety, 31, (6), 325-327.

Adelman. R. (2007). Reducing Anger in Adolescents: An REBT Approach, Center City, Minnesota: Hazelden Press.

Adelman, R.W., Castonguay, L. G., Kraus, D. R., & Zack, S. E. (2015). Conducting research and collaborating with researchers: The experience of clinicians in a residential treatment center. Psychotherapy Research, 25(1), 108-120. https://dx.doi.org/101080/10503307.2014.935520

Angtuaco, L.A., Castonguay, L.G., & Kraus, D. R. (2005). The TOP: A core battery for the assessment of psychotherapy outcome. Paper presented at the Annual Meeting of the Society for Psychotherapy Research. Montreal (June).

Baxter, E. E., Alexander, P.C., Kraus, D.R., Bentley, J.H., Boswell, J.F., & Castonguay, L.G. (2016). Concurrent validation of the Treatment Outcome Package (TOP) for children and adolescents. Journal of Child and Family Studies, 25, 2415–2422. https://doi.org/10.1007/s10826-016-0419-4

Blais, M. A., Sinclair, S. J., & Shorey, H. (unpublished manuscript). A Psychometric Evaluation of the Treatment Outcome Package – TOP.

Boswell, J. F., Constantino, M. J., Coyne, A. E., & Kraus, D. R. (2022). For whom does a match matter most? Patient-level moderators of evidence-based patient-therapist matching.  Journal of Consulting and Clinical Psychology, 90(1), 61-74.

Boswell, J. F., Constantino, M. J., & Kraus, D. R. (2017). Harnessing the therapist effect in patient-centered mental health care decision making. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 724-728. https://doi.org/10.1007/s10488-016-0789-

Boswell, J. F., Constantino, M. J., Kraus, D. R., Bugatti, M., & Oswald, J. (2016). The expanding relevance of routinely collected outcome data for mental health care decision making. Administration and Policy in Mental Health and Mental Health Services Research, 43, 482-491. doi: 10.1007/s10488-015-0649-6

Boswell, J. F., Constantino, M. J., Oswald, J. M., Bugatti, M., Coyne, A. E., Goodwin, B., & Morrison, N. (2021).  A Multimethod Study of Mental Health Care Patients’ Attitudes Toward Clinician-Level Performance Information. Psychiatric Services, 72(4), 452-456.

Boswell, J. F., Constantino, M. J., Oswald, J. M., Bugatti, M., Goodwin, B., & Yucel, R. (2018). Mental health care consumers’ relative valuing of clinician
performance information. Journal of Consulting and Clinical Psychology, 86(4), 301–308.

Boswell, J. F., Kraus, D. R., Constantino, M. J., Bugatti, M., & Castonguay, L. G. (2017). The implications of therapist effects for routine practice, training, and policy. In L. G. Castonguay & C. E. Hill (Eds.), Why are some therapists are better than others? Understanding therapist effects (pp. 309-323). Washington DC: American Psychological Association.

Boswell, J. F., Kraus, D. R., Nordberg, S. N., & Castonguay, L. G. (2009). The Treatment Outcome Package (TOP): An investigation of its validity. Society for Psychotherapy Research. Santiago, Chile.

Boswell, J.F., Kraus, D.R., Miller, S.D., & Lambert, M.J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6-19.

Castonguay L. G., Constantino, M. J., Boswell, J. F., & Kraus D. R. (2010). The therapeutic alliance: Research and theory. In L. Horowitz & S. Strack (Eds.), Handbook of interpersonal psychology. London: Wiley Press.

Constantino, M. J., Boswell, J. F., & Kraus, D. R. (2020). Enhancing mental health care by scientifically matching patients to providers’ strengths. Patient-Centered Outcomes Research Institute contract #IHS-1503-28573

Constantino, M. J., Boswell, J. F., Coyne, A. E., Kraus, D. R., & Castonguay, L. G. (2017). Who works for whom and why? Integrating therapist effects analysis into psychotherapy outcome and process research. In L. G. Castonguay & C. E. Hill (Eds.), Why are some therapists are better than others? Understanding therapist effects (pp. 55-68). Washington DC: American Psychological Association.

Constantino, M. J., Boswell, J. F., Coyne, A. E., Romano, F. M., Trudeau, K. J., & Kraus, D. R. (2019, July). Therapists’ accuracy in predicting their own objective effectiveness in treating specific mental health concerns. Paper presented at the 50th annual meeting of the Society for Psychotherapy Research, Buenos Aires, Argentina.

Constantino, M. J., Boswell, J. F., Coyne, A. E., Swales, T. P., & Kraus, D. R. (2021). Effect of Matching Therapists to Patients vs Assignment as Usual on Adult
Psychotherapy Outcomes: A Randomized Clinical Trial. JAMA Psychiatry, 78(9), 960-969.

Constantino, M. J., Gaines, A. N., Coyne, A. E., Boswell, J. F., & Kraus, D. R. (in press). Existential Isolation as a Correlate of Mental Health Problems, Predictor of Treatment Outcome, and Moderator of a Patient-Therapist Match Effect.  Journal of Social and Clinical Psychology.

Constantino et al., (in press).  Therapist Perceptions of Their Own Measurement-Based, Problem-Specific Effectiveness. Journal of Consulting and Clinical Psychology.

Coyne, A. E., Constantino, M. J., Boswell, J. F., & Kraus, D. R. (2022). Therapist-level moderation of within- and between-therapist process-outcome associations. Journal of Consulting and Clinical Psychology, 90(1), 75-89.

Kraus, D. R. & Horan, F. P. (1997). Outcomes roadblocks: Problems and solutions. Behavioral Health Management, 17, 22-24.

Kraus, D. R. & Stelk, W. (2002). Best Practice Characteristics in Public Mental Health Centers, Paper presented at the 15th Annual Research Conference for the Research and Training Center for Children’s Mental Health.

Kraus, D. R. &, Varadian, M. S. (2003). Effective Outcomes Management Techniques. Paper presented at the Michigan Association for Community Mental Health Boards, Lansing, MI.

Kraus, D. R. (1988). Designing Outcome Management Programs that Improve the Quality of Care. Paper presented at the Association for Ambulatory Behavioral Healthcare’s annual convention, Washington DC.

Kraus, D. R. (1998). Measuring the Value of Your Care Management Program Through Effective Outcomes Assessment. Pre-conference workshop presented at the Second Annual National Forum on Medicare Care Management, Orlando, FL.

Kraus, D. R. (1999). Outcomes Management. Paper presented at the Illinois Association for Community Mental Healthcare, Chicago, IL.

Kraus, D. R. (1999). Using Outcome Data for Benchmarking. Paper presented at the Third Annual International Forum on Behavioral Health Outcomes Management, Boston, MA.

Kraus, D. R. (2001). Identifying Best Practices to Improve Child Outcomes. Paper presented at the Massachusetts Behavioral Health Partnership’s Convention, Worcester, MA.

Kraus, D. R. (2001). Lessons Learned from Outcomes Management. Panel discussion American Psychological Association, San Francisco, CA.

Kraus, D. R., & Castonguay, L. (2006). Integrating Evidence Based Practices with Outcomes Management. Paper presented at NASPR Annual Conference.

Kraus, D. R., & Crawford, J. (1997). Implementing a Provider Initiated Outcomes Measurement Project — Case Study. Paper presented at the Institute for International Research, Boston, MA.

Kraus, D. R., & Finch, R. A. (1998). Using Outcomes Data to Make Purchasing and Network Management Decisions — Increasing Data Accuracy and Reducing Liability. Keynote address presented at the Second Annual National Forum on Behavioral Health Outcomes Management, Boston, MA.

Kraus, D. R., & Horan, F. P. (1998). Protecting client confidentiality and improving provider relations through a new form of managed care: Collaborative care management. In Coughlin, K.M. (Ed.), Behavioral outcomes & guidelines. New York: Faulkner & Gray.

Kraus, D. R., & Wolfe, A. & Castonguay, L.G., (2006). The outcome assistant: A kinder philosophy to the management of outcome. Psychotherapy Bulletin, 41, 23-31

Kraus, D. R., Boswell, J.F., Wright, A.G.C., Castonguay, L.G., & Pincus, A.L. (2010). Factor structure of the Treatment Outcome Package for children. Journal of Clinical Psychology, 66(6), 627-40.

Kraus, D. R., Finch, R. A, Crawford, J. (2000). Designing and Monitoring the Progress of Quality Improvement Initiatives in the Public Sector. Paper presented at the Fourth Annual National Forum on Behavioral Health Outcomes Management, Boston, MA.

Kraus, D. R., Seligman, D, & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61(3), 285-314.

Kraus, D. R., Varadian, M. S. (2003). Using Quartile Analyses to Identify CQI Needs. Paper presented at the Michigan Association for Community Mental Health Boards, Cadillac, MI.

Kraus, D., & Castonguay, L. G. (2010). TOP: Development and use in naturalistic settings. In M. Barkham, G.E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence (pp. 155-174). London: Wiley Press.

Kraus, D., Castonguay, L., Wolfe, A., (2005) Development of the TOP and the TOP Distress Scale. Paper presented at APA Annual Conference.

Kraus, D., Castonguay, L.G., Pincus, A., Boswell, J.F., & Wright, A. (2008). Treatment Outcome Package for Children: An examination of its factor structure. Paper presented at the Annual meeting of the Society for Psychotherapy Research. Barcelona, Spain (June).

Kraus, D.R., Baxter, E.E., Alexander, P.C., & Bentley, J.H. (2015). The Treatment Outcome Package (TOP): A multi-dimensional level of care matrix for child welfare. Children and Youth Services Review, 57, 171-178.

Kraus, D.R., Bentley, J.H., Alexander, P.C., Boswell, J.F., Constantino, M.J., Baxter, E.E., & Castonguay, L.G. (2016). Predicting therapist effectiveness from their own practice-based evidence. Journal of Consulting and Clinical Psychology, 84(6), 473.

Kraus, D.R., Castonguay, L.G., Boswell, J.F., Nordberg, S.S., & Hayes, J.A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21, 267-276.

Kraus, D.R., Castonguay, L.G., Hayes, J.A. & Barber, J.P. (2010). The empirically supported therapist: All clinicians have strengths and weaknesses. Psychologie Quebec, 1, 12-15.

Kraus, D.R. (2004). Advancing Practice Research Networks in APA Training Clinics. Paper presented at the Association for the Advancement of Behavior Therapy, LA

Kraus, D.R. (2004). CQI: Getting the most out of your outcome data. Paper presented at Bridging the Gap: NJAMHA’s Annual IT Conference.

Kraus, D. R., Williams, A. A., Hobbs, K., Constantino, M. J., Boswell, J. F., & Trudeau, K. J. (in press). Matched referrals to behavioral health practitioners’ historical effectiveness strengths improves patient outcomes.  Journal of Family Practice.

McAleavey, A.A., Nordberg, S.S., Kraus, D.R., & Castonguay, L.G. (2012). Errors in treatment outcome monitoring: Implications of multidimensional and general measurements for real-world psychotherapy. Canadian Psychology, 53(2), 105-114.

Nordberg, S, Boswell, J.F., Castonguay, L.G., & Kraus, D., (2008). Measuring the Shape of Change: Results from Three Years of Repeated Assessment in a University Clinic. Paper presented at the Annual meeting of the Society for Psychotherapy Research. Barcelona, Spain (June).

Nordberg, S, Castonguay, L.G., Wilson, L., Boswell, J.F., Nelson, D., Zack, S.E., Lampropoulos, G., & Kraus, D. (2008). Clients’ socio-economic status and improvement in psychotherapy. Paper presented at the meeting of the North American Society for Psychotherapy Research, New Heaven, CT  (September).

Nordberg, S. A., Castonguay, L.G., Fisher, A.J., Boswell, J.F., & Kraus, D.R. (2014). Validating the rapid responder construct within a practice research network. Journal of Clinical Psychology 70(9), 886-903.

Stelk, W., & Berger, M. (2009). Predictive Modeling: Using TOP Clinical Domain Items to Identify Adult Medicaid Recipients at Risk for High Utilization of Behavioral Health Services in a Managed Care Provider Network. 40th SPR International Annual Meeting. Santiago de Chile.

Wolfe, A., Kraus, D., & Castonguay, L.G. (2007). The convergent/divergent validity of a multidimensional measure of psychotherapy outcome. Paper presented at the annual meeting of the Ohio Society for Psychotherapy Research, Miami (April).

Wolfe, A., Kraus, D., Castonguay, L. (2005). Development of the TOP and the TOP Distress Scale. Paper presented at SPR Annual Conference.

Wolfe, A.W., Love, T.E., Kraus, D., & Castonguay, L.G. (2005). Item response theory and psychotherapy outcome. Paper presented at the Annual Meeting of the Ohio Society for Psychotherapy Research, Toledo, OH (April).

Youn, S.J., Kraus, D.R., Castonguay, L.G. (2012). The Treatment Outcome Package: Facilitating practice and clinically relevant research. Psychotherapy, 49(2), 115-122.

Zack, S.E., Castonguay, L.G., Boswell, J.F., McAleavey, A.A., Adelman, R., & Kraus, D.R. (2015). Attachment history as a moderator of the alliance outcome relationship in adolescents. Psychotherapy, 52(2), 258–267. https://doi.org/10.1037/a003772