Decision Support and Evaluation

The Office of Decision Support and Evaluation (DSE) provides accurate and timely data analysis to support BHA programs.

DSE provides comprehensive evaluation, research and data to support BHA’s programming, service delivery and policy decisions for behavioral health services.  
 

DSE’s functions include:

  • Planning and implementing data-driven needs assessments
  • Conducting and managing client and provider surveys
  • Developing and reporting performance measures
  • Evaluating prevention and treatment outcomes
  • Supporting quality improvement efforts
  • Projecting the impacts of policy and budget scenarios
For more information about DSE, please contact Can Du at Can.Du@dshs.wa.gov
Interested in other DSHS reports?  You can find them here: Substance Use Reports and Mental Health Reports.

DSE Projects and Reports

DSE supports DBHR's behavioral health programs, helps DBHR understand our clients' perspectives on the services they receive, and tracks DBHR's progress in its goal to help transform lives

Recent Projects at DSE:

Patients Speak Out: DBHR's Annual Patient Satisfaction Survey

Since 2001, DBHR has conducted an annual survey to ask clients who participate in substance use disorder treatment programs in Washington state their perception of the quality of the services they receive.  Using these survey results, DSE staff compile statewide reports as well as county-level reports and individual, confidential reports for each of the participating treatment agencies.  These reports provide analysis and feedback that can be used at the state, county, and provider levels to improve the quality of substance use disorder treatment services in Washington state.


New:
Patients Speak Out: Youth Patient Satisfaction Survey 2015

Download a copy of the report here.

For more information, contact Felix Rodriguez, Ph.D.

 

Patients Speak Out: Adult Patient Satisfaction Survey 2015

Download a copy of the report here.

For more information, contact Felix Rodriguez, Ph.D.

 

 

The Washington State Young Adult Health Survey (YAHS)

YAHS is an online survey that measures marijuana and other substance use, perceptions of harm, risk factors, and consequences among young adults (18-25 years old) living in Washington State. Motivated by the passage of Initiative 502 in 2012, the first wave of the survey began in 2014 before the recreational marijuana stores opened their doors; a total of 2,101 eligible young adults participated. The survey is administered annually. Follow-up interviews with prior years' participants have been conducted to assess changes in young adults' marijuana use over time.

New: Perceived and Reported Use of Marijuana and Alcohol - An Update from the 2015 Young Adult Health Survey

Download a copy of the report here.

For more information, contact Rebecca Grady, Ph.D.

 

 

The Washington State Healthy Youth Survey (HYS):

In collaboration with the Office of the Superintendent of Public Instruction (OSPI), the Department of Health (DOH), and the Liquor and Cannabis Board (LCB), DBHR supports a statewide adolescent health behavior survey, the Healthy Youth Survey (HYS). The survey is administered through participating school districts in the state. Collected every two years, survey data is used for local and state prevention program and policy planning.

The HYS measures health risk behaviors that contribute to youth injuries, deaths, and social problems. Students answer questions about alcohol, tobacco, marijuana and other drug use, safety and violence, dietary behaviors and physical activity, and related risk and protective factors. Survey data can be used to examine links between behaviors and negative consequences, such as drug use and poor school performance.

The survey results serve as an important source of needs-assessment data for school districts, community-based organizations, local health and human service agencies, and state agencies. The data are used to monitor the health status of adolescents and track progress on state, federal, and local education and health-related goals. The information from the Healthy Youth Survey may be used to identify trends in patterns of behavior over time. It may also be used to compare with results from national and other state-level data sources. State and local health and safety agencies use this information to guide policies and programs that serve youth.

For more information, contact Rebecca Grady, Ph.D.

Healthy Youth Survey Links:

  • Healthy Youth Survey: Survey information and background.
  • AskHYS.net: For reports, fact sheets, online data analysis, and information about analyzing and disseminating HYS data. State and county-level HYS behavior data is available to everyone. Access to school-level data may be granted by contacting school districts. The system will suppress any data that has the potential to compromise students' anonymity.

 

 

 

Current Efforts

Creating Mental Health Connections for Children and Youth in Foster Care

The purpose of this project is to improve the screening and assessment for trauma and evidence based treatments for children, youth, and their families who are served in the Washington State public child welfare system.

The primary goals of this collaborative project are to:

  • Improve the accessibility of evidence based mental health treatments that will enhance the safety, permanency, and wellbeing of children and youth in foster care with behavioral health care needs;
  • Create efficient strategies to connect children, youth, and families with appropriate and evidence-based mental health practices (EBP); and
  • Improve communication between social workers and mental health providers to ensure children, youth, and families with these needs are identified and referred to the best available services that will result in better outcomes for this population.

To achieve these goals we will align screening, assessment, and mental health evidence based treatments between the child welfare, mental health, and Medicaid systems for children and youth in foster care and their families by implementing these strategies:

  • Create a learning community with all primary stakeholders in the lives of children and families involved with the foster care system;
  • Use validated screening measures (within child welfare) and measures of functional outcomes (within mental health), building on existing protocols in both systems
  • Streamline and standardize how we identify and refer youth to EBPs;
  • Increase our mental health system capacity to deliver EBPs matched to the assessed needs of each child, emphasizing fidelity in a trauma-responsive manner;
  • Create a feedback system between child welfare and mental health professionals to better coordinate and match mental health needs with EBPs for improved case planning efforts.

A process and outcome evaluation will document impacts on clients, services, and systems. Several recently enacted initiatives that complement this project¡¦s goals will be incorporated and leveraged to increase project breadth and reach.

Funding amount and use: Year one funding will support a comprehensive planning process. Funding for subsequent years two-five is contingent upon successful year one planning, and will be used to support infrastructure development, CA staff training, evidence-based practices service training, and evaluation-related activities. ($639,320 for year one, subsequent years depend on successful planning).

For more information contact Kathy Smith-DeJulio: smithkl1@dshs.wa.gov.

Evidence-Based Treatment Intervention

Purpose
The availability of empirically supported clinical practices for the treatment of substance use disorders has increased as research moves from highly-controlled clinical trials to the real world of community treatment settings. The Evidence-Based Practices Substance Abuse (EBP) database and web site is a tool to help treatment providers and policy officials make informed decisions about which evidence-based practices are most appropriate for specific drug problems and individuals.

Criteria for Selection
Practices have published research documenting their effectiveness, and/or are recognized by reputable organizations as evidence-based. Currently, 42 practices are included, most meeting these criteria:

  • Research. The practice has been studied in randomized clinical trials, quasi-experimental studies, or in some cases, a less rigorously controlled research design. Research results are published in peer reviewed journals.
  • Meaningful outcomes. The practice has resulted in benefits to the individuals receiving the service. It has helped consumers achieve positive outcomes related to treatment goals and objectives.
  • Standardization. The practice has been standardized so that it can be replicated. Preference is given to programs which have developed a manual or similar documentation.
  • Replication. The intervention has been studied in more than one setting and findings have yielded consistent results.
  • Fidelity measure.  A fidelity measure either exists or could be developed from available information. Such measures allow practitioners to verify that an intervention is being implemented in a manner consistent with the protocol evaluated in the research.

Search Features
Users can view interventions in a matrix, browse and select by title, or search the database using a variety of descriptors such as population, drug problem, therapy type, and setting. Each entry includes a brief description of the intervention, including implementation issues, references to supporting literature, the availability of instructional manuals and training, developer notes, and other useful information.

Other Features
In addition to the database, the EBP Substance Abuse web site includes abstracts of selected review articles about the effectiveness of evidence-based practices for treating substance abuse, links to web resources for more information, and FAQs (frequently asked questions) about the EBP-Substance Abuse database and related issues.

Target Audience
This database is intended for treatment providers, administrators, and anyone else interested in researching and selecting evidence-based practices for treating substance use disorders.

Future Plans
EBP-Substance Abuse is an expanding resource. As the efficacy and effectiveness of practices are documented, they will be added to the database, and we invite nominations of practices from the treatment and research communities. If salient information about a practice is not included in the database, please let us know. Our goal is to provide a resource that helps treatment providers and policy officials make informed decisions about building effective treatment services.

EBP-Substance Abuse is a project of the University of Washington Alcohol & Drug Abuse Institute and the Northwest Frontier Addiction Technology Transfer Center, funded by DBHR.

Contact: adai@u.washington.edu

Washington Healthy Youth Coalition Evaluation

The goals of the Washington Healthy Youth Coalition (formerly the Washington Coalition to Reduce Underage Drinking) are to prevent or reduce underage use of alcohol and marijuana. 

The Coalition receives block grant awards from the federal Office of Juvenile Justice and Delinquency Prevention (OJJDP). These funds support public education efforts, Liquor Control Board enforcement efforts, workshops at the State Prevention Summit, youth leadership activities, and community-based coalitions.

DBHR also received two discretionary grants to support five communities as they implement comprehensive approaches to reducing underage drinking, with an emphasis on increasing law enforcement activity. Washington Traffic Safety Commission and the Washington State Liquor Control Board are primary partners in the Coalition.  Other collaborators include: local law enforcement, Mothers Against Drunk Driving, the statewide College Coalition for Substance Abuse Prevention and other state agencies.  

Visit www.StartTalkingNow.org to get more more information about the Coalition's work and its members.

For more information contact Martha.Perla@dshs.wa.gov

Staffing Patterns Survey

DBHR has commissioned a survey every three years since 1991 to monitor changes in the staffing patterns of certified chemical dependency treatment facilities in Washington State. For each year, directors of treatment programs completed the staffing patterns survey.  The survey response rate has remained over 90 percent, except for one year when it was 85 percent. DBHR generates a report that combines the results of the latest survey with past surveys. The report presents changes in the staffing patterns of contract and non-contract treatment facilities with respect to race/ethnicity, gender, disability status, and multilingual ability.

Staffing Patterns in Washington State Chemical Dependency Treatment Facilities:

For more information, contact Felix.Rodriguez@dshs.wa.gov

Substance Abuse Treatment Enhancement and Dissemination (SAT-ED) project

The Washington State System of Care grant funded (SAMHSA, Substance Abuse and Mental Health Services Administration) project will expand systems of care statewide with family-driven, youth-guided core values fully integrated in all parts of the SOC Governance Structure, the Statewide Family, Youth and System Partners Round Table - FYSPRT.

This governance structure has been adopted as the infrastructure for Children's Behavioral Health and is comprised of four regional FYSPRTs in addition to the statewide FYSPRT. Local FYSPRTs are in development. Each FYSPRT reviews and approves policy, program and practice changes at the local, regional or state levels.  The SOC expansion will focus primarily on youth ages 13-18 with serious emotional disturbances - SED, out-of-home placement, or juvenile justice/child welfare histories. For more information on the grant, system of care values and principles and the Governance Structure please see Systems of Care - SOC and http://www.dshs.wa.gov/mediareleases/2012/pr12046.shtml (MISSING RELEASE PAGE)

PURPOSE:

  1. Infuse SOC values in all systems for children, youth and families
  2. Ensure services are seamless for children and youth who are the population of focus
  3. Build access and availability of home and community based services
  4. Develop and strengthen workforce that operationalizes SOC values
  5. Build strong data management systems to inform decision making and ensure outcomes

For more information on the grant, system of care values and principles and the Governance Structure see Systems of Care - SOC andhttp://www.dshs.wa.gov/mediareleases/2012/pr12046.shtml (MISSING RELEASE PAGE)

REPORTS:

Reports will be developed through a collaborative effort between DBHR and RDA and include both programmatic and administrative data. The Children's Behavioral Health System of Care Data Quality Team, comprised of representatives of DSHS child serving systems, is developing Measures of Statewide Performance to provide a monitoring and evaluation framework for the System of Care. This outcomes-based report is intended to be relevant to all children and youth with emotional and behavioral health needs and their families served by DSHS and HCA.

For more information, contact Kathy Smith-DiJulio: smithkl1@dshs.wa.gov.

Systems of Care for Children's Behavioral Health Services

The Washington State System of Care grant funded (SAMHSA, Substance Abuse and Mental Health Services Administration) project will expand systems of care statewide with family-driven, youth-guided core values fully integrated in all parts of the SOC Governance Structure, the Statewide Family, Youth and System Partners Round Table - FYSPRT.

This governance structure has been adopted as the infrastructure for Children's Behavioral Health and is comprised of four regional FYSPRTs in addition to the statewide FYSPRT. Local FYSPRTs are in development. Each FYSPRT reviews and approves policy, program and practice changes at the local, regional or state levels. The SOC expansion will focus primarily on youth ages 13-18 with serious emotional disturbances - SED, out-of-home placement, or juvenile justice/child welfare histories. For more information visit: our Systems of Care webpage.

PURPOSE:

  1. Infuse SOC values in all systems for children, youth and families
  2. Ensure services are seamless for children and youth who are the population of focus
  3. Build access and availability of home and community based services
  4. Develop and strengthen workforce that operationalizes SOC values
  5. Build strong data management systems to inform decision making and ensure outcomes

For more information on the grant, system of care values and principles and the Governance Structure see Systems of Care - SOC and  http://www.dshs.wa.gov/mediareleases/2012/pr12046.shtml (MISSING RELEASE PAGE)

REPORTS:

Reports will be developed through a collaborative effort between DBHR and RDA and include both programmatic and administrative data. The Children's Behavioral Health System of Care Data Quality Team, comprised of representatives of DSHS child serving systems, is developing Measures of Statewide Performance to provide a monitoring and evaluation framework for the System of Care. This outcomes-based report is intended to be relevant to all children and youth with emotional and behavioral health needs and their families served by DSHS and HCA.

For more information, contact Kathy Smith-DiJulio: smithkl1@dshs.wa.gov.

Screening, Brief Intervention, Referral and Treatment Project (SBIRT)

The Screening, Brief Intervention, and Referral to Treatment (SBIRT) Primary Care Integration project is a universal, evidence-based practice used to identify, reduce, and prevent problematic use, abuse, and dependence on alcohol and illicit drugs.

In 2003 DBHR received a grant award to place Chemical Dependency Professionals (CDPs) in nine hospital emergency departments in six different counties.  The CDP's screened emergency department patients for substance abuse problems and provided brief intervention or referral to treatment.

The evaluation examined the degree to which the project produces intended changes in service delivery systems to improve existing linkages to these services and to expand substance abuse services to include early intervention. The DSHS Research and Data Analysis Division completed the evaluation report which is available at Washington State Screening, Brief Intervention, and Referral to Treatment Program.  

DBHR received additional funding that allows Washington to build on the success of the first grant by expanding and further integrating behavioral health care services into primary care settings.  Services are provided to adults receiving primary care in selected community health clinics in King, Whitman, Cowlitz and Clallam Counties.

We anticipate over 96,000 adults will be screened and served over the life of the grant, which will reduce substance abuse and related injuries, and decrease health care use and costs for chronic conditions such as depression and anxiety. The primary components of services are:

  • Screening - a healthcare professional assesses a patient for risky substance use behaviors using standard screening tools;
  • Brief Intervention - a healthcare professional engages a patient showing risky substance use behaviors in a short conversation, providing feedback and advice; and
  • Referral to Treatment - a healthcare professional provides a referral to brief therapy or additional treatment to patients who screen in need of additional services.

For more information about SBIRT, visit http://www.wasbirt.com.