Decision Support and Evaluation

The Office of Decision Support and Evaluation - DSE provides accurate and timely data analysis to support BHA programs.

DSE provides comprehensive evaluation, research and data to support BHA’s programming, service delivery and policy decisions for behavioral health services.  
 

DSE’s functions include:

  • Planning and implementing data-driven needs assessments
  • Conducting and managing client and provider surveys
  • Developing and reporting performance measures
  • Evaluating prevention and treatment outcomes
  • Supporting quality improvement efforts
  • Projecting the impacts of policy and budget scenarios
For more information about DSE, please contact Can Du at Can.Du@dshs.wa.gov

DSE Projects and Reports

DSE supports DBHR's behavioral health programs, helps DBHR understand our clients' perspectives on the services they receive, and tracks DBHR's progress in its goal to help transform lives

Interested in other DBHR and DSHS reports?  
You can find them here: Substance Use Reports and Mental Health Reports.

Recent Projects at DSE:

Patients Speak Out: DBHR's Annual Patient Satisfaction Survey

Since 2001, DBHR has conducted an annual survey to ask clients who participate in substance use disorder treatment programs in Washington state their perception of the quality of the services they receive.  Using these survey results, DSE staff compile statewide reports as well as county-level reports and individual, confidential reports for each of the participating treatment agencies.  These reports provide analysis and feedback that can be used at the state, county, and provider levels to improve the quality of substance use disorder treatment services in Washington state.


New: Patients Speak Out: Youth Patient Satisfaction Survey 2015

Download a copy of the report here.

For more information, contact Felix Rodriguez, Ph.D.

 

Patients Speak Out: Adult Patient Satisfaction Survey 2015

Download a copy of the report here.

For more information, contact Felix Rodriguez, Ph.D.

 

 

The Washington State Young Adult Health Survey (YAHS)

YAHS is an online survey that measures marijuana and other substance use, perceptions of harm, risk factors, and consequences among young adults (18-25 years old) living in Washington State. Motivated by the passage of Initiative 502 in 2012, the first wave of the survey began in 2014 before the recreational marijuana stores opened their doors; a total of 2,101 eligible young adults participated. The survey is administered annually. Follow-up interviews with prior years' participants have been conducted to assess changes in young adults' marijuana use over time.

 Perceived and Reported Use of Marijuana and Alcohol - An Update from the 2015 Young Adult Health Survey 

Download a copy of the report here.

For more information, contact Rebecca Grady, Ph.D.

 

 

The Washington State Healthy Youth Survey (HYS):

In collaboration with the Office of the Superintendent of Public Instruction (OSPI), the Department of Health (DOH), and the Liquor and Cannabis Board (LCB), DBHR supports a statewide adolescent health behavior survey, the Healthy Youth Survey (HYS). The survey is administered through participating school districts in the state. Collected every two years, survey data is used for local and state prevention program and policy planning.

The HYS measures health risk behaviors that contribute to youth injuries, deaths, and social problems. Students answer questions about alcohol, tobacco, marijuana and other drug use, safety and violence, dietary behaviors and physical activity, and related risk and protective factors. Survey data can be used to examine links between behaviors and negative consequences, such as drug use and poor school performance.

The survey results serve as an important source of needs-assessment data for school districts, community-based organizations, local health and human service agencies, and state agencies. The data are used to monitor the health status of adolescents and track progress on state, federal, and local education and health-related goals. The information from the Healthy Youth Survey may be used to identify trends in patterns of behavior over time. It may also be used to compare with results from national and other state-level data sources. State and local health and safety agencies use this information to guide policies and programs that serve youth.

For more information, contact Rebecca Grady, Ph.D.

Healthy Youth Survey Links:

  • Healthy Youth Survey: Survey information and background.
  • AskHYS.net: For reports, fact sheets, online data analysis, and information about analyzing and disseminating HYS data. State and county-level HYS behavior data is available to everyone. Access to school-level data may be granted by contacting school districts. The system will suppress any data that has the potential to compromise students' anonymity.

2017-2022 SPE Strategic Planning: Data Needs Assessment, March 13, 2017

The Washington State Prevention Enhancement Policy Consortium (Consortium) relies on data and resource needs assessments in the development of their 5-year Strategic Plan.  The 2017- 2022 Data Needs Assessment  presentation includes data on long term outcomes (consequences: chronic disease, crime, graduation rates, drug-related traffic fatalities and injuries), intermediate outcomes (behavioral health problem areas:  substance use disorders, mental health indicators) and short term outcomes (intervening variables:  availability of drugs, risk and protective factors, and community norms).  The Data Needs Assessment was developed as a collaborative effort by the State Epidemiological Outcomes Work Group, which serves as the primary data workgroup for the Consortium.

For more information, contact Martha Perla

WHY COALITION PRESENTATION:  Health Youth Survey and Monitoring the Future Results, March 17, 2017

The Washington Healthy Youth (WHY) Coalition consists of state-level efforts and community-based strategies addressing youth substance use disorders, particularly alcohol and marijuana use.  The March 17, 2017 presentation to the WHY Coalition reported 2016 Washington State (Health Youth Survey) and National (Monitoring the Future) survey results  This presentation covers alcohol and marijuana substance use, substance use related behaviors and norms, and national versus state trends.

For more information, contact Martha Perla

Current Efforts

Creating Mental Health Connections for Children and Youth in Foster Care

The purpose of this project is to improve the screening and assessment for trauma and evidence based treatments for children, youth, and their families who are served in the Washington State public child welfare system.

The primary goals of this collaborative project are to:

  • Improve the accessibility of evidence based mental health treatments that will enhance the safety, permanency, and wellbeing of children and youth in foster care with behavioral health care needs;
  • Create efficient strategies to connect children, youth, and families with appropriate and evidence-based mental health practices (EBP); and
  • Improve communication between social workers and mental health providers to ensure children, youth, and families with these needs are identified and referred to the best available services that will result in better outcomes for this population.

To achieve these goals we will align screening, assessment, and mental health evidence based treatments between the child welfare, mental health, and Medicaid systems for children and youth in foster care and their families by implementing these strategies:

  • Create a learning community with all primary stakeholders in the lives of children and families involved with the foster care system;
  • Use validated screening measures (within child welfare) and measures of functional outcomes (within mental health), building on existing protocols in both systems
  • Streamline and standardize how we identify and refer youth to EBPs;
  • Increase our mental health system capacity to deliver EBPs matched to the assessed needs of each child, emphasizing fidelity in a trauma-responsive manner;
  • Create a feedback system between child welfare and mental health professionals to better coordinate and match mental health needs with EBPs for improved case planning efforts.

A process and outcome evaluation will document impacts on clients, services, and systems. Several recently enacted initiatives that complement this project¡¦s goals will be incorporated and leveraged to increase project breadth and reach.

Funding amount and use: Year one funding will support a comprehensive planning process. Funding for subsequent years two-five is contingent upon successful year one planning, and will be used to support infrastructure development, CA staff training, evidence-based practices service training, and evaluation-related activities. ($639,320 for year one, subsequent years depend on successful planning).

For more information contact Kathy Smith-DeJulio: smithkl1@dshs.wa.gov.

Evidence-Based Treatment Intervention

Purpose
The availability of empirically supported clinical practices for the treatment of substance use disorders has increased as research moves from highly-controlled clinical trials to the real world of community treatment settings. The Evidence-Based Practices Substance Abuse (EBP) database and web site is a tool to help treatment providers and policy officials make informed decisions about which evidence-based practices are most appropriate for specific drug problems and individuals.

Criteria for Selection
Practices have published research documenting their effectiveness, and/or are recognized by reputable organizations as evidence-based. Currently, 42 practices are included, most meeting these criteria:

  • Research. The practice has been studied in randomized clinical trials, quasi-experimental studies, or in some cases, a less rigorously controlled research design. Research results are published in peer reviewed journals.
  • Meaningful outcomes. The practice has resulted in benefits to the individuals receiving the service. It has helped consumers achieve positive outcomes related to treatment goals and objectives.
  • Standardization. The practice has been standardized so that it can be replicated. Preference is given to programs which have developed a manual or similar documentation.
  • Replication. The intervention has been studied in more than one setting and findings have yielded consistent results.
  • Fidelity measure.  A fidelity measure either exists or could be developed from available information. Such measures allow practitioners to verify that an intervention is being implemented in a manner consistent with the protocol evaluated in the research.

Search Features
Users can view interventions in a matrix, browse and select by title, or search the database using a variety of descriptors such as population, drug problem, therapy type, and setting. Each entry includes a brief description of the intervention, including implementation issues, references to supporting literature, the availability of instructional manuals and training, developer notes, and other useful information.

Other Features
In addition to the database, the EBP Substance Abuse web site includes abstracts of selected review articles about the effectiveness of evidence-based practices for treating substance abuse, links to web resources for more information, and FAQs (frequently asked questions) about the EBP-Substance Abuse database and related issues.

Target Audience
This database is intended for treatment providers, administrators, and anyone else interested in researching and selecting evidence-based practices for treating substance use disorders.

Future Plans
EBP-Substance Abuse is an expanding resource. As the efficacy and effectiveness of practices are documented, they will be added to the database, and we invite nominations of practices from the treatment and research communities. If salient information about a practice is not included in the database, please let us know. Our goal is to provide a resource that helps treatment providers and policy officials make informed decisions about building effective treatment services.

EBP-Substance Abuse is a project of the University of Washington Alcohol & Drug Abuse Institute and the Northwest Frontier Addiction Technology Transfer Center, funded by DBHR.

Contact: adai@u.washington.edu

Washington Healthy Youth Coalition Evaluation

The goals of the Washington Healthy Youth Coalition (formerly the Washington Coalition to Reduce Underage Drinking) are to prevent or reduce underage use of alcohol and marijuana. 

The Coalition receives block grant awards from the federal Office of Juvenile Justice and Delinquency Prevention (OJJDP). These funds support public education efforts, Liquor Control Board enforcement efforts, workshops at the State Prevention Summit, youth leadership activities, and community-based coalitions.

DBHR also received two discretionary grants to support five communities as they implement comprehensive approaches to reducing underage drinking, with an emphasis on increasing law enforcement activity. Washington Traffic Safety Commission and the Washington State Liquor Control Board are primary partners in the Coalition.  Other collaborators include: local law enforcement, Mothers Against Drunk Driving, the statewide College Coalition for Substance Abuse Prevention and other state agencies.  

Visit www.StartTalkingNow.org to get more more information about the Coalition's work and its members.

For more information contact Martha.Perla@dshs.wa.gov

Staffing Patterns Survey

DBHR has commissioned a survey every three years since 1991 to monitor changes in the staffing patterns of certified chemical dependency treatment facilities in Washington State. For each year, directors of treatment programs completed the staffing patterns survey.  The survey response rate has remained over 90 percent, except for one year when it was 85 percent. DBHR generates a report that combines the results of the latest survey with past surveys. The report presents changes in the staffing patterns of contract and non-contract treatment facilities with respect to race/ethnicity, gender, disability status, and multilingual ability.

Staffing Patterns in Washington State Chemical Dependency Treatment Facilities:

For more information, contact Felix.Rodriguez@dshs.wa.gov

Substance Abuse Treatment Enhancement and Dissemination (SAT-ED) project

The Washington State System of Care grant funded (SAMHSA, Substance Abuse and Mental Health Services Administration) project will expand systems of care statewide with family-driven, youth-guided core values fully integrated in all parts of the SOC Governance Structure, the Statewide Family, Youth and System Partners Round Table - FYSPRT.

This governance structure has been adopted as the infrastructure for Children's Behavioral Health and is comprised of four regional FYSPRTs in addition to the statewide FYSPRT. Local FYSPRTs are in development. Each FYSPRT reviews and approves policy, program and practice changes at the local, regional or state levels.  The SOC expansion will focus primarily on youth ages 13-18 with serious emotional disturbances - SED, out-of-home placement, or juvenile justice/child welfare histories. For more information on the grant, system of care values and principles and the Governance Structure please see Systems of Care - SOC.

PURPOSE:

  1. Infuse SOC values in all systems for children, youth and families
  2. Ensure services are seamless for children and youth who are the population of focus
  3. Build access and availability of home and community based services
  4. Develop and strengthen workforce that operationalizes SOC values
  5. Build strong data management systems to inform decision making and ensure outcomes

For more information on the grant, system of care values and principles and the Governance Structure see Systems of Care - SOC.

REPORTS:

Reports will be developed through a collaborative effort between DBHR and RDA and include both programmatic and administrative data. The Children's Behavioral Health System of Care Data Quality Team, comprised of representatives of DSHS child serving systems, is developing Measures of Statewide Performance to provide a monitoring and evaluation framework for the System of Care. This outcomes-based report is intended to be relevant to all children and youth with emotional and behavioral health needs and their families served by DSHS and HCA.

For more information, contact Kathy Smith-DiJulio: smithkl1@dshs.wa.gov.

Systems of Care for Children's Behavioral Health Services

The Washington State System of Care grant funded (SAMHSA, Substance Abuse and Mental Health Services Administration) project will expand systems of care statewide with family-driven, youth-guided core values fully integrated in all parts of the SOC Governance Structure, the Statewide Family, Youth and System Partners Round Table - FYSPRT.

This governance structure has been adopted as the infrastructure for Children's Behavioral Health and is comprised of four regional FYSPRTs in addition to the statewide FYSPRT. Local FYSPRTs are in development. Each FYSPRT reviews and approves policy, program and practice changes at the local, regional or state levels. The SOC expansion will focus primarily on youth ages 13-18 with serious emotional disturbances - SED, out-of-home placement, or juvenile justice/child welfare histories. For more information visit: our Systems of Care webpage.

PURPOSE:

  1. Infuse SOC values in all systems for children, youth and families
  2. Ensure services are seamless for children and youth who are the population of focus
  3. Build access and availability of home and community based services
  4. Develop and strengthen workforce that operationalizes SOC values
  5. Build strong data management systems to inform decision making and ensure outcomes

For more information on the grant, system of care values and principles and the Governance Structure see Systems of Care - SOC and  http://www.dshs.wa.gov/mediareleases/2012/pr12046.shtml (MISSING RELEASE PAGE)

REPORTS:

Reports will be developed through a collaborative effort between DBHR and RDA and include both programmatic and administrative data. The Children's Behavioral Health System of Care Data Quality Team, comprised of representatives of DSHS child serving systems, is developing Measures of Statewide Performance to provide a monitoring and evaluation framework for the System of Care. This outcomes-based report is intended to be relevant to all children and youth with emotional and behavioral health needs and their families served by DSHS and HCA.

For more information, contact Kathy Smith-DiJulio: smithkl1@dshs.wa.gov.