Evaluation Exploring How Course Modality Influences the Effectiveness of the R3 Academy for Couples

The REFRAME project is designed to offer the R3 Academy for Couples, a robust 24-hour program, to married adults ages 18 and over in the state of California. The R3 Academy is an evidence-based couple relationship education curriculum that helps couples strengthen their relationships with their child, with their spouse, and at work. The program also includes two evidence-based components that address economic stability and an innovative approach to Case Management that fosters client self-direction. The R3 Academy curricula will be delivered in both English and Spanish through two modalities: 1) live classes and 2) livestream classes via a video conferencing platform. The Local Evaluation will examine how modality, or in other words attending a live class versus a livestream class, influences the effectiveness of R3 Academy for Couples program when it comes to changes in couples' marital/relationship satisfaction, conflict management, support and affection, and commitment. The question of modality is a timely one. In the COVID-19 era, many programs have become exclusively online-but the potential impact on effectiveness is not well known. We address this issue by considering the impact on four relationship outcomes: marital/relationship satisfaction, conflict management, support and affection, and commitment. Moreover, one issue that many programs report is that couples have great difficulty finding time to be engaged in regularly scheduled, live, in-person classes. Our study will provide evidence about how the availability of materials in alternative formats, that may allow more couples to be involved and reduce issues around the ability to participate, may influence the efficacy of those programs.

RQ1: How do live in-person (control) and online livestream (treatment) Marriage and Relationship Education (MRE) workshops compare on marital/relationship satisfaction outcomes immediately after program completion? RQ2: How do live in-person and online livestream MRE workshops compare on conflict management outcomes immediately after program completion? RQ3: How do live in-person and online livestream MRE workshops compare on support and affection outcomes immediately after program completion? RQ4: How do live in-person and online livestream MRE workshops compare on commitment outcomes immediately after program completion? RQ5: Do program effects last beyond program completion?

Couples in this study are required to take an Eligibility survey. If they meet the required eligibility criteria, the survey will gather further information including screening factors associated with domestic violence and child maltreatment that, if checked, will be flagged for further assessment by personal contact with our Case Management Supervisor. This form will also enable the registrant to identify which class format he or she wishes to attend-a live R3 Academy or a livestream workshop via a video conferencing platform. For the purpose of this study, the live or in-person modality is considered the control group and the livestream workshop is considered the treatment group. The R3 Academy curriculum is the same for each group, only the modality of curriculum delivery is different. Courses are a total of 24 hours that stretch across 12 sessions. Incentives for program completion include a $50 gift card that is offered to those who complete at least 90% of the program. In addition to the Eligibility survey, participants are asked to take a pre-survey before starting the class, a post-survey immediately following class completion, and a 4-month follow-up survey. If participants complete all three surveys they are eligible for an additional $25 gift card which they can receive even if they did not reach 90% completion.

As stated previously, entry into treatment or control groups is determined at enrollment. At the time of the impact analysis, propensity score matching (PSM) comparison groups will be formed-this statistical analysis will match up similar participants from each group to allow for comparison across conditions. PSM allows researchers to estimate differences between treatment and control groups in non-randomized samples. PSM will allow us to directly compare matched cases-meaning that the treatment and control groups will have a similar distribution of sociodemographic and sociocultural characteristics. This allows us to consider how outcomes vary between treatment and control groups, while accounting for the potential self-selection into different program groups. Participants will be matched across multiple metrics, including: racial/ethnic identity, sex/gender, income, education level, language of instruction, number of children, employment status, age, marital status, residential status, child sex, and child age. As clients may choose one program delivery modality over another due to work, childcare availability, or time, measures will be included for work schedule, availability of social support, work flexibility, and work-family stress.

Eligibility Criteria:
Inclusion Criteria:

* Adult over the age of 18 living in California and applying with their romantic partner

Exclusion Criteria:

* Domestic violence or child maltreatment is detected
* Active drug use
* Undiagnosed or untreated mental illness
* Anger management issues
* Pending legal action