Research and evaluation
Research and evaluation
Evaluation in 2019/20
Counselling, family dispute resolution and Family Relationship Centres
We evaluated our funded counselling, family dispute resolution (FDR) and Family Relationship Centre services in 2020 through Standard Client Outcomes Reporting (SCORE). Evaluations from over 4600 clients indicated that overwhelmingly, these services support clients to feel listened to and understood, and work on and talk about what is important to them. Clients also reported significant satisfaction with the services provided.
- 98.7 per cent of clients felt listened to and understood.
- 97.7 per cent of clients were satisfied with the counselling, FDR and Family Relationship Centre services that they received.
- 98.7 per cent of clients reported that they felt better able to deal with the issues for which they sought help.
Continuous evaluation of other programs
We continue to evaluate our I like, like you program, Family Safety Navigation Program, and AccessResolve Property Mediation and conciliation service, with positive outcomes reported by the majority of clients accessing these services.
COVID-19 counselling and FDR survey
In April and May 2020, we surveyed clients in our counselling and FDR services about the impact of COVID-19 on family and household relationships, as well as the satisfaction and outcomes of the service received – particularly with respect to the telephone and video service modalities used during the pandemic. These were associated with strong service satisfaction.
- Over 82 per cent of FDR and 88 per cent of counselling clients reporting that their practitioner listened to them and understood their issues.
- More than 87 per cent of counselling clients reported that they were satisfied with the service they received.
In late 2019, we concluded a three-year mixed-method approach evaluation of our early matters program. The evaluation involved a combination of validated and fit-for-purpose tools combining qualitative and quantitative data, including pre- and post-program surveys to assess and measure outcomes.
- The Home Visiting Service was associated with a 27 per cent reduction in the impact of significant issues on families, and a 30 per cent reduction in how stressed families were about their presenting issues.
- The vast majority of teachers felt confident that their students would be able to develop healthier relationships following early matters children’s group programs.
- Programs for parents were associated with increases in confidence with self-care and seeking support, and increased parental confidence in parental attachment with their new baby.
Support for Fathers
Results from our Support for Fathers project evaluation found that the practitioners were better equipped to support fathers after attending our workplace training program, with an 11 per cent statistically significant increase in confidence to engage dads in services, and a 15 per cent increase in practitioners feeling that they had the skills and knowledge to successfully engage with dads. Of fathers who attended our community information sessions, 85 per cent agreed that the session was relevant to them as a dad.
Tuning in to Teens
As part of a collaborative initiative with the Yarra Communities that Care initiative, RAV leads the coordination and delivery of the evidence-based program, Tuning in to Teens. An evaluation of the activities in 2019/20 indicates strong positive outcomes for participants.
- 100 per cent of respondents were satisfied with the program.
- 94.73 per cent of participants were doing things differently as a parent following the program.
- 84.2 per cent of participants had increased confidence in responding to their children’s emotions.
- 73.7 per cent felt they had increased connectedness with children.
Research in 2019/20
The effectiveness of men’s behaviour change programs
Research into our MBCPs continued in 2019/20, in partnership with Monash University’s Monash Centre for Health Research and Implementation (MCHRI). The research stemmed from the recommendations of the Royal Commission into Family Violence (Victoria), which highlighted the urgent need for MBCPs to be examined. Our joint rapid review of the content, implementation and impacts of the programs on participants and family outcomes internationally was published in a leading international family violence journal, Trauma, Violence & Abuse.
The findings of the review indicated a limited evidence base of detailed MBCP evaluations, and the information relating to program content covered a wide range of topics not documented in the research. Evaluations that were existing, however, indicated that positive changes were reported in relation to participants’ communication, parenting, interpersonal relationships, empathy, skills development, responsibility for behaviour, self-awareness and cognitive beliefs – as well as their aggression, abuse, power and control tactics, behaviour control and abusiveness patterns. No evaluations examined the links between men’s accountability and responsibility for the safety and wellbeing of women and children. The review also revealed a lack of implementation evaluations, and no assessments of the integrity of program delivery, system processes or evaluations based on program logics.
As a result of this review, a detailed program logic and evaluation plan was developed to enable RAV’s MBCPs to be examined, with 60 program participants and 19 RAV facilitators and family support contact service staff participating in the research.
Following an MBCP, men reported significant improvements in their belief to be able to manage stressful times; understanding of the impact of their use of violence; and their skills to repair the impact of their use of violence on their partner/former partner, children and family members.
Trends in the data showed improvements in the men’s understanding of their own emotional and mental health, understanding of their partner/former partner and family members’ needs and feelings, relationships with their partners/former partners and family members, and understanding that their behaviour in relationships could improve. But, in relation to their children’s needs and feelings, and the impact of their violence on children, responses from men indicated that further attention is needed on how to deliver MBCPs that promote the safety, development and wellbeing of children.
Overall, program facilitators reported the program positively impacted 43 per cent of men, who experienced significant improvements recording changes in their attitudes, levels of accountability and responsibility, and active use of strategies learned in the program.
The research has resulted in recommendations for current and future attention on the further development of MBCPs, staff engagement and additional research into the impact of the programs.
The RA FDR Outcomes Study, which was jointly led by RAV and RA Queensland, was completed this year. RAV led the property component of this national study, which involved collecting survey data at multiple points in time from 1,695 clients across Australia. Interviews with 200 of these clients generated evidence on the outcomes of RA FDR services in both parenting and property disputes.
RAV prepared a qualitative paper to be submitted to a peer-reviewed journal that presents client views on the advantages and disadvantages of FDR for property matters, compared to legal methods. While most participants choosing FDR for property matters primarily wanted to avoid the increased costs, stress and levels of acrimony associated with legal processes, many also identified benefits of the mediation process, itself, as key to their choice. These benefits included facilitating communication, both during and outside FDR, and having a skilled and impartial third party to direct negotiations and control emotion.
One of two other papers submitted to the Journal of Family Studies uses interview data to assess reasons for the low use of FDR for property matters in Australia, given the benefits cited above. Among 112 interviewees who had hoped to use FDR to resolve their property matters, only 37 per cent were able to make a serious attempt at a property settlement. The most common reason for participants’ inability to progress with property negotiations was an unwilling former partner. The paper suggests that making FDR mandatory before filing to the court for property matters, as is the case for parenting matters, would increase the likelihood that separating couples can negotiate their disputes; therefore, improving adjustment to separation for both former partners and their children.
Further papers are being prepared by RAV, including for the Australian Institute of Family Studies Conference. A quantitative paper on measuring FDR outcomes will also demonstrate that the benefits of FDR for both parenting and property clients extend beyond reaching agreements, to reducing psychosocial distress and improving adjustment to separation.
In late 2018, Relationships Australia released research entitled Is Australia experiencing an epidemic of loneliness? which identifies which Australians are most likely to feel lonely and socially isolated, and when. The research, which is based on the findings from 16 waves of Household Income and Labour Dynamics of Australia survey data from 2001-2016, reveals that one in 10 Australians lack social support and one in six is experiencing emotional loneliness.
The role and effectiveness of separation-related smartphone apps. (2019-20). Relationships Australia Victoria, Relationships Australia Canberra and Region, Australian National University.
In 2019/20, RAV partnered with high-profile academics at the Australian National University and colleagues at RA Canberra and Region, to apply for an Australian Research Council Linkage Grant.
The proposed study, which would run for two years, aims to examine the role and effectiveness of separation-related smartphone apps in supporting families to respond to the many challenges of post-separation co-parenting. In an increasingly digital landscape, where poor choices of apps can have serious consequences for families, this knowledge is urgently needed by parents and family law practitioners, including FDR practitioners, to provide an evidence base for recommendations regarding the use of such technologies. The COVID-19 pandemic further highlights the need for access to effective and safe digital communication tools.
The use and misuse of communication technologies in post-separation parenting. (2019-20). Relationships Australia Victoria, Victoria University.
Our collaborative relationship with Victoria University continued in 2019/20 as a study of the use and misuse of communication technologies in post-separation parenting. This year, we completed the first phase of this project, which was a prevalence survey of separated parents attending RAV’s FRCs about their use of 11 different kinds of technology including email, SMS, instant messenger, social networking sites, online learning and video calls.
Relationships Australia Monthly Surveys
Each month Relationships Australia conducts an online survey to capture the Australians' views and opinions on relationship, social and current community issues and concerns. New surveys and summaries of previous survey results are available on the Relationships Australia National website.
My Service, My Story
In 2016/17, our Kew Centre participated in a nationwide Department of Social Services Data Exchange Client Survey pilot project, designed to independently measure outcomes for, and satisfaction of, clients in core, funded services, through online client surveys. Responses and feedback from the project will inform the implementation of a longer-term evaluation project.
Fathering, family and domestic violence and intervention challenges
We are one of 23 government and non-government organisations taking part in the Australian Research Council-funded four-year research project, led by the University of Melbourne and also involving researchers from the universities of South Australia and Western Australia. The project's ultimate aim is to improve the parenting experience of children whose fathers have used domestic and family violence.
Family violence and the FDR process
The outcomes of our four-year study with La Trobe University, funded by the Australian Research Council, into the impact of family violence on the FDR process has been disseminated and discussed, including through the publication of a peer-reviewed research paper in the Australian Institute of Family Studies Family Matters journal.
The research has attracted international interest, including from academic institutions and policy-makers, and it continues to influence models of practice for working with clients affected by family violence.
Loneliness in older adults
We have partnered with Swinburne University of Technology to investigate loneliness in older adults in residential aged care and community settings, through the university's Wellbeing Clinic for Older Adults. The project seeks to better understand the prevalence of loneliness, and the predictors of loneliness and emotional wellbeing among older adults. The project's findings will assist counsellors and other health professionals to develop more specific interventions to prevent the negative health consequences associated with loneliness.
FDR Outcome Measurement Trial
Through our membership of the Partnership of Victorian Family Relationship Centres, RAV is participating in an FDR Outcome Measurement Trial, funded by the Attorney-General's Department and the Department of Social Services. The pilot project seeks to identify or develop a tool that measures the parenting outcomes of FDR, such as the development of parenting plans, increased parental awareness of the impact of conflict on children and a reduced need for litigation or the involvement of lawyers.
In 2016/17, we engaged with RMIT's Centre for Innovative Justice to undertake research on perpetrator interventions in the criminal justice system. This research will help the sector to better understand and establish an evidence base for interventions with men who use violence.
ARC research projects
RAV has been involved in major projects funded by the Australian Research Council (ARC), reaffirming our commitment to research to better inform our clinical practice and service delivery.
The long-term benefits of counselling and group courses
RAV has completed a three-year research project with La Trobe University to investigate the long-term benefits of couple counselling and our Good Connecting relationship education course. In addition to producing better outcomes for our clients, this significant study will have national and international impact upon the practice of couple counselling and relationship education.
Diversity in Australian life
The Work, Love and Play in Diverse Australian Family Life project ran in partnership with Relationships Australia National, the University of Melbourne, La Trobe University and The Bouverie Centre.
The five-year study examined same-sex parenting and children's outcomes. It provides a broad and in-depth examination of a variety of factors that can impact on child outcomes: how parents balance their working commitments and domestic arrangements; characteristics and quality of the parents' relationship and how they parent together; and the family's social, financial and practical resources and social networks.
Collaboration in the mental health sector
We researched the systemic, organisational and individual factors that optimise or impede effective collaboration. The research aimed to develop evidence-based guidelines for achieving effective collaboration, and the identification of knowledge gaps and areas for future research.
Social media and relationships
In partnership with Victoria University, and with support from their Centre for Cultural Diversity and Wellbeing, we completed research into the effect of social media engagement on relationship satisfaction in 2016. The findings illustrated that relationship satisfaction is impacted by how, rather than how often, social media is used.
The effectiveness of Men’s Behaviour Change Programs (MBCPs)
In 2016, we undertook a literature review into the most current research on the efficacy of MBCPs. This review forms the foundation of a significant wider research project to evaluate the effectiveness of MBCPs, led by RAV and involving Relationships Australia South Australia and Relationships Australia Western Australia.
Relationships Indicators Survey: 2011 results
In 2011, Relationships Australia National surveyed the population to find out what the main issues and concerns that Australians had in their relationships at the time.
View the results of the 2011 survey, undertaken in partnership with Credit Union Australia and conducted by Woolcott Research across Australia.
Dads and kids
RAV partnered with primary schools, kindergartens and maternal and child health centres to run programs for fathers and children called Fathers Utilising Networks for Kids (FUN for Kids). These programs allowed fathers to examine their parenting styles, establish networks, have more effective communication with their kids, share with other dads and have fun. FUN for Kids is not currently being run.
The Potter Foundation funded an independent evaluation of the program by the Australian Institute of Family Studies (AIFS). The final report indicates some very positive outcomes for dads, partners, children and communities.