Trial Review

The safety and scientific validity of this study is the responsibility of the study sponsor and investigators. Listing a study does not mean it has been endorsed by the ANZCTR. Before participating in a study, talk to your health care provider and refer to this information for consumers
Trial registered on ANZCTR


Registration number
ACTRN12620001224910
Ethics application status
Approved
Date submitted
8/09/2020
Date registered
16/11/2020
Date last updated
16/11/2020
Date data sharing statement initially provided
16/11/2020
Date results information initially provided
16/11/2020
Type of registration
Retrospectively registered

Titles & IDs
Public title
Wellbeing Track & Change: Usability and evaluation of Workplace Wellbeing Assist, a digital tool for the mental wellbeing of residential aged care workers
Scientific title
Wellbeing Track & Change: Usability and evaluation of Workplace Wellbeing Assist, a digital tool for the mental wellbeing of residential aged care workers
Secondary ID [1] 300090 0
None
Universal Trial Number (UTN)
U1111-1245-3862
Trial acronym
Linked study record

Health condition
Health condition(s) or problem(s) studied:
Workplace mental wellbeing 318476 0
Condition category
Condition code
Public Health 316476 316476 0 0
Health promotion/education
Mental Health 316533 316533 0 0
Studies of normal psychology, cognitive function and behaviour

Intervention/exposure
Study type
Interventional
Description of intervention(s) / exposure
This aim of this project is to develop and evaluate a digital monitoring and decision support tool (Workplace Wellbeing Assist [WWA]) for use in residential aged care (RAC) facilities. WWA is designed to enhance the workplace culture and mental wellbeing of direct-care staff, however it is not a diagnostic tool. The project will be undertaken at a RAC facility located in the Barwon South West region of Victoria, Australia. The project involves 2 stages: (1) a 2-week unmoderated usability trial of WWA, and (2) a 24-week, in-situ evaluation trial of WWA.

Usability trial
Materials: WWA will be available to participants to use over a 2-week period via the internet on their mobile, tablet or computer.

Procedures: Up to 10 participants will be recruited from a RAC facility participating in the project or the general public. Interested individuals will be emailed a Plain Language Information Statement (PLIS) and consent form (CF). Upon receipt of the CF, the participant will be given a username and password to access WWA for up to 2-weeks. They will be asked to test as many components of the digital tool as possible (i.e., the Resource Library), noting any problems encountered. For the duration of the usability trial, WWA will be pre-populated with dummy data to allow the participant to view and interact with the features of the digital tool.

Following the 2-week usability trial period, a recorded semi-structured interview will be conducted with RAC participants. An interview will be conducted via the telephone, Skype or Zoom and will take approx. 30-45 minutes. General public participants will complete an online questionnaire via Survey Monkey which will take approx. 15 minutes, depending on how much feedback is provided. Participants will be nominally reimbursed with a $10 Woolworths gift card.

Frequency of use: Participants will have up to 2-weeks to access WWA during the usability trial. They will be free to access and spend as much time using the digital tool as they choose during the usability trial period. It is expected that they will spend a maximum of 2 hours testing the digital tool.

Data collected from the interviews and online questionnaires will be de-identified and reviewed for any problems encountered with WWA or the resources (i.e., videos not playing, broken links). These problems will then be corrected prior to the commencement of the evaluation trial.


Evaluation trial
Materials: WWA will be available to participants to use via the internet on their preferred device wherever they have internet connection.

Procedures: For the evaluation to proceed at a facility, two conditions must be met: (1) a RAC manager must first be recruited to the study, and (2) a minimum of five direct-care workers must be recruited to the study. Managers and direct-care staff will be sent an invitation to participate in the evaluation to their RAC work email account.

Upon completion of a set of mandatory pre-evaluation questionnaires, direct-care participants will have immediate access to WWA. Each time they login to WWA, they will have the option of completing a brief Workplace Wellbeing Survey (WWS). Participants will be encouraged to complete the survey on a fortnightly basis; however, they will be free to do so more or less often. The WWS consists of 10-items, six workplace-related items (e.g., job control) and four personal wellbeing items (e.g., ‘How satisfied do you feel with your life?’). Each item is answered on a 5-point Likert-style scale from ‘Not at all’ to ‘Completely’ and participants are asked to answer each item in relation to the past week. If a participant responds to a workplace-related item with ‘Not at all’ or ‘A little’, the question will expand to provide the participant with additional contextual responses to that item (e.g., I had little or no say over the way I do my job). These questions may take up to three minutes to complete, although it is expected that they will take less time across the evaluation period as participants become familiar with the questions.

Direct-care staff will receive confidential and personalised feedback displayed on their WWA dashboard, based on a composite, aggregate score calculated from their responses to the four personal wellbeing survey items (in real-time). Based on participants aggregated score, they will be recommended three tailored resources (from a selection of 16 resources) via their WWA dashboard to assist their personal mental wellbeing. Resource topics include Effective Communication, Time Management, Strengths Building, Managing Worry, and Practising Gratitude. Each resource is structured in the same way with a topic-related image, three questions to help the participant decide if the resource maybe helpful to them, and four sections covering what the topic is, why it is important, practical advice and links to external credible external sources (i.e., Beyond Blue, Black Dog Institute) where the participant can learn more about the topic, or access practical tools (i.e., worksheets). All resources can be accessed at any time from a Resource Library located on the dashboard. In addition, participants will have access to two videos (each less than two minutes) on how to use and understand WWA, and two further text-based resources on the mental health continuum and mentally healthy workplace. Participants will also be able to monitor their personal wellbeing over time via a trendline graph displayed on their dashboard. The trendline is updated live upon each WWS completion.

Each fortnight, managers participating in the evaluation will have access to a dashboard that will display aggregated and non-identifiable staff scores from the WWS, as well as the secondary responses selected in relation to the workplace-related items. To assist managers to take action, WWA includes a resource tailored for each of the six workplace-related items. The management resources contain an (up to 60 second) animated video summarising the topic and the same four sections as noted for the personal wellbeing resources above. In addition, each resource includes questions to help the manager consider the topic in relation to their workplace and where they may need to take action. Managers also have access to two videos (each less than two minutes) on how to use WWA and how to interpret direct-care staff wellbeing scores. In addition, managers will have access to the full Resource Library, including the 16 personal wellbeing resources and the two text-based resources (mental health continuum and mentally healthy workplace) made available to direct care staff.

The manager dashboard and direct care staff dashboard are separate on WWA and neither has access to the other. Overall, accessing the resources, how often and how long, is up to the participant (direct care and manager). However, it is expected that the text-based resources will take approximately 15 minutes to read, plus additional time should the participant choose to work through any of the practical suggestions or access the external links.

Following their first login to WWA, direct care staff will be presented with a PLIS, if upon reading the PLIS they decide to participate, they click on an ‘I agree with the above conditions’ button and will then be required to create an account by submitting a strong password. Direct care participants will then complete demographic items (at Week 0), and three sets of online questionnaires designed to measure changes in the workplace climate and staff mental wellbeing (at Week 0, Week 12, and Week 24). The questionnaires will take approximately 20-30 minutes to complete. Direct care participants will also complete a System Usability Scale two weeks into the evaluation.

Managers interested in the evaluation will be sent a PLIS and CF to their RAC workplace email account. Upon receipt of their CF, the manager will be directed to complete demographic items online (via Survey Monkey). Managers will then be provided with a link to WWA and be required to create an account by submitting a strong password, following which they will have immediate access to WWA. They will not complete any further questionnaires.

At Week 12, participants (direct care and managers) will be invited to participate in a recorded, one-to-one semi-structured interview via telephone, Zoom or Skype. Interviews will be conducted with the first participants to respond to an email invitation (up to N=15). The interviews will take up to 60 minutes and will allow participants to provide feedback on the acceptability, usability and usefulness or WWA. Interview participants will be nominally reimbursed with a $10 Woolworths gift card for their time.

Frequency of use: The evaluation trial will be conducted across a 24-week period. It will be recommended that direct-care participants use WWA on a regular basis to monitor their mental wellbeing and to complete the Workplace Wellbeing Survey on at least a fortnightly basis. Managers will be advised to monitor the management dashboard on at least a fortnightly basis to review the updated, aggregated data.

Usage data will be collected from WWA, such as number of logins, how many times the WWS was completed, and which and how many resources were accessed and for how long. All data collected from the evaluation trial will be de-identified prior to any analysis.

Adherence: Regular use of WWA will be encouraged for direct-care staff and mangers to achieve maximum benefit in assisting to create a mentally healthy workplace culture. Push notifications and email reminders will be sent to direct-care staff if they have not completed the Workplace Wellbeing Survey for two weeks or more. Managers will be sent fortnightly reminders announcing that new aggregate data is available for their review and action where required.
Intervention code [1] 318251 0
Prevention
Intervention code [2] 318441 0
Lifestyle
Comparator / control treatment
No control group
Control group
Uncontrolled

Outcomes
Primary outcome [1] 324660 0
The Psychosocial Safety Climate (PSC-12) mean score will measure change in perceptions of psychosocial safety climate in the workplace.
Timepoint [1] 324660 0
RAC direct care participants will complete the PSC-12 at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24)(primary timepoint)..
Secondary outcome [1] 385351 0
The Kessler Psychological Distress Scale (K10) will measure changes in psychological distress.
Timepoint [1] 385351 0
RAC direct care participants will complete the K10 at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24).
Secondary outcome [2] 385352 0
The Mental Health Continuum - Short Form (MHC-SF) will measure changes in mental wellbeing.
Timepoint [2] 385352 0
RAC direct care participants will complete the MHC-SF at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24).
Secondary outcome [3] 385365 0
The Australian Quality of Life - 4D (AQoL-4D) will measure changes in quality of life.
Timepoint [3] 385365 0
RAC direct care participants will complete the AQoL-4D at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24).
Secondary outcome [4] 385366 0
The Copenhagen Psychosocial Questionnaire - II (COPSOQ-II) will measure changes in perceptions of workplace psychosocial risk factors.
Timepoint [4] 385366 0
RAC direct care participants will complete COPSOQ-II at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24).
Secondary outcome [5] 385375 0
The People at Work Survey - bullying module (PAW) will measure changes in perceptions of workplace psychosocial risk factors.
Timepoint [5] 385375 0
RAC direct care participants will complete this questionnaire at three time-points: pre-evaluation (Week 0), mid-evaluation (Week 12), and post-evaluation (Week 24).
Secondary outcome [6] 385408 0
The System Usability Scale (SUS) will measure the usability and accessibility of WWA.
Timepoint [6] 385408 0
RAC direct care participants will complete the SUS 2-weeks after completing the pre-evaluation questionnaires.
Secondary outcome [7] 385424 0
The semi-structured interviews (evaluation trial) are designed to elicit in-depth feedback from participants on the feasibility of using WWA.
Timepoint [7] 385424 0
Semi-structured interviews will be conducted with RAC managers and direct care participants at mid-evaluation (Week 12). Up to 15 interviews will be conducted.
Secondary outcome [8] 385744 0
The semi-structured interviews (usability trial) are designed to elicit feedback from participants on the feasibility of using WWA, with a particular focus on identifying any technical bugs, usability issues, or content issues that can be rectified prior to the commencement of the evaluation trial.
Timepoint [8] 385744 0
Semi-structured interviews will be conducted with RAC participants following the end of a 2-week unmoderated usability trial.
Secondary outcome [9] 385745 0
The online usability trial questionnaire is designed to elicit feedback from participants on the feasibility of using WWA, with a particular focus on identifying any technical bugs, usability issues, or content issues that can be rectified prior to the commencement of the evaluation trial.
Timepoint [9] 385745 0
Non-RAC participants will complete an online questionnaire following the end of a 2-week unmoderated usability trial.

Eligibility
Key inclusion criteria
Usability trial - Participants can either be an employee of an RAC facility involved with this project or a member of general public. Participants must be 18 years of age or older.

Evaluation trial - Participants are required to be a manager or direct-care worker employed on a part time or full time basis at a RAC facility involved with this project. Participants must be 18 years of age or older.
Minimum age
18 Years
Maximum age
No limit
Sex
Both males and females
Can healthy volunteers participate?
Yes
Key exclusion criteria
RAC staff employed on a casual basis.

Study design
Purpose of the study
Prevention
Allocation to intervention
Non-randomised trial
Procedure for enrolling a subject and allocating the treatment (allocation concealment procedures)
Methods used to generate the sequence in which subjects will be randomised (sequence generation)
Masking / blinding
Open (masking not used)
Who is / are masked / blinded?



Intervention assignment
Single group
Other design features
Phase
Not Applicable
Type of endpoint/s
Efficacy
Statistical methods / analysis
Evaluation trial - Assuming a conservative small effect (i.e. GPower f test = 0.15), the significance level was set at 5% (p = 0.05), power at 80%, a sample of 46 will be required to demonstrate statistical significance on the primary outcome measure (PSC-12). However, allowing for a 30% attrition rate, we will be required to recruit N=66 participants.

Quantitative data will be analysed using mixed-model analysis and and qualitative data will be analysed using thematic analysis.

Recruitment
Recruitment status
Active, not recruiting
Date of first participant enrolment
Anticipated
Actual
22/06/2020
Date of last participant enrolment
Anticipated
Actual
31/08/2020
Date of last data collection
Anticipated
15/03/2021
Actual
Sample size
Target
76
Accrual to date
Final
8
Recruitment in Australia
Recruitment state(s)
VIC

Funding & Sponsors
Funding source category [1] 304536 0
Government body
Name [1] 304536 0
WorkSafe - WorkWell Mental Health Improvement Fund
Country [1] 304536 0
Australia
Primary sponsor type
Charities/Societies/Foundations
Name
Prevention United
Address
552 Victoria St, North Melbourne VIC 3051
Country
Australia
Secondary sponsor category [1] 306936 0
None
Name [1] 306936 0
Address [1] 306936 0
Country [1] 306936 0
Other collaborator category [1] 281420 0
University
Name [1] 281420 0
Federation University Australia
Address [1] 281420 0
University Drive, Mt Helen VIC 3350
Country [1] 281420 0
Australia
Other collaborator category [2] 281421 0
Government body
Name [2] 281421 0
Ballarat Health Services - Residential Aged Care Services
Address [2] 281421 0
907 Sturt Street, Ballarat VIC 3350
Country [2] 281421 0
Australia

Ethics approval
Ethics application status
Approved
Ethics committee name [1] 304965 0
Federation University Australia Human Research Ethics Committee
Ethics committee address [1] 304965 0
University Drive, Mt Helen, 3350 Victoria.
Ethics committee country [1] 304965 0
Australia
Date submitted for ethics approval [1] 304965 0
20/03/2020
Approval date [1] 304965 0
03/04/2020
Ethics approval number [1] 304965 0
A20-21
Ethics committee name [2] 306640 0
Barwon Health Human Research Ethics Committee
Ethics committee address [2] 306640 0
PO Box 281, Geelong VIC 3220
Ethics committee country [2] 306640 0
Australia
Date submitted for ethics approval [2] 306640 0
22/05/2020
Approval date [2] 306640 0
28/05/2020
Ethics approval number [2] 306640 0
20/96

Summary
Brief summary
The aim of this project is to develop and evaluate whether a digital monitoring and support tool, called Workplace Wellbeing Assist (WWA), is effective in promoting a workplace culture that enhances the mental wellbeing of RAC staff working at a facility located in the Barwon South West region of Victoria, Australia. Direct care staff, managers and the general public will first be invited to participate in a 2-week unmoderated usability trial of WWA to test the digital tool and determine whether there are any problems. Direct care workers and managers will then be invited to participate in a 24-week in-situ evaluation of WWA.

Specifically, this project seeks to:
(1) Determine whether WWA increases perceptions of psychosocial safety in the RAC workplace from pre- (week 0), to mid- (week 12), to post-evaluation (week 24).
(2) Determine whether WWA can successfully promote RAC direct care workers’ mental wellbeing and quality of life, and reduce psychological distress and workplace risk factors from pre- (week 0), to mid- (week 12), to post-evaluation (week 24).
(3) Use quantitative and qualitative evaluation data to further explore the acceptability, usability, and usefulness of WWA, and to allow for future optimisation of WWA in the RAC sector.

The results of this research will be used to determine whether a digital intervention can effectively promote a mentally healthy workplace that enhances staff mental wellbeing within RAC facilities and how it could potentially be optimised for other workplaces.
Trial website
Trial related presentations / publications
Public notes

Contacts
Principal investigator
Name 98790 0
Prof Britt Klein
Address 98790 0
Federation University
University Drive, Mt Helen Campus, Victoria, 3350
Country 98790 0
Australia
Phone 98790 0
+61 3 5327 6717
Fax 98790 0
Email 98790 0
[email protected]
Contact person for public queries
Name 98791 0
Dr Wendi Kruger
Address 98791 0
Federation University
University Drive, Mt Helen Campus, Victoria, 3350
Country 98791 0
Australia
Phone 98791 0
+61 3 5327 6524
Fax 98791 0
Email 98791 0
[email protected]
Contact person for scientific queries
Name 98792 0
Prof Britt Klein
Address 98792 0
Federation University
University Drive, Mt Helen Campus, Victoria, 3350
Country 98792 0
Australia
Phone 98792 0
+61 3 5327 6717
Fax 98792 0
Email 98792 0
[email protected]

Data sharing statement
Will individual participant data (IPD) for this trial be available (including data dictionaries)?
Yes
What data in particular will be shared?
Relevant de-identified individual participant data collected during the usability and evaluation trial.
When will data be available (start and end dates)?
Data will be available following publication of the final results from this study (not determined) with the end date 5 years post-publication.
Available to whom?
Case-by-case basis at the discretion of the Principal Investigator.
Available for what types of analyses?
Case-by-case basis at the discretion of the Principal Investigator.
How or where can data be obtained?
Access subject to approval by the Principal Investigator (Prof Britt Klein), followed by submission to the Ethical Review Committee to access the de-identified data and approval granted. The Principal Investigator can be contacted via email: [email protected]


What supporting documents are/will be available?

No Supporting Document Provided



Results publications and other study-related documents

Documents added manually
No documents have been uploaded by study researchers.

Documents added automatically
No additional documents have been identified.