Please note that the copy function is not enabled for this field.
If you wish to
modify
existing outcomes, please copy and paste the current outcome text into the Update field.
LOGIN
CREATE ACCOUNT
LOGIN
CREATE ACCOUNT
MY TRIALS
REGISTER TRIAL
FAQs
HINTS AND TIPS
DEFINITIONS
Trial Review
The ANZCTR website will be unavailable from 1pm until 3pm (AEDT) on Wednesday the 30th of October for website maintenance. Please be sure to log out of the system in order to avoid any loss of data.
The safety and scientific validity of this study is the responsibility of the study sponsor and investigators. Listing a study does not mean it has been endorsed by the ANZCTR. Before participating in a study, talk to your health care provider and refer to this
information for consumers
Download to PDF
Trial registered on ANZCTR
Registration number
ACTRN12624000641594
Ethics application status
Approved
Date submitted
3/05/2024
Date registered
20/05/2024
Date last updated
19/07/2024
Date data sharing statement initially provided
20/05/2024
Type of registration
Prospectively registered
Titles & IDs
Public title
Evaluating educational interventions to support safe use of ChatGPT for health: a randomised-controlled trial of ChatGPT users
Query!
Scientific title
Evaluating educational interventions to support safe use of ChatGPT for health: A randomised-controlled trial of ChatGPT users
Query!
Secondary ID [1]
311775
0
Nil
Query!
Universal Trial Number (UTN)
Query!
Trial acronym
Query!
Linked study record
Query!
Health condition
Health condition(s) or problem(s) studied:
general health (not specific to a health condition as this is health literacy skills research)
333282
0
Query!
Condition category
Condition code
Public Health
329974
329974
0
0
Query!
Health promotion/education
Query!
Intervention/exposure
Study type
Interventional
Query!
Description of intervention(s) / exposure
Participants will be randomly assigned to receive one of the interventions below, or the comparator.
1. Infographic style information about how to use ChatGPT safely for health questions available as image carousel within the online survey (time to view <5 mins)
2. Short (<5 min) animation about how to use ChatGPT safely for health questions
Content for both interventions covers the potential risks of using ChatGPT for health information, advice about which kinds of health questions may be less risky, and strategies for reducing these risks e.g. accessing multiple information sources.
For all intervention groups including comparator:
Delivered online via online survey in a single instance. Survey completion will be used to monitor adherence.
Time to complete survey is approx 15 minutes.
Query!
Intervention code [1]
328228
0
Behaviour
Query!
Comparator / control treatment
Participants will view an unrelated infographic (e.g. on healthy eating) available through the online survey software as an image.
Query!
Control group
Placebo
Query!
Outcomes
Primary outcome [1]
337735
0
Appropriate use of ChatGPT for health questions
Query!
Assessment method [1]
337735
0
performance-based assessment of whether the participant would try using or avoid using ChatGPT to answer a question (7 scenarios). This includes scenarios relating to asking ChatGPT to explain medical terms or concepts, describe treatment options, give treatment advice, interpret personal medical results, summarise other health information, diagnose based on personal symptoms. Scores for each questions will be combined into a composite measure of performance-based ChatGPT skills for health questions.
Query!
Timepoint [1]
337735
0
Single timepoint immediately after exposure to the intervention
Query!
Secondary outcome [1]
433005
0
Trust in ChatGPT
Query!
Assessment method [1]
433005
0
Likert scale "How much do you trust what ChatGPT says?" [Extremely to Not at all]
Query!
Timepoint [1]
433005
0
Single timepoint immediately after exposure to the intervention
Query!
Secondary outcome [2]
433009
0
Knowledge of ChatGPT
Query!
Assessment method [2]
433009
0
Participants answer questions about ChatGPT to provide a knowledge score, designed specifically for this study.
Query!
Timepoint [2]
433009
0
Single timepoint immediately after exposure to the intervention
Query!
Eligibility
Key inclusion criteria
Adults (18+) years, based in Australia, who self-report having used ChatGPT at least a few times in the past 6 months. A minimum 50% of participants will have less than university level of education
Query!
Minimum age
18
Years
Query!
Query!
Maximum age
No limit
Query!
Query!
Sex
Both males and females
Query!
Can healthy volunteers participate?
Yes
Query!
Key exclusion criteria
People who report that they have not used ChatGPT at least a few times in the past 6 months.
Query!
Study design
Purpose of the study
Educational / counselling / training
Query!
Allocation to intervention
Randomised controlled trial
Query!
Procedure for enrolling a subject and allocating the treatment (allocation concealment procedures)
central randomisation (Qualtrics platform)
Query!
Methods used to generate the sequence in which subjects will be randomised (sequence generation)
Simple randomisation using a randomisation table created by computer software (i.e. computerised sequence generation) - (Qualtrics platform Mersenne Twister, 1:1:1 ratio)
Query!
Masking / blinding
Blinded (masking used)
Query!
Who is / are masked / blinded?
The people assessing the outcomes
The people analysing the results/data
Query!
Query!
Query!
Query!
Intervention assignment
Parallel
Query!
Other design features
Query!
Phase
Not Applicable
Query!
Type of endpoint/s
Efficacy
Query!
Statistical methods / analysis
Statistical analysis will be conducted using planned contrasts between the two intervention arms and control arm, implemented in regression models. The influence of age, gender, language, education, health literacy, self-assessed health status, and the presence of pre-existing or chronic health conditions, will be examined by including appropriate interaction terms within the regression models. The total sample size required is 567. This is based on an expected small effect size of 0.15 for the primary outcome. The number of participants required per arm (3 arms), to provide 90% power at error type I (alpha of 0.05) is 189 (this is a balanced design).
Query!
Recruitment
Recruitment status
Recruiting
Query!
Date of first participant enrolment
Anticipated
5/07/2024
Query!
Actual
5/07/2024
Query!
Date of last participant enrolment
Anticipated
Query!
Actual
Query!
Date of last data collection
Anticipated
Query!
Actual
Query!
Sample size
Target
567
Query!
Accrual to date
28
Query!
Final
Query!
Recruitment in Australia
Recruitment state(s)
ACT,NSW,NT,QLD,SA,TAS,WA,VIC
Query!
Funding & Sponsors
Funding source category [1]
316107
0
Government body
Query!
Name [1]
316107
0
National Health and Medical Research Council
Query!
Address [1]
316107
0
Query!
Country [1]
316107
0
Australia
Query!
Primary sponsor type
University
Query!
Name
The University of Sydney
Query!
Address
Query!
Country
Australia
Query!
Secondary sponsor category [1]
318276
0
None
Query!
Name [1]
318276
0
Query!
Address [1]
318276
0
Query!
Country [1]
318276
0
Query!
Ethics approval
Ethics application status
Approved
Query!
Ethics committee name [1]
314940
0
The University of Sydney Human Research Ethics Committee
Query!
Ethics committee address [1]
314940
0
https://www.sydney.edu.au/research/research-integrity-and-ethics.html
Query!
Ethics committee country [1]
314940
0
Australia
Query!
Date submitted for ethics approval [1]
314940
0
Query!
Approval date [1]
314940
0
13/03/2024
Query!
Ethics approval number [1]
314940
0
Query!
Summary
Brief summary
ChatGPT is a publicly available AI chatbot that is free, easy to use and gives quick, human-like responses to user questions and requests. However, sometimes the information it gives is incorrect, missing key information, or unsafe. In this online study we want to test two social media interventions to see if they help people use ChatGPT more safely when asking health questions. Participants will be allocated to one of three groups: image carousel (instagram tiles), animation (short video) or control (health eating infographic). After viewing the intervention we will ask participants which kinds of questions they would try asking or avoiding asking ChatGPT.
Query!
Trial website
Query!
Trial related presentations / publications
Query!
Public notes
Query!
Contacts
Principal investigator
Name
133186
0
Dr Julie Ayre
Query!
Address
133186
0
Edward Ford Building (A27), Physics Rd, The University of Sydney , NSW 2006
Query!
Country
133186
0
Australia
Query!
Phone
133186
0
+61 293517789
Query!
Fax
133186
0
Query!
Email
133186
0
[email protected]
Query!
Contact person for public queries
Name
133187
0
Julie Ayre
Query!
Address
133187
0
Edward Ford Building (A27), Physics Rd, The University of Sydney , NSW 2006
Query!
Country
133187
0
Australia
Query!
Phone
133187
0
+61 293517789
Query!
Fax
133187
0
Query!
Email
133187
0
[email protected]
Query!
Contact person for scientific queries
Name
133188
0
Julie Ayre
Query!
Address
133188
0
Edward Ford Building (A27), Physics Rd, The University of Sydney , NSW 2006
Query!
Country
133188
0
Australia
Query!
Phone
133188
0
+61 293517789
Query!
Fax
133188
0
Query!
Email
133188
0
[email protected]
Query!
Data sharing statement
Will individual participant data (IPD) for this trial be available (including data dictionaries)?
Yes
Query!
What data in particular will be shared?
deidentified data underlying published results
Query!
When will data be available (start and end dates)?
available after publication of the manuscript, no end date to when the data will no longer be available.
Query!
Available to whom?
anyone who wishes to access it
Query!
Available for what types of analyses?
any
Query!
How or where can data be obtained?
publicly available data (email principal investigator
[email protected]
)
Query!
What supporting documents are/will be available?
No Supporting Document Provided
Results publications and other study-related documents
Documents added manually
No documents have been uploaded by study researchers.
Documents added automatically
No additional documents have been identified.
Download to PDF