Please note that the copy function is not enabled for this field.
If you wish to
modify
existing outcomes, please copy and paste the current outcome text into the Update field.
LOGIN
CREATE ACCOUNT
LOGIN
CREATE ACCOUNT
MY TRIALS
REGISTER TRIAL
FAQs
HINTS AND TIPS
DEFINITIONS
Trial Review
The ANZCTR website will be unavailable from 1pm until 3pm (AEDT) on Wednesday the 30th of October for website maintenance. Please be sure to log out of the system in order to avoid any loss of data.
The safety and scientific validity of this study is the responsibility of the study sponsor and investigators. Listing a study does not mean it has been endorsed by the ANZCTR. Before participating in a study, talk to your health care provider and refer to this
information for consumers
Download to PDF
Trial registered on ANZCTR
Registration number
ACTRN12613001146785
Ethics application status
Approved
Date submitted
13/10/2013
Date registered
15/10/2013
Date last updated
17/03/2016
Type of registration
Prospectively registered
Titles & IDs
Public title
Consistency of Assessor Scoring on the Direct Observation of Procedural Skills Form
Query!
Scientific title
Do assessors using the Australian and New Zealand Direct Observation of Procedural Skills form for regional anaesthesia achieve consistency and reliability?
Query!
Secondary ID [1]
283394
0
nil
Query!
Universal Trial Number (UTN)
U1111-1149-0810
Query!
Trial acronym
Query!
Linked study record
Query!
Health condition
Health condition(s) or problem(s) studied:
Reliability of the Direct Observation of Procedural Skills Form
290291
0
Query!
Condition category
Condition code
Anaesthesiology
290689
290689
0
0
Query!
Anaesthetics
Query!
Public Health
290700
290700
0
0
Query!
Other public health
Query!
Intervention/exposure
Study type
Observational
Query!
Patient registry
False
Query!
Target follow-up duration
Query!
Target follow-up type
Query!
Description of intervention(s) / exposure
An observational study of consistency and reliability of scoring regional anaesthesia performance on the Direct Observation of Procedural Skills form.
ANZCA Fellows will be recruited and asked to view and score 2 videos of regional anaesthesia block performance. These are scripted videos of actors roleplaying the trainee, anaesthetic assistant, and patient. The process is contained in a 1.5 hour session.
The scores are based on the DOPS form introduced in the ANZCA new curriculum commencing 2013. The results from all participants are analysed to estimate the degree of reliability by using measures of correlation.
Query!
Intervention code [1]
288119
0
Not applicable
Query!
Comparator / control treatment
No control
Query!
Control group
Uncontrolled
Query!
Outcomes
Primary outcome [1]
290703
0
Correlation of scores across all assessors completing the Direct Observation of Procedural Skills form
Query!
Assessment method [1]
290703
0
Query!
Timepoint [1]
290703
0
after all assessors view an instance of regional anaesthesia performance by a trainee
Query!
Secondary outcome [1]
305070
0
Correlation of scores across all assessors completing the Direct Observation of Procedural Skills form
Query!
Assessment method [1]
305070
0
Query!
Timepoint [1]
305070
0
after all assessors view the second instance of regional anaesthesia performance by a separate trainee
Query!
Eligibility
Key inclusion criteria
Assessors are Fellows of the Australian and New Zealand College of Anaesthetists
Query!
Minimum age
18
Years
Query!
Query!
Maximum age
No limit
Query!
Query!
Sex
Both males and females
Query!
Can healthy volunteers participate?
Yes
Query!
Key exclusion criteria
Those declining participation in study
Query!
Study design
Purpose
Screening
Query!
Duration
Cross-sectional
Query!
Selection
Convenience sample
Query!
Timing
Prospective
Query!
Statistical methods / analysis
Measures of correlation using intra-rater correlation coefficient and Chronbach's alpha analysis
Query!
Recruitment
Recruitment status
Completed
Query!
Date of first participant enrolment
Anticipated
25/02/2014
Query!
Actual
25/02/2014
Query!
Date of last participant enrolment
Anticipated
Query!
Actual
30/04/2014
Query!
Date of last data collection
Anticipated
Query!
Actual
Query!
Sample size
Target
40
Query!
Accrual to date
Query!
Final
54
Query!
Recruitment in Australia
Recruitment state(s)
NSW
Query!
Recruitment outside Australia
Country [1]
5496
0
New Zealand
Query!
State/province [1]
5496
0
North Island
Query!
Funding & Sponsors
Funding source category [1]
288116
0
Self funded/Unfunded
Query!
Name [1]
288116
0
Query!
Address [1]
288116
0
Query!
Country [1]
288116
0
Query!
Primary sponsor type
University
Query!
Name
Macquarie University
Query!
Address
2 Technology Place
Macquarie University
NSW 2109
Query!
Country
Australia
Query!
Secondary sponsor category [1]
286837
0
None
Query!
Name [1]
286837
0
Query!
Address [1]
286837
0
Query!
Country [1]
286837
0
Query!
Ethics approval
Ethics application status
Approved
Query!
Ethics committee name [1]
290039
0
Macquarie University HREC (Human Sciences)
Query!
Ethics committee address [1]
290039
0
Ethics Secretariat Research Office Level 3, Research Hub Building C5C East Macquarie University NSW 2109
Query!
Ethics committee country [1]
290039
0
Australia
Query!
Date submitted for ethics approval [1]
290039
0
28/10/2013
Query!
Approval date [1]
290039
0
21/11/2013
Query!
Ethics approval number [1]
290039
0
Query!
Summary
Brief summary
Commencing in 2013, the Australian and New Zealand College of Anaesthetists (ANZCA) implemented the Direct Observation of Procedural Skills (DOPS) form as part of the new curriculum that uses workplace based assessments (WBA) as an integral part of trainee assessment. DOPS is a generic tool using a 10-item, 9-point Likert scale scoring system for all procedural skills performed in anaesthesia. A vital aspect of confidence in the results generated by any assessment tool is the concept of reliability, which refers to the reproducibility of a test. This implies that a broad range of assessors, when viewing the same trainee performing a regional anaesthesia block, comes to a similar result. Components which improve reliability of an assessment tool include objective criteria for assessment, training of the assessors, direct observation at the moment of performance (rather than retrospective), and ability of the tool to discriminate between different levels of performance. As there is no published literature on the ANZCA DOPS reliability, we are performing this study to collect the consistency of scoring. The results will generate baseline data to inform future studies, such as whether training can improve reliability. This research project will recruit ANZCA Fellows and ask them to view 2 videos of regional anaesthesia block performance. The videos are scripted, and the trainee, anaesthetic assistant, and patient are roleplayed. Participants will view each video and score on the DOPS form. The results from all participants are analysed to estimate the degree of consistency by using measures of correlation.
Query!
Trial website
Query!
Trial related presentations / publications
Chuan A et al. Reliability of the Direct Observation of Procedural Skills assessment tool for ultrasound-guided regional anaesthesia. In print, Anaethesia and Intensive Care 2016
Query!
Public notes
Query!
Contacts
Principal investigator
Name
43650
0
Dr Alwin Chuan
Query!
Address
43650
0
The Australian School of Advanced Medicine
Building F10A, Groundfloor,
2 Technology Place
Macquarie University NSW 2109
Query!
Country
43650
0
Australia
Query!
Phone
43650
0
+61 407743668
Query!
Fax
43650
0
Query!
Email
43650
0
[email protected]
Query!
Contact person for public queries
Name
43651
0
Alwin Chuan
Query!
Address
43651
0
The Australian School of Advanced Medicine
Building F10A, Groundfloor,
2 Technology Place
Macquarie University NSW 2109
Query!
Country
43651
0
Australia
Query!
Phone
43651
0
+61 407743668
Query!
Fax
43651
0
Query!
Email
43651
0
[email protected]
Query!
Contact person for scientific queries
Name
43652
0
Alwin Chuan
Query!
Address
43652
0
The Australian School of Advanced Medicine
Building F10A, Groundfloor,
2 Technology Place
Macquarie University NSW 2109
Query!
Country
43652
0
Australia
Query!
Phone
43652
0
+61 407743668
Query!
Fax
43652
0
Query!
Email
43652
0
[email protected]
Query!
No information has been provided regarding IPD availability
What supporting documents are/will be available?
No Supporting Document Provided
Results publications and other study-related documents
Documents added manually
No documents have been uploaded by study researchers.
Documents added automatically
No additional documents have been identified.
Download to PDF