Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Kristina Karstad; Reiner Rugulies; Jørgen Skotte; Pernille Kold Munch; Birgit A Greiner; Alex Burdorf; Karen Søgaard; Andreas Holtermann

doi:10.1016/j.apergo.2018.01.004

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Kristina Karstad
, Reiner Rugulies
, Jørgen Skotte
, Pernille Kold Munch
, Birgit A Greiner
, Alex Burdorf
, Karen Søgaard
, Andreas Holtermann

School of Public Health, University College Cork, Western Road, Cork, Ireland.
Department of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark.
Department of Public Health, Erasmus MC, Rotterdam, The Nederlands
Institute of Clinical Research, University of Southern Denmark, Odense, Denmark.
Department of Public Health, University of Copenhagen, Copenhagen, Denmark.
Department of Psychology, University of Copenhagen, Copenhagen, Denmark

Research output: Contribution to journal › Journal article › Research › peer-review

Abstract

The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

Original language	English
Journal	Applied Ergonomics
Volume	69
Pages (from-to)	93-103
Number of pages	11
ISSN	0003-6870
DOIs	https://doi.org/10.1016/j.apergo.2018.01.004
Publication status	Published - 2018

Keywords

Journal Article

Access to Document

10.1016/j.apergo.2018.01.004

1 Finished

EN -Betydning af fysisk arbejdseksponering og psykosocialt arbejdemiljø (DOSES)
Holtermann, A. (Project Manager), Jørgensen, A. W. (Project Participant), Ørberg, A. (Project Participant), Maltesen, A. T. (Project Participant), Linde, C. S. (Project Participant), Ekner, D. H. (Project Participant), Eriksen, D. P. (Project Participant), Hessellund, G. M. (Project Participant), Bay, H. (Project Participant), Rieltoft, H. R. (Project Participant), Soll-Johanning, H. (Project Participant), Skotte, J. H. (Project Participant), Meyland, K. K. (Project Participant), Egelund, L. I. (Project Participant), Nielsen, L. (Project Participant), Jacobsen, M. H. (Project Participant), Ravn, M. H. (Project Participant), Lidegaard, M. (Project Participant), Kraul, M. P. (Project Participant), Munch, P. K. (Project Participant), Hendriksen, P. F. (Project Participant), Rasmussen, R. B. (Project Participant), Rugulies, R. (Project Participant), Lavard, T. (Project Participant), Li, T. (Project Participant) & Korup, V. (Project Participant)
01/01/2012 → 31/12/2017
Project: Research

1 Ph.D. thesis
1 Conference abstract for conference

Er der sammenhæng mellem antallet af forflytninger og lænderygsmerter blandt SOSU’er i ældreplejen? – et prospektivt studie på 20 danske plejehjem
Karstad, K., 2018.
Research output: Contribution to conference › Conference abstract for conference › Research
Workplace observations on resident handling and low back pain among eldercare workers
Karstad, K., 2017, The National Research Centre for the Working Environment; University of Southern Denmark.
Research output: Book/Report › Ph.D. thesis

Cite this

@article{d1ae62646b414f11a6ed4d0eb70189f1,

title = "Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project",

abstract = "The aim of the study was to develop and evaluate the reliability of the {"}Danish observational study of eldercare work and musculoskeletal disorders{"} (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.",

keywords = "Journal Article",

author = "Kristina Karstad and Reiner Rugulies and J{\o}rgen Skotte and Munch, \{Pernille Kold\} and Greiner, \{Birgit A\} and Alex Burdorf and Karen S{\o}gaard and Andreas Holtermann",

year = "2018",

doi = "10.1016/j.apergo.2018.01.004",

language = "English",

volume = "69",

pages = "93--103",

journal = "Applied Ergonomics",

issn = "0003-6870",

publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

AU - Karstad, Kristina

AU - Rugulies, Reiner

AU - Skotte, Jørgen

AU - Munch, Pernille Kold

AU - Greiner, Birgit A

AU - Burdorf, Alex

AU - Søgaard, Karen

AU - Holtermann, Andreas

PY - 2018

Y1 - 2018

N2 - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

AB - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

KW - Journal Article

U2 - 10.1016/j.apergo.2018.01.004

DO - 10.1016/j.apergo.2018.01.004

M3 - Journal article

C2 - 29477334

SN - 0003-6870

VL - 69

SP - 93

EP - 103

JO - Applied Ergonomics

JF - Applied Ergonomics

ER -

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Abstract

Keywords

Access to Document

Fingerprint

Projects

EN -Betydning af fysisk arbejdseksponering og psykosocialt arbejdemiljø (DOSES)

Research output

Er der sammenhæng mellem antallet af forflytninger og lænderygsmerter blandt SOSU’er i ældreplejen? – et prospektivt studie på 20 danske plejehjem

Workplace observations on resident handling and low back pain among eldercare workers

Cite this