Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Kristina Karstad; Reiner Rugulies; Jørgen Skotte; Pernille Kold Munch; Birgit A Greiner; Alex Burdorf; Karen Søgaard; Andreas Holtermann

doi:10.1016/j.apergo.2018.01.004

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Kristina Karstad
, Reiner Rugulies
, Jørgen Skotte
, Pernille Kold Munch
, Birgit A Greiner
, Alex Burdorf
, Karen Søgaard
, Andreas Holtermann

School of Public Health, University College Cork, Western Road, Cork, Ireland.
Department of Sports Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark.
Department of Public Health, Erasmus MC, Rotterdam, The Nederlands
Institute of Clinical Research, University of Southern Denmark, Odense, Denmark.
Department of Public Health, University of Copenhagen, Copenhagen, Denmark.
Department of Psychology, University of Copenhagen, Copenhagen, Denmark

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › peer review

Abstract

The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

Originalsprog	Engelsk
Tidsskrift	Applied Ergonomics
Vol/bind	69
Sider (fra-til)	93-103
Antal sider	11
ISSN	0003-6870
DOI	https://doi.org/10.1016/j.apergo.2018.01.004
Status	Udgivet - 2018

Adgang til dokumentet

10.1016/j.apergo.2018.01.004

1 Afsluttet

Betydning af fysisk arbejdseksponering og psykosocialt arbejdsmiljø (DOSES)
Holtermann, A. (Projektleder), Jørgensen, A. W. (Projektdeltager), Ørberg, A. (Projektdeltager), Maltesen, A. T. (Projektdeltager), Linde, C. S. (Projektdeltager), Ekner, D. H. (Projektdeltager), Eriksen, D. P. (Projektdeltager), Hessellund, G. M. (Projektdeltager), Bay, H. (Projektdeltager), Rieltoft, H. R. (Projektdeltager), Soll-Johanning, H. (Projektdeltager), Skotte, J. H. (Projektdeltager), Meyland, K. K. (Projektdeltager), Egelund, L. I. (Projektdeltager), Nielsen, L. (Projektdeltager), Jacobsen, M. H. (Projektdeltager), Ravn, M. H. (Projektdeltager), Lidegaard, M. (Projektdeltager), Kraul, M. P. (Projektdeltager), Munch, P. K. (Projektdeltager), Hendriksen, P. F. (Projektdeltager), Rasmussen, R. B. (Projektdeltager), Rugulies, R. (Projektdeltager), Lavard, T. (Projektdeltager), Li, T. (Projektdeltager) & Korup, V. (Projektdeltager)
01/01/2012 → 31/12/2017
Projekter: Projekt › Forskning

1 Ph.d.-afhandling
1 Konferenceabstrakt til konference

Er der sammenhæng mellem antallet af forflytninger og lænderygsmerter blandt SOSU’er i ældreplejen? – et prospektivt studie på 20 danske plejehjem
Karstad, K., 2018.
Publikation: Konferencebidrag › Konferenceabstrakt til konference › Forskning
Workplace observations on resident handling and low back pain among eldercare workers
Karstad, K., 2017, The National Research Centre for the Working Environment; University of Southern Denmark.
Publikation: Bog/antologi/afhandling/rapport › Ph.d.-afhandling

Citationsformater

@article{d1ae62646b414f11a6ed4d0eb70189f1,

title = "Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project",

abstract = "The aim of the study was to develop and evaluate the reliability of the {"}Danish observational study of eldercare work and musculoskeletal disorders{"} (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.",

keywords = "Journal Article",

author = "Kristina Karstad and Reiner Rugulies and J{\o}rgen Skotte and Munch, \{Pernille Kold\} and Greiner, \{Birgit A\} and Alex Burdorf and Karen S{\o}gaard and Andreas Holtermann",

year = "2018",

doi = "10.1016/j.apergo.2018.01.004",

language = "English",

volume = "69",

pages = "93--103",

journal = "Applied Ergonomics",

issn = "0003-6870",

publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

AU - Karstad, Kristina

AU - Rugulies, Reiner

AU - Skotte, Jørgen

AU - Munch, Pernille Kold

AU - Greiner, Birgit A

AU - Burdorf, Alex

AU - Søgaard, Karen

AU - Holtermann, Andreas

PY - 2018

Y1 - 2018

N2 - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

AB - The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers.

KW - Journal Article

U2 - 10.1016/j.apergo.2018.01.004

DO - 10.1016/j.apergo.2018.01.004

M3 - Journal article

C2 - 29477334

SN - 0003-6870

VL - 69

SP - 93

EP - 103

JO - Applied Ergonomics

JF - Applied Ergonomics

ER -

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project

Abstract

Adgang til dokumentet

Fingeraftryk

Projekter

Betydning af fysisk arbejdseksponering og psykosocialt arbejdsmiljø (DOSES)

Publikation

Er der sammenhæng mellem antallet af forflytninger og lænderygsmerter blandt SOSU’er i ældreplejen? – et prospektivt studie på 20 danske plejehjem

Workplace observations on resident handling and low back pain among eldercare workers

Citationsformater