The development, reliability, and validity of the Facilitator Assessment Tool: an implementation fidelity measure used in Parenting for Lifelong Health for Young Children

Martin, M., Lachman, J. M. , Murphy, H., Gardner, F. and Foran, H. (2023) The development, reliability, and validity of the Facilitator Assessment Tool: an implementation fidelity measure used in Parenting for Lifelong Health for Young Children. Child: Care, Health and Development, 49(3), pp. 591-604. (doi: 10.1111/cch.13075) (PMID:36316789)

[img] Text
285055.pdf - Published Version
Available under License Creative Commons Attribution.

396kB

Abstract

Background: The Parenting for Lifelong Health for Young Children (PLH-YC) programme aims to reduce violence against children and child behaviour problems among families in low- and middle-income countries (LMICs). Although the programme has been tested in four randomised controlled trials and delivered in over 25 countries, there are gaps in understanding regarding the programme's implementation fidelity and, more generally, concerning the implementation fidelity of parenting programmes in LMICs. Aims: This study aims to address these gaps by examining the psychometric properties of the PLH-YC-Facilitator Assessment Tool (FAT)—an observational tool used to measure the competent adherence of PLH-YC facilitators. Examining the psychometric properties of the FAT is important in order to determine whether there is an association between facilitator competent adherence and programme outcomes and, if correlated, to improve facilitator performance. It is also important to develop the implementation literature among parenting interventions in LMICs. Methods: The study examined the content validity, intra-rater reliability, and inter-rater reliability of the FAT. Revision of the tool was based on consultation with programme trainers, experts, and assessors. A training curriculum and assessment manual was created. Assessors were trained in Southeastern Europe and their assessments of facilitator delivery were analysed as part of a large-scale factorial experiment (N = 79 facilitators). Results: The content validity process with PLH-YC trainers, experts, and assessors resulted in substantial improvements to the tool. Analyses of percentage agreements and intraclass correlations found that, even with practical challenges, assessments were completed with adequate yet not strong intra- and inter-rater reliability. Conclusions: This study contributes to the literature on the implementation of parenting programmes in LMICs. The study found that the FAT appears to capture its intended constructs and can be used with an acceptable degree of consistency. Further research on the tool's reliability and validity—specifically, its internal consistency, construct validity, and predictive validity—is recommended.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Lachman, Dr Jamie
Authors: Martin, M., Lachman, J. M., Murphy, H., Gardner, F., and Foran, H.
College/School:College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > MRC/CSO SPHSU
Journal Name:Child: Care, Health and Development
Publisher:Wiley
ISSN:0305-1862
ISSN (Online):1365-2214
Published Online:31 October 2022
Copyright Holders:Copyright © 2022 The Authors
First Published:First published in Child: Care, Health and Development 49(3):591-604
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
727661Complexity in Health ImprovementLaurence MooreMedical Research Council (MRC)MC_UU_12017/14HW - MRC/CSO Social and Public Health Sciences Unit
727631Social Relationships & Health ImprovementLisa McDaidMedical Research Council (MRC)MC_UU_12017/11HW - MRC/CSO Social and Public Health Sciences Unit
727631Social Relationships & Health ImprovementLisa McDaidOffice of the Chief Scientific Adviser (CSO)SPHSU11HW - MRC/CSO Social and Public Health Sciences Unit
727661Complexity in Health ImprovementLaurence MooreOffice of the Chief Scientific Adviser (CSO)SPHSU14HW - MRC/CSO Social and Public Health Sciences Unit