Towards Automatic Monitoring of Disease Progression in Sheep: a Hierarchical Model for Sheep Facial Expressions Analysis from Video

Pessanha, F., McLennan, K. and Mahmoud, M. (2020) Towards Automatic Monitoring of Disease Progression in Sheep: a Hierarchical Model for Sheep Facial Expressions Analysis from Video. In: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), Buenos Aires, Argentina, 16-20 Nov 2020, pp. 387-393. ISBN 9781728130798 (doi: 10.1109/FG47880.2020.00107)

Abstract

Pain in farm animals harms the economics of farming and affects animal welfare. However, prey animals tend to not openly express signs of weakness, making the pain assessment process difficult. We propose a novel hierarchical model for disease progression evaluation, adapted for a wide range of head poses, according to which relevant information is extracted. A fine-tuned CNN is applied for face detection, followed by a CNN-based pose estimation and pose-informed landmark location method. Then multi-modal features are extracted, combining the appearance of regions-of-interest, described using a Histogram of Oriented Gradients, with geometric features and the pose values, leading to a binary Support Vector Machine classifier. To evaluate the efficiency of the complete pipeline, videos of the same sheep recorded at initial and advanced stages of treatment were tested, showing a decrease in the average pain score detected. The pain evaluation method significantly outperformed the existing state-of-the-art approach, being the first to apply a pose-based feature extraction in sheep pain detection.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Mahmoud, Dr Marwa
• Authors: Pessanha, F., McLennan, K., and Mahmoud, M.
• College/School: College of Science and Engineering > School of Computing Science
• ISBN: 9781728130798
• Published Online: 18 January 2021