Less experienced observers assess piglet castration-induced acute pain differently than experienced observers: A pilot study

Abstract

Behavioral pain scales have been helpful for standardized swine pain assessment. However, it is still unknown if observers' experience influences the scale score. We conducted a pilot study to investigate how three different levels of swine experience influenced how observers scored castration pain in piglets using Unesp-Botucatu Pig Composite Acute Pain Scale (UPAPS). We used a database from UPAPS scores from pigs undergoing surgical castration in a previous study. Scores were attributed by six observers with Little to no experience (n = 2), Some experience (n = 2) and Extensive experience (n = 2). Reliability was estimated using the intraclass correlation coefficient, agreement was investigated by Bland-Altman analysis, predictive capacity was estimated using the area under the curve (AUC), and statistical differences were tested using a regression model. We found that intra-experience levels reliability were satisfactory (Little to no: 0.72, Some: 0.81, Extensive: 0.84), but inter-experience reliability was lower (0.42). Little to no experience observers had poor agreement with other observers, with a bias toward underscoring UPAPS (bias of 0.94 vs. Some, 1.17 vs. Extensive). Predictive capacity was similar between all observers (AUC, Little to no: 71.94%, Some: 76.10%, Extensive: 79.09%, p > 0.05). Regression model confirmed underscoring of Little to no experience observers (mean ± standard error; Little to no: 1.09 ± 0.14; Some: 2.02 ± 0.23; Extensive: 2.25 ± 0.22; p < 0.05). We concluded that minimal experience, as Some experience observers have in the swine industry, is sufficient for them to score UPAPS in a similar way than more experienced observers. The present pilot study supports the enhancement and implementation of UPAPS on farm and laboratory settings by minimally qualified observers, improving swine welfare in the short and long term.

Fig 1. Observers scoring on UPAPS total sum.

(A) Overall observers scoring on UPAPS total sum boxplot across experience levels. (B) UPAPS total score by different levels of experience: little to no experience, some experience and extensive experience. (Letters indicate statistical differences (p < 0.05) found in the Bonferroni post-hoc test (a>b). UPAPS: Unesp-Botucatu Pig Composite Acute Pain Scale).

Fig 2. Bland-Altman plot of UPAPS total sum assigned by Little to no experience vs Some experience observers.

Solid lines represent bias, dashed lines represent the lower and upper limit of agreement, dotted lines represent the 95% and 90% confidence intervals for bias and lower and upper limit of agreement, respectively. Green line represents the simple linear regression line. UPAPS: Unesp-Botucatu Pig Composite Acute Pain Scale.

Fig 3. Bland-Altman plot of UPAPS total sum assigned by Little to no experience vs Extensive experience observers.

Solid lines represent bias, dashed lines represent the lower and upper limit of agreement, dotted lines represent the 95% and 90% confidence intervals for bias and lower and upper limit of agreement, respectively. Purple line represents the simple linear regression line. UPAPS: Unesp-Botucatu Pig Composite Acute Pain Scale.

Fig 4. Bland-Altman plot of UPAPS total sum assigned by Some experience vs Extensive experience.

Solid lines represent bias, dashed lines represent the lower and upper limit of agreement, dotted lines represent the 95% and 90% confidence intervals for bias and lower and upper limit of agreement, respectively. Yellow line represents the simple linear regression line. UPAPS: Unesp-Botucatu Pig Composite Acute Pain Scale.

Fig 5. UPAPS scores proportions along experience level groups for UPAPS items.

(A) Posture, (B) Interaction, (C) Activity, (D) Attention and (E) Miscellaneous items. UPAPS: Unesp-Botucatu Pig Composite Acute Pain Scale.