Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov 18;44(6):1026-1038.
doi: 10.24272/j.issn.2095-8137.2022.485.

BARN: Behavior-Aware Relation Network for multi-label behavior detection in socially housed macaques

Sen Yang  1   2   3 , Zhi-Yuan Chen  2   3 , Ke-Wei Liang  2   3 , Cai-Jie Qin  2   3 , Yang Yang  2   3 , Wen-Xuan Fan  1   2   3 , Chen-Lu Jie  2   3   4 , Xi-Bo Ma  1   2   5
Affiliations

BARN: Behavior-Aware Relation Network for multi-label behavior detection in socially housed macaques

Sen Yang et al. Zool Res. .

Abstract
in English, Chinese

Quantification of behaviors in macaques provides crucial support for various scientific disciplines, including pharmacology, neuroscience, and ethology. Despite recent advancements in the analysis of macaque behavior, research on multi-label behavior detection in socially housed macaques, including consideration of interactions among them, remains scarce. Given the lack of relevant approaches and datasets, we developed the Behavior-Aware Relation Network (BARN) for multi-label behavior detection of socially housed macaques. Our approach models the relationship of behavioral similarity between macaques, guided by a behavior-aware module and novel behavior classifier, which is suitable for multi-label classification. We also constructed a behavior dataset of rhesus macaques using ordinary RGB cameras mounted outside their cages. The dataset included 65 913 labels for 19 behaviors and 60 367 proposals, including identities and locations of the macaques. Experimental results showed that BARN significantly improved the baseline SlowFast network and outperformed existing relation networks. In conclusion, we successfully achieved multi-label behavior detection of socially housed macaques with both economic efficiency and high accuracy.

猕猴行为的量化在许多领域的研究中提供了关键的实验支持，如药物安全评估、神经科学和动物行为学。近些年来，许多研究人员致力于猕猴的行为分析。然而，很少有工作研究群居猕猴的多标签行为检测。该任务考虑了猕猴之间的交互，更符合群居猕猴的特征。鉴于缺乏和该任务相关的方法和数据集，在该文中我们提出了一个用于群居猕猴多标签行为检测的行为感知关系网络（BARN）。该网络在一个行为感知模块的指导下建模了猕猴之间的行为相似性这一关系，还包含一个新颖的更适用于多标签分类的行为分类器。我们还利用安装在笼子外的普通RGB相机构建了一个恒河猴的行为数据集。数据注释包含65 913个对应于19种行为的标签和60 367个包括猕猴的身份和位置的提议（proposals）。实验结果表明BARN对基线网络SlowFast取得了显著改进并且由于现有的关系网络。总的来说，我们以低成本和高精度成功地完成了群居猕猴的多标签行为检测。.

Keywords: Behavioral similarity; Drug safety assessment; Macaque behavior; Multi-label behavior detection; Relation network.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Figure 1
Figure 1
Overall cage environment and camera setup
Figure 2
Figure 2
Example of each behavior and corresponding category
Figure 3
Figure 3
Number of samples in different datasets
Figure 4
Figure 4
Overview of proposed muti-label behavior detection framework
Figure 5
Figure 5
Architecture of BSRM
Figure 6
Figure 6
Comparative analysis of BARN (ours) with baseline network SlowFast and ACRN (Sun et al., 2018) on the validation set
Figure 7
Figure 7
Movement distance of each macaque generated by ground-truth and monkey detector on the test set of the proposed macaque identity dataset
Figure 8
Figure 8
Visualization results of bounding boxes, identities, movement trajectories, and behaviors of macaques in two videos
Figure 9
Figure 9
Duration of behaviors generated by ground-truth, BARN (ours), and ACRN (Sun et al., 2018) on the test set of the proposed macaque behavior dataset
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Bala PC, Eisenreich BR, Yoo SBM, et al Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio. Nature Communications. 2020;11(1):4560. doi: 10.1038/s41467-020-18441-5. - DOI - PMC - PubMed
    1. Ballesta S, Reymond G, Pozzobon M, et al A real-time 3D video tracking system for monitoring primate groups. Journal of Neuroscience Methods. 2014;234:147–152. doi: 10.1016/j.jneumeth.2014.05.022. - DOI - PubMed

    1. Collobert R, Bengio S, Mariéthoz J. 2002. Torch: a modular machine learning software library. REP_WORK (30 October, 2002). Idiap, https://os.unil.cloud.switch.ch/tind-customer-epfl/5ea06583-58ae-4f33-bcc5-ae8feb746af1?response-content-disposition=attachment%3B%20filename%2A%3DUTF-8%27%27rr02-46.pdf&response-content-type=application%2Fpdf&AWSAccessKeyId=ded3589a13b4450889b2f728d54861a6&Expires=1682421084&Signature=gej7yCqVtYuJiwgttsO0YPoiqXo%3D.

    1. Defler TR. 2000. Locomotion and posture in Lagothrix lagotricha. Folia Primatologica, 70(6): 313–327.

    1. Everingham M, Van Gool L, Williams CKI, et al The pascal visual object classes (VOC) challenge. International journal of computer vision. 2010;88(2):303–338. doi: 10.1007/s11263-009-0275-4. - DOI