A dual-transformation with contrastive learning framework for lymph node metastasis prediction in pancreatic cancer

Abstract

Pancreatic cancer is a malignant tumor, and its high recurrence rate after surgery is related to the lymph node metastasis status. In clinical practice, a preoperative imaging prediction method is necessary for prognosis assessment and treatment decision; however, there are two major challenges: insufficient data and difficulty in discriminative feature extraction. This paper proposed a deep learning model to predict lymph node metastasis in pancreatic cancer using multiphase CT, where a dual-transformation with contrastive learning framework is developed to overcome the challenges in fine-grained prediction with small sample sizes. Specifically, we designed a novel dynamic surface projection method to transform 3D data into 2D images for effectively using the 3D information, preserving the spatial correlation of the original texture information and reducing computational resources. Then, this dynamic surface projection was combined with the spiral transformation to establish a dual-transformation method for enhancing the diversity and complementarity of the dataset. A dual-transformation-based data augmentation method was also developed to produce numerous 2D-transformed images to alleviate the effect of insufficient samples. Finally, the dual-transformation-guided contrastive learning scheme based on intra-space-transformation consistency and inter-class specificity was designed to mine additional supervised information, thereby extracting more discriminative features. Extensive experiments have shown the promising performance of the proposed model for predicting lymph node metastasis in pancreatic cancer. Our dual-transformation with contrastive learning scheme was further confirmed on an external public dataset, representing a potential paradigm for the fine-grained classification of oncological images with small sample sizes. The code will be released at https://github.com/SJTUBME-QianLab/Dual-transformation.

Keywords: Contrastive learning; Dual-transformation; Dynamic surface projection; Lymph node metastasis.