Homomorphic Encryption-Based Federated Privacy Preservation for Deep Active Learning

Abstract

Active learning is a technique for maximizing performance of machine learning with minimal labeling effort and letting the machine automatically and adaptively select the most informative data for labeling. Since the labels on records may contain sensitive information, privacy-preserving mechanisms should be integrated into active learning. We propose a privacy-preservation scheme for active learning using homomorphic encryption-based federated learning. Federated learning provides distributed computation from multiple clients, and homomorphic encryption enhances the privacy preservation of user data with a strong security level. The experimental result shows that the proposed homomorphic encryption-based federated learning scheme can preserve privacy in active learning while maintaining model accuracy. Furthermore, we also provide a Deep Leakage Gradient comparison. The proposed scheme has no gradient leakage compared to the related schemes that have more than 74% gradient leakage.

Keywords: active learning; federated learning; homomorphic encryption; privacy preserving.

Figure 1

Proposed scheme of homomorphic encryption-based federated active learning with one server and multiple clients.

Figure 2

Active learning query process with one server and one client of the proposed scheme.

Figure 3

MNIST classification accuracy of Active Federated Learning as a function of query rounds for two clients. (AL: Active Learning, FL: Federated Learning, FL-Enc: FL with homomorphic encryption).