Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Oct 27;24(11):1545.
doi: 10.3390/e24111545.

Homomorphic Encryption-Based Federated Privacy Preservation for Deep Active Learning

Hendra Kurniawan  1 , Masahiro Mambo  2
Affiliations

Homomorphic Encryption-Based Federated Privacy Preservation for Deep Active Learning

Hendra Kurniawan et al. Entropy (Basel). .

Abstract

Active learning is a technique for maximizing performance of machine learning with minimal labeling effort and letting the machine automatically and adaptively select the most informative data for labeling. Since the labels on records may contain sensitive information, privacy-preserving mechanisms should be integrated into active learning. We propose a privacy-preservation scheme for active learning using homomorphic encryption-based federated learning. Federated learning provides distributed computation from multiple clients, and homomorphic encryption enhances the privacy preservation of user data with a strong security level. The experimental result shows that the proposed homomorphic encryption-based federated learning scheme can preserve privacy in active learning while maintaining model accuracy. Furthermore, we also provide a Deep Leakage Gradient comparison. The proposed scheme has no gradient leakage compared to the related schemes that have more than 74% gradient leakage.

Keywords: active learning; federated learning; homomorphic encryption; privacy preserving.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Proposed scheme of homomorphic encryption-based federated active learning with one server and multiple clients.
Figure 2
Figure 2
Active learning query process with one server and one client of the proposed scheme.
Figure 3
Figure 3
MNIST classification accuracy of Active Federated Learning as a function of query rounds for two clients. (AL: Active Learning, FL: Federated Learning, FL-Enc: FL with homomorphic encryption).
See this image and copyright information in PMC

References

    1. Aggarwal C.C., Philip S.Y. A survey of uncertain data algorithms and applications. IEEE Trans. Knowl. Data Eng. 2008;21:609–623. doi: 10.1109/TKDE.2008.190. - DOI
    1. Feyisetan O., Drake T., Balle B., Diethe T. Privacy-preserving active learning on sensitive data for user intent classification. arXiv. 20191903.11112
    1. McMahan B., Moore E., Ramage D., Hampson S., y Arcas B.A. Communication-efficient learning of deep networks from decentralized data; Proceedings of the Artificial Intelligence and Statistics; Fort Lauderdale, FL, USA. 20–22 April 2017; pp. 1273–1282.
    1. Goetz J., Malik K., Bui D., Moon S., Liu H., Kumar A. Active federated learning. arXiv. 20191909.12641
    1. Ahn J.H., Kim K., Koh J., Li Q. Federated Active Learning (F-AL): An Efficient Annotation Strategy for Federated Learning. arXiv. 20222202.00195

LinkOut - more resources