Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Mar;85(3):277-86.
doi: 10.1002/cyto.a.22433. Epub 2013 Dec 31.

High-throughput flow cytometry data normalization for clinical trials

Affiliations

High-throughput flow cytometry data normalization for clinical trials

Greg Finak et al. Cytometry A. 2014 Mar.

Abstract

Flow cytometry datasets from clinical trials generate very large datasets and are usually highly standardized, focusing on endpoints that are well defined apriori. Staining variability of individual makers is not uncommon and complicates manual gating, requiring the analyst to adapt gates for each sample, which is unwieldy for large datasets. It can lead to unreliable measurements, especially if a template-gating approach is used without further correction to the gates. In this article, a computational framework is presented for normalizing the fluorescence intensity of multiple markers in specific cell populations across samples that is suitable for high-throughput processing of large clinical trial datasets. Previous approaches to normalization have been global and applied to all cells or data with debris removed. They provided no mechanism to handle specific cell subsets. This approach integrates tightly with the gating process so that normalization is performed during gating and is local to the specific cell subsets exhibiting variability. This improves peak alignment and the performance of the algorithm. The performance of this algorithm is demonstrated on two clinical trial datasets from the HIV Vaccine Trials Network (HVTN) and the Immune Tolerance Network (ITN). In the ITN data set we show that local normalization combined with template gating can account for sample-to-sample variability as effectively as manual gating. In the HVTN dataset, it is shown that local normalization mitigates false-positive vaccine response calls in an intracellular cytokine staining assay. In both datasets, local normalization performs better than global normalization. The normalization framework allows the use of template gates even in the presence of sample-to-sample staining variability, mitigates the subjectivity and bias of manual gating, and decreases the time necessary to analyze large datasets.

Keywords: BioConductor; bias; immunology; staining variability; template gating.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest

Kevin Krouse is an employee of LabKey Software.

Figures

Figure 1
Figure 1
Gating scheme for an FCS file from the ICS data set. In this example, cells are stimulated with POL-1-PTEG peptide pool. Problematic gating of the Perforin channel for both CD4 and CD8 subsets is clearly visible.
Figure 2
Figure 2
Variability in the staining intensity of channels in the ICS and B-cell phenotyping data sets. In the ICS data, the Perforin channel is compared to CD57, before and after normalization. A random sampling of 12 FCS files showing the variability in staining on the channel A) before and B) after normalization, contrasted against the staining of which does not exhibit staining variability. The density is shown for the CD4+ cell subpopulation, right before the Perforin+ gate is applied. In the B-cell phenotyping data, the density of different channels in the C) locally normalized, and the D) raw data is shown. Variability across subjects is evident for the Red-A, Violet-C, Violet-A, and Blue-F channels, and their variability is reduced across subjects after normalization.
Figure 3
Figure 3
Percent of perforin positive CD4+ and CD8+ T-cells before (A,B) and after (C,D) normalization in a sample FCS file (505333.fcs) and the target reference file (504789.fcs). The reference is unchanged after normalization.
Figure 4
Figure 4
Comparison of global and local normalization approaches for the ICS data and B-cell phenotyping data. A) The proportion of Perforin positive CD4 and CD8-positive T-cells before and after local and global normalization. Local normalization leads to accurate gating of the CD4 and CD8 Perforin positive T-cells, while global normalization inflates the number of CD4 and CD8 Perforin positive T-cells. Variability is expected to decrease within stimulation groups and T-cell subsets for this data set upon accurate gating. B) Paired differences between manually gated and normalized, globally normalized, or template gated cell populations in the B-cell phenotyping data. Dotted gray line at zero is a guide to the eye. Differences closer to zero are better because they imply less bias. Narrower boxes imply greater precision.
Figure 5
Figure 5
Comparative gating of three potential false positive responders in the IFN-γ producing CD4+ T-cell subset stimulated with POL-1-PTEG. Gating of the A) normalized data and B) raw data with associated proportions of Perforin positive cells. Red dots indicate IFNg postive T-cells.

Comment in

  • Analyses of large flow cytometry datasets.
    Stuchlý J, Kalina T. Stuchlý J, et al. Cytometry A. 2014 Mar;85(3):203-5. doi: 10.1002/cyto.a.22431. Epub 2013 Dec 31. Cytometry A. 2014. PMID: 24382687 No abstract available.

References

    1. Lo K, Hahne F, Brinkman R, Gottardo R. flowClust: a Bioconductor package for automated gating of flow cytometry data. BMC Bioinformatics. 2009;10(1):145. - PMC - PubMed
    1. Finak G, Bashashati A, Brinkman R, Gottardo R. Merging mixture components for cell population identification in flow cytometry. Advances in Bioinformatics. 2009;2009:247646. - PMC - PubMed
    1. Aghaeepour N, Finak G, Hoos H, Mosmann TR, Brinkman R, Gottardo R, Scheuermann RH. Critical assessment of automated flow cytometry data analysis techniques. Nature Methods. 2013;10(5):445–445. - PMC - PubMed
    1. Kaltsidis H, Cheeseman H, Kopycinski J, Ashraf A, Cox MC, Clark L, Anjarwalla I, Dally L, Bergin P, Spentzou A, Higgs C, Gotch F, Gazzard B, Gomez R, Hayes P, Kelleher P, Gill DK, Gilmour J. Measuring human T cell responses in blood and gut samples using qualified methods suitable for evaluation of HIV vaccine candidates in clinical trials. Journal of immunological methods. 2011;370(1–2):43–54. - PubMed
    1. Shulman N, Bellew M, Snelling G, Carter D, Huang Y, Li H, Self SG, McElrath MJ, De Rosa SC. Development of an automated analysis system for data from flow cytometric intracellular cytokine staining assays from clinical vaccine trials. Cytometry Part A : the journal of the International Society for Analytical Cytology. 2008;73(9):847–856. - PMC - PubMed

Publication types

LinkOut - more resources