Analyzing gene-frequency data when the effective population size is finite

Abstract

The statistical methods used by SCHAFFER, YARDLEY and ANDERSON (1977) and by GIBSON et al. (1979) to analyze the variation in allele frequencies in two common types of experimental procedure, where the effective population size is finite, are extended to a more general situation involving a greater range of experiments. The analysis developed is more sensitive in detecting changes in allele frequency due to both fluctuating and balancing selection, as well as to directional selection. The error involved in many studies due to ignoring the effective population size structure would appear to be large. The range of hypothesis that can be considered may be increased as well. Finally, the method of determining bounds for the effective population size, when a particular genetic model is known to hold for a data set, is also outlined.