Variation in selection among populations and years has important implications for evolutionary trajectories of populations. Yet, the agents of selection causing this variation have rarely been identified. Selection on the time of reproduction within a season in plants might differ both among populations and among years, and selection can be mediated by both mutualists and antagonists. We investigated if differences in the direction of phenotypic selection on flowering phenology among 20 populations of Gentiana pneumonanthe during 2 yr were related to the presence of the butterfly seed predator Phengaris alcon, and if butterfly incidence was associated with the abundance of the butterfly's second host, Myrmica ants. In plant populations without the butterfly, phenotypic selection favored earlier flowering. In populations where the butterfly was present, caterpillars preferentially attacked early-flowering individuals, shifting the direction of selection to favoring later flowering. Butterfly incidence in plant populations increased with ant abundance. Our results demonstrate that antagonistic interactions can shift the direction of selection on flowering phenology, and suggest that such shifts might be associated with differences in the community context.