Human leukocyte antigen (HLA) immune genes play an important role in partner selection, but it has remained unclear if nonrandom pairing with respect to parental HLA genes could occur at the level of the gametes. We tested this possibility by investigating whether the sperm fertilization competence in humans is dependent on HLA genotype combination of the partners. We conducted a full-factorial experiment, in which the sperm physiological preparation for fertilization among multiple males was studied in the presence of follicular fluid (oocyte surrounding bioactive liquid) of several females. All the studied sperm pre-fertilization physiological parameters (motility, hyperactivation, acrosome reaction, and viability) were strongly dependent on male–female combination. In other words, follicular fluids (women) that induce strong sperm physiological response in some males often induce much weaker response in the other(s). Sperm physiological responses were stronger in HLA-dissimilar male–female pairs than in HLA-similar combinations, but none of the measured sperm traits were associated with genome-wide similarity. Together, these findings shed new light on the evolutionary and immunological mechanisms of fertilization. Furthermore, our results raise an intriguing possibility that against currently prevailing WHO’s definition, infertility may not represent exclusively a pathological condition, but may also result from immunogenetic incompatibility of the gametes.