Aging is associated with a significant shift in immune system reactivity (“inflammaging”), as basal inflammation increases but protective responses to infection are compromised. The immune system exhibits considerable sex differences, which may influence the process of inflammaging, including immune cell activation and behavioral consequences of immune signaling (i.e., impaired memory). Here, we test the hypothesis that sex differences in immune aging may mediate sex differences in cognitive decline. Aged male and female rats received peripheral immune stimulation using lipopolysaccharide (LPS), then molecular, cellular, and behavioral outcomes were assessed. We observed that LPS-treated aged male rats showed cognitive impairment and increased neuroinflammatory responses relative to adult males. In contrast, aged female rats did not display these aging-related deficits. Using transcriptomic and flow cytometry analyses, we further observed significant age- and sex- dependent changes in immune cell populations in the brain parenchyma and meninges, indicating a broad shift in the neuroinflammatory environment that may potentiate these behavioral effects. Ovariectomized aged female rats were also resistant to inflammation-induced memory deficits, indicating that ovarian hormones are not required for the attenuated neuroinflammation in aged females. Overall, our results indicate that males have amplified inflammatory priming with age, which contributes to age-associated cognitive decline. Our findings highlight sexual dimorphism in mechanisms of aging, and suggest that sex is a crucial consideration for identifying therapies for aging and neuroinflammation.