The aim of this study was to evaluate sexual function in male and female COPD (chronic obstructive pulmonary disease) patients and identify associated factors. Methods: This is a cross-sectional study on 52 COPD patients treated at an outpatient pneumology service of a referral hospital in Northeastern Brazil. Information was collected on demographic, clinical and spirometric variables and exercise capacity. The following instruments and scores were used: modified Medical Research Council (mMRC) for dyspnea, SF-36 for quality of life (QoL), the Beck Depression and Anxiety Inventory, Male and Female Sexual Quotient. Results: Sexual function was satisfactory/excellent in 17% (9/52) and poor/absent in 82% (43/52). Patients with poor/absent sexual function tended to have lower scores on the domain mental health summary score of SF-36 (p = 0.007) and higher anxiety and depression scores than patients with satisfactory/excellent sexual function (p = 0.02 and p = 0.01). In the multivariate analysis, patients with high depression scores displayed a greater likelihood of poor/absent sexual function (OR = 1.13; 95% CI = 1.02–1.25). Conclusion: COPD patients presented a high rate of sexual dysfunction and compromised sexuality was associated with depression