Symbiotic microorganisms that reside in the human intestine are adept at foraging glycans and polysaccharides, including those in dietary plants (starch, hemicellulose and pectin), animal-derived cartilage and tissue (glycosaminoglycans and N-linked glycans), and host mucus (O-linked glycans). Fluctuations in the abundance of dietary and endogenous glycans, combined with the immense chemical variation among these molecules, create a dynamic and heterogeneous environment in which gut microorganisms proliferate. In this Review, we describe how glycans shape the composition of the gut microbiota over various periods of time, the mechanisms by which individual microorganisms degrade these glycans, and potential opportunities to intentionally influence this ecosystem for better health and nutrition.