Social anxiety disorder (SAD) is associated with altered brain function and structure, but most structural studies include small samples and findings are mixed. This study compared regional gray matter volume between 48 SAD patients and 29 healthy controls (HC) as well as the relationship between volume and symptom severity. Structural magnetic resonance images from SAD patients and HC were evaluated using standard voxel-based morphometry (VBM) processing in the SPM8 software package. Social anxiety symptom severity was rated in SAD patients by a clinician using the Liebowitz Social Anxiety Scale (LSAS). SAD patients had greater regional gray matter volume in the lingual gyrus and lateral occipital cortex than the controls, and within the SAD group a positive correlation was found between symptom severity and regional gray matter volume in the lingual gyrus and the retrosplenial cortex. These findings replicate and extend earlier reports of enlarged visual processing areas in SAD. Increased gray matter volume in regions involved in visual processing and self-consciousness could underlie, or be the result of, abnormal emotional information processing and self-focused attention previously demonstrated in patients with SAD.