Sclerosing cholangitis is a spectrum of chronic progressive cholestatic liver disease characterized by inflammation, fibrosis, and stricture of the bile ducts, which can be classified as primary and secondary sclerosing cholangitis. Primary sclerosing cholangitis is a chronic progressive liver disease of unknown cause. On the other hand, secondary sclerosing cholangitis has identifiable causes that include immunoglobulin G4-related sclerosing disease, recurrent pyogenic cholangitis, ischemic cholangitis, acquired immunodeficiency syndrome-related cholangitis, and eosinophilic cholangitis. In this review, we suggest a systemic approach to the differential diagnosis of sclerosing cholangitis based on the clinical and laboratory findings, as well as the typical imaging features on computed tomography and magnetic resonance (MR) imaging with MR cholangiography. Familiarity with various etiologies of sclerosing cholangitis and awareness of their typical clinical and imaging findings are essential for an accurate diagnosis and appropriate management.