We show that nonreciprocal unidirectional single-photon quantum transport can be achieved with the photonic Aharonov–Bohm effect. The system consists of a 1D waveguide coupling to two three-level atoms of the V-type. The two atoms, in addition, are each driven by an external coherent field. We show that the phase of the external coherent field provides a gauge potential for the photon states. With a proper choice of the phase difference between the two coherent fields, the transport of a single photon can exhibit unity contrast in its transmissions for the two propagation directions.