The simplest way to produce the Raman beams needed for atomic gravimetry is using a phase modulator. This process, however, produces additional frequencies that introduce a spatial modulation on the Rabi frequency. In this work, we show that using a calcite crystal and a polarizer in the retro-reflected beam, it is possible to remove the undesired frequency components and the spatial Rabi frequency modulation, resulting in Raman beams with perpendicular polarization and preserving the advantages of the modulation technique without their unwanted interference effects. We discuss how the calcite crystal enables polarization combinations that were not easily accessible before using a phase modulator alone.