In an extensive search for bioactive compounds from plant sources, the composition of different extracts of rosemary leaves collected from different geographical zones of Serbia was studied. The qualitative and quantitative characterization of 20 rosemary (Rosmarinus officinalis) samples, obtained by microwave-assisted extraction (MAE), was determined by high performance liquid chromatography coupled to electrospray quadrupole-time of flight mass spectrometry (HPLC–ESI-QTOF-MS). The high mass accuracy and true isotopic pattern in both MS and MS/MS spectra provided by the QTOF-MS analyzer enabled the characterization of a wide range of phenolic compounds in the extracts, including flavonoids, phenolic diterpenes and abietan-type triterpenoids, among others. According to the data compiled, rosemary samples from Sokobanja presented the highest levels in flavonoids and other compounds such as carnosol, rosmaridiphenol, rosmadial, rosmarinic acid, and carnosic acid. On the other hand, higher contents in triterpenes were found in the extracts of rosemary from Gložan (Vojvodina).