Pastoralists face increasing competition for land with crop farmers and nature in and around the W Biosphere Reserve (WBR) in Benin. Our aim was to describe and analyse land use changes in order to understand their drivers, and to describe and analyse the viewpoints of relevant stakeholders in order to understand the competition for land. To this end, remote sensing data, regional statistics, and survey data were collected. We found that crop land expansion around the WBR was the direct driver of decrease of the grazing land area. Population growth and rising demand for food crops, and government support to the cotton sector were indirect drivers of grazing land reduction. Furthermore, competing claims on land among users arose from the complex interaction of crop expansion, presence of WBR and the way it is governed, the lack of support to pastoralists, and the increasing shift of pastoralists’ lifestyle into one of settled crop farmers. Pastoralism is under threat and its survival depends on the successful implementation of policies to support pastoralists and protect grazing lands.