Environmental experiences play a critical role in shaping the structure and function of the brain. Its plasticity in response to different external stimuli has been the focus of research efforts for decades. In this review, we explore the effects of adversity on brain’s structure and function and its implications for brain development, adaptation, and the emergence of mental health disorders. We are focusing on adverse events that emerge from the immediate surroundings of an individual, i.e., microenvironment. They include childhood maltreatment, peer victimisation, social isolation, affective loss, domestic conflict, and poverty. We also take into consideration exposure to environmental toxins. Converging evidence suggests that different types of adversity may share common underlying mechanisms while also exhibiting unique pathways. However, they are often studied in isolation, limiting our understanding of their combined effects and the interconnected nature of their impact. The integration of large, deep-phenotyping datasets and collaborative efforts can provide sufficient power to analyse high dimensional environmental profiles and advance the systematic mapping of neuronal mechanisms. This review provides a background for future research, highlighting the importance of understanding the cumulative impact of various adversities, through data-driven approaches and integrative multimodal analysis techniques.