There is broad agreement among researchers that the next facing of the construction material industry is ‘geopolymer composites’, also called ‘green composites. Although geopolymer composites have been extensively investigated as a new sustainable building material in recent years, their acceptability is still limited owing to few critical fragilities as a commercial material for construction. However, recent progress on geopolymer composites by several scientists suggests that it could be designed at the nanoscale to significantly enhance the chemical and physiomechanical characteristics to overcome multiple limitations. Graphene, a 2D nanomaterial, has been reported to improve various crucial properties when combined with geopolymer composites. This review paper starts with a bibliometric investigation of the studies related to graphene reinforced geopolymer composites (GRGC) to provide useful insights into current research trends. The paper described the synthesis of suitable graphene derivatives and the manufacturing of different phases of GRGC, namely ink, paste, mortar, and composites. Then a critical review is provided on the mechanical and electrical properties enhancement of graphene geopolymer matrix systems through the modification of the composite matrix at the nano-micro structural level. The GRGC has the potential to be used in multiple applications, such as the recycling of industrial solid waste, and is addressed in this paper. Research gaps were identified in the areas of suitable forms of graphene materials synthesis, dispersion, geopolymer binder type, mixing design, microstructure, and acceptance as well as implementation. The review clarifies those challenging aspects and presents guided solutions for developing sustainable, resilient, and efficient geopolymer matrix-based future materials.