In Australia, the introduction of extension approaches based on adult learning, action learning and action research theory has resulted in a turn around in the way in which Research, Development and Extension (RD&E) agencies operate. These approaches are being used particularly in projects involving farmer groups to improve decision‐making skills of both fanners and extension agents and have become common agendas of funding bodies and agencies that support such projects. However, the questions remain concerning both funding bodies and extension agencies: ‘Does participatory action learning (PAL) make a difference? And is it more effective than traditional models of extension for improving the adoption of sustainable farming practices? This paper presents the results from evaluating the learning occurring within an on‐going conservation cropping farmer group using PAL. The results illustrate real‐world evidence to suggest that participatory action learning and other action research based approaches make a difference in improving the effectiveness of group learning compared to more traditional extension approaches. Qualities of and indicators for effective learning can be developed from empirical research as well as common concepts drawn from theories of learning. In addition, the use of qualitative evaluation methods (eg. convergent interviewing) and ‘soft’ systems approaches, are useful for traditionally perceived ‘difficult‐to‐measure’ advances in learning. The overall finding is that PAL was both feasible and rewarding.