The implementation of public policy in Nigeria has been hindered in various ways by different governments since the 1960s. The result of these challenges stem from the fact that governments suffered from a clear understanding of what constitutes public policy, and also as a result of policy inconsistency. Many governments’ policies have not been effectively implemented for reasons of regime change, lack of political will, lack of bottom-top approach to policy, lack of consultation in policy or decision making and the like. This paper therefore intends to examine the challenges of public policy in Nigeria, with special focus on the education sector. Drawing from extent literature, and using a qualitative analysis, the paper argues that the militating factor against effective policy implementation lies with the lukewarm attitudes of bureaucratic institutions responsible for implementing these policies. Also, it is observed that inconsistency in policy and political will has also served as a major setback to effective policy implementation in Nigeria. The paper therefore is recommending that Policy goals should not be robust, rather, they should be formulated in relation to developmental needs and realities of the target population.