The paper highlights the contribution of Physical Education as a teaching subject in the National Policy on Education of Nigeria, and the need to involve more technocrats in its implementation. Physical education was defined as that aspect of general education which aims at the development of the physical, mental and psychological heath of every school child. Also discussed in this paper include physical education and sports during primitive time and historical background of physical education in Nigeria. The state of sports in Education as contained in the National Sports Policy and Physical education in National Policy on Education were discussed. The paper highlights the position of Physical  education and sports in some African countries like South Africa, Ghana, Cameron and Niger Republics. The paper concludes that Physical Education and school sports are well focused but the planning is often defective, making implementation difficult. Technocrats available for the implementation of a given educational policy are often overestimated and thereby elicit unrealistic expectations that fail to materialize. The paper recommended that the Federal Ministry of Education shall be responsible for Enunciating a National Policy on Education and ensures its Implementation in all the states of the Federation, it also recommends that only physical education technocrats be employed to teach the subject at all levels of Nigerian Educational system.