Evaluation criteria | Research questions | Indicator | Source of verification |
Relevance & quality at entry (needs and problem assessment) | Relevance - What were the national development priorities addressed by the project? - Were the project development priorities aligned with: o The national strategies? o The donors’ strategies for the countries? - Did the project also respond to a regional integration need? Quality at entry - To what extent were the following dimensions of project design and preparation duly assessed? o Governance structure o Project alternatives o Project financial and economic viability o Implementation arrangements/ contractual agreements - What were the main environmental or social effects, as defined in the ESIA? - On which aspects were the project design and preparation weaker? - Were the risks related to the project complexity well assessed? - Was the project design of such a good quality to be a key factor for the success or failure? | - Evolution of the countries’ macroeconomic outlook - Share of imported petroleum products in Mozambique - Existing energy supply and access to modern energy - Domestic gas consumption forecasts - Domestic demand for electricity generation - Alternative choices to maximize the value of the Tamane/Pande natural gas resources - Estimate of the project costs and benefits at country level | - Project appraisal reports - Project completion reports - The Bank’s Country Strategy Papers - The Bank’s Regional Development Strategy for Southern Africa - World Bank Country Assistance Strategies - National Energy Strategies - National Energy regulatory frameworks - SADC protocol (1999) - Letter of Development Program submitted to the World Bank in support of the Energy Reform and Access Project - Preliminary Information Memorandum |
Effectiveness (Achievement of purpose) & Impact (wider development impact, including Regional Integration) | Effectiveness - Were the project objectives achieved as planned: did the actual results match the performance targets set out initially? - In case the intended results could have been achieved at a higher level of quantity or quality, what project dimensions could have been improved? - Is the project inspiring new forms of collaboration in the region? - Were the project’s environmental adverse impacts mitigated? Impact - To what extent has the project contributed to the socio-economic development of the countries? - To what extent has the project contributed to regional integration process? o Has the project effectively supported the creation of a regional energy market? o Is it attracting new private and multinational investments? o Has the project inspired legislative and policy reforms in the field of energy? | Output: - Physical (Km of pipeline built, installed capacity, etc.) - MGJ of gas annually processed - Number of Social Development Fund interventions implemented - Number of additional small-scale gas investments implemented - Number of resettled homesteads/graves exhumed/machambas compensated - Number of ancillary small businesses and local contractors benefiting from the project Result: - Increased revenues for Government of Mozambique in the form of taxes, royalties and dividends - Cost savings in carbon imports from petroleum products in Mozambique - Increased turnover for Sasol Ltd. and its subsidiaries (“business success”) - Strengthened ENH/CMH technical, financial and organisational capacity - N. of jobs created during construction and operational phases Impact: - Promotion of private sector investments in the gas sector - Increased Foreign Direct Investments - Creation of opportunities for development of domestic gas markets - Reliability of access to modern energy - Creation of a regional energy market - Reforms/Harmonization of legislations | - Project construction progress reports - Annual Supervision Reports - Audited Financial Statements - Project completion reports prepared by different donors - Marco-economic statistics |