Evaluation criteria

Research questions

Indicator

Source of verification

Relevance & quality at entry

(needs and problem assessment)

Relevance

- What were the national development priorities addressed by the project?

- Were the project development priorities aligned with:

o The national strategies?

o The donors’ strategies for the countries?

- Did the project also respond to a regional integration need?

Quality at entry

- To what extent were the following dimensions of project design and preparation duly assessed?

o Governance structure

o Project alternatives

o Project financial and economic viability

o Implementation arrangements/ contractual agreements

- What were the main environmental or social effects, as defined in the ESIA?

- On which aspects were the project design and preparation weaker?

- Were the risks related to the project complexity well assessed?

- Was the project design of such a good quality to be a key factor for the success or failure?

- Evolution of the countries’ macroeconomic outlook

- Share of imported petroleum products in Mozambique

- Existing energy supply and access to modern energy

- Domestic gas consumption forecasts

- Domestic demand for electricity generation

- Alternative choices to maximize the value of the Tamane/Pande natural gas resources

- Estimate of the project costs and benefits at country level

- Project appraisal reports

- Project completion reports

- The Bank’s Country Strategy Papers

- The Bank’s Regional Development Strategy for Southern Africa

- World Bank Country Assistance Strategies

- National Energy Strategies

- National Energy regulatory frameworks

- SADC protocol (1999)

- Letter of Development Program submitted to the World Bank in support of the Energy Reform and Access Project

- Preliminary Information Memorandum

Effectiveness

(Achievement of purpose) & Impact (wider development impact, including Regional Integration)

Effectiveness

- Were the project objectives achieved as planned: did the actual results match the performance targets set out initially?

- In case the intended results could have been achieved at a higher level of quantity or quality, what project dimensions could have been improved?

- Is the project inspiring new forms of collaboration in the region?

- Were the project’s environmental adverse impacts mitigated?

Impact

- To what extent has the project contributed to the socio-economic development of the countries?

- To what extent has the project contributed to regional integration process?

o Has the project effectively supported the creation of a regional energy market?

o Is it attracting new private and multinational investments?

o Has the project inspired legislative and policy reforms in the field of energy?

Output:

- Physical (Km of pipeline built, installed capacity, etc.)

- MGJ of gas annually processed

- Number of Social Development Fund interventions implemented

- Number of additional small-scale gas investments implemented

- Number of resettled homesteads/graves exhumed/machambas compensated

- Number of ancillary small businesses and local contractors benefiting from the project

Result:

- Increased revenues for Government of Mozambique in the form of taxes, royalties and dividends

- Cost savings in carbon imports from petroleum products in Mozambique

- Increased turnover for Sasol Ltd. and its subsidiaries (“business success”)

- Strengthened ENH/CMH technical, financial and organisational capacity

- N. of jobs created during construction and operational phases

Impact:

- Promotion of private sector investments in the gas sector

- Increased Foreign Direct Investments

- Creation of opportunities for development of domestic gas markets

- Reliability of access to modern energy

- Creation of a regional energy market

- Reforms/Harmonization of legislations

- Project construction progress reports

- Annual Supervision Reports

- Audited Financial Statements

- Project completion reports prepared by different donors

- Marco-economic statistics