Skip to main content

Albania

EVAL_Trade_UNDA2023W_MR_2024

Global Initiative towards post-Covid-19 resurgence of the MSME sector (UNDA project 2023W) Period of Review: 2020 - 2023   Date of Evaluation Report: 30/04/2024 

Languages and translations
English

MANAGEMENT RESPONSE

Evaluation Title: Global Initiative towards post-Covid-19 resurgence of the MSME sector (UNDA project 2023W)

Period of Review: 2020 - 2023

Date of Evaluation Report:

30/04/2024

Approved by:

Chief, PMU Nicolas Dath-Baron

Date Signature 05/06/2024

Cleared by:

Director of Divisions: Elisabeth Türk, Economic Cooperation and Trade Division Dario Liguti, Sustainable Energy Division

18/07/2024

Prepared by:

UNECE Project Managers: Hana Daoudi Oleg Dzioubinski

05/06/2024

1

2

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

Recommendation 1:

1. (i) UNCTAD should further leverage the experience gained through the project to map out how components of the Entrepreneurship Policy Framework relate to and can be best positioned to support MSMEs in their recovery from different types of crises and (ii) DESA and the Regional Commissions should add their analysis of how their work can contribute towards the objective.

2. UNCTAD, DESA and the Regional Commissions could build on the project to map their areas of intervention in support of the MSME sector, as well as capacities and knowledge on the implementation of the EPF components, including in a crisis context, and opportunities for broadening the uptake of EPF components at the regional level based on national needs. UNCTAD, DESA and the Regional

Accepted Through existing and future UNDA projects and subject to the availability of funds and the potential for synergies withs UNCTAD, DESA and the remaining regional commissions, UNECE will focus its actions on three key areas:

Integration of evidence-based sectoral insights, focused on the impact of trade disruptions and fluctuations in national, regional and global sustainable development for guiding the development of resilience strategies for MSMEs within the EPF.

Capacity-building: UNECE can help MSMEs implement the strategies outlined in the EPF through training on new technologies, sustainable trade practices to mitigate the effects of crises and capitalize on new market opportunities as they arise.

Strengthening broad-based networks and partnerships, which bring together national and local governments; UNECE sustainable trade expert communities, enterprise

UNECE Economic Cooperation and Trade Division and Sustainable Energy Division

2 years Yes

3

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

Commissions could further consider identifying areas of joint interventions that would trigger complementarities and synergies between the agencies. This could involve collaborating on the development of capacities of all national and sub-national actors, i.e. Governments, MSMEs, other partners (e.g. Chamber of Commerce, Business Incubators, etc.) in line with United Nations Sustainable Development Cooperation Frameworks (SDCF) in respective countries; strengthening or contributing to facilitate access to finance for the MSMEs (including seed money, grants, access to credit, etc.); improving the coordination of MSMEs related policies across ministries; increasing interventions at the local level, such as by supporting NGOs or MSMEs outside of the main cities. The application of a human rights-based approach, gender responsiveness and

support organizations working with UNECE and MSMEs to support the practical application of the EPF.

4

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

inclusion of other vulnerable groups (LNOB) should be ensured.

Recommendation 2:

UNCTAD should continue building on the momentum generated by the project to continue fostering knowledge exchanges and promoting the Entrepreneurship Policy Framework.

UNCTAD, DESA and the Regional Commissions should identify means to more meaningfully continue to share good practices and lessons learned on the demand-driven support they provide to the MSME sector, including on areas such as green/circular economy; innovation policies and ecosystems; MSME formalization and strengthening MSME capacities for the empowerment and leadership of women, youth and groups in vulnerable situations. UNCTAD and the Regional Commissions could also

Accepted Through existing and future UNDA projects and subject to the availability of funds and the potential for synergies with UNCTAD, DESA and the remaining regional commissions, UNECE’s actions can be framed around the following activities:

Facilitating knowledge exchange by participating in, and possibly co-hosting national and regional events for discussing emerging issues and sharing national and regional experiences.

Promoting best practices by leveraging its extensive network and expertise to compile and disseminate case studies and success stories from its member states.

Supporting national, regional and sector- specific initiatives that align with the EPF, including contributing to the development of policies and programs that foster innovation, the transition to a circular

UNECE Economic Cooperation and Trade Division and Sustainable Energy Division

2 years Yes

5

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

propose organizing regional events and/or a global conference to promote entrepreneurship policy and further advance the goals and impact of the Surge project. Furthermore, learnings from the experiences with the Surge about external partnerships should encourage UNCTAD to promote the EPF and entrepreneurship development to other UN agencies also engaged in this area (e.g. ILO, FAO, UN Women, etc.), to development banks, or to related initiatives such as the recent Global Accelerator on Jobs and Social Protection. UNCTAD could also consider joining and supporting events that promote the achievement of SDG 8.3 as an avenue to further promote the EPF.

economy, and enable MSMEs to integrate sustainability practices throughout their supply chains.

Recommendation 3:

The DA-PMT should develop a clear framework for assessing the costs and benefits of implementing a global or

6

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

inter-regional project versus regional projects.

As a global crisis can affect regions and countries differently, global or joint projects should be developed only when there are clear benefits of joint implementation. Thus, a global or inter-regional vs. regional response would not be a priori decision, but a result of a clear assessment. A specific guideline or framework should be developed for this. Some of the assessment criteria could include the need or demand from member States for an integrated response; the range of common versus entity-specific activities and added value of complementary interventions (i.e. in terms of geographical coverage, reach of the target population, capacity, and/or coverage of multiple reinforcing technical areas, or networks and partnerships); capability to execute joint interventions (e.g. in terms of time, resources, logistics, and flexibility to

7

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

pivot interventions without bureaucratic procedures); coordination costs (which increase with the number of participating UN entities); project inception modalities and governance and knowledge management requirements to facilitate collaboration and knowledge sharing; scaling and sustainability plans; expected results of spreading resources versus concentrating on fewer countries; and so forth. The time taken to conduct such assessments will increase project coherence and effectiveness and facilitate the identification of the financial and human resources needed for project implementation. The network of DA Focal Points is a key existing asset for this assessment.

Recommendation 4:

Implementing UN entities should ensure that they have a comprehensive Results Framework for the entire project as well as an

Accepted This guidance already exists for UNECE projects, whether funded from XB or UNDA. UNECE divisions will continue to apply and enrich in future projects.

UNECE Economic Cooperation and Trade Division and Sustainable Energy Division

8

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

adequate monitoring plan, with indicators that are designed to support the ongoing monitoring.

The results framework should have one objective and ideally have one outcome per cluster/workstream. The objective should state the intended goal of the project, describe the overall achievement targeted by the project, involving a process of change aimed at meeting the needs of identified beneficiaries, and reflect the overall funding available to the project. Each objective should include reference to the project’s beneficiaries and its substantive focus. The objective should not attempt to explain the ways in which the project intends to achieve the objective (i.e. it should not include the word ‘through’ or describe the internal work of the UN using verbs such as ‘support’, ‘facilitate’ or ‘contribute’). The outcomes (OCs) should describe the changes that are expected to occur as a result of the completion of outputs.

9

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

The OCs should be achievable within the project’s timeframe and budget, and should be specific enough to be measured by the associated indicators of achievement. The indicators of achievement (IAs) should provide measures for monitoring progress towards achieving the OCs and reporting on them after completion of the project. Every indicator needs to provide clearly defined baselines, units of measurement and targets, detailing the quantity, quality and timing of expected results. The monitoring, evaluation, accountability, and learning (MEAL) system should also be designed to capture HRBA, gender and LNOB aspects. In phased interventions or during project execution, any changes in the logframe if/when pivoting activities should be clearly explained to the wider team.

Recommendation 5: Accepted This guidance already exists for UNECE projects, whether funded from XB or

UNECE Economic Cooperation and

10

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

Implementing UN entities should ensure that sufficient resources are allocated to project coordination, technical collaboration, and partnership building.

The absorption capacity of implementing entities can be challenged by crisis response projects which add to the planned programme of work. This is further compounded by projects that come with an extensive UN partnership and a global scope. Sufficient resources should be dedicated to global coordination and to building global partnerships with strategic stakeholders (e.g., UN organisations engaged in supporting the MSME sector; development banks). Capacities should also be directed to supporting technical collaboration and the staff implementing interventions, including towards synergy or liaison with the UNCTs. When designing the project, implementing UN entities should consider featuring

UNDA. UNECE divisions will continue to apply and enrich in future projects.

Trade Division and Sustainable Energy Division

11

Evaluation Recommendation (a) Management

response (b) Accepted, partially

accepted or rejected

Management plan Actions to be taken, and/or

comments about partial acceptance or rejection (c)

Responsible unit (d)

Timeframe (e)

Resources required

(Y or N) (f)

coordination and partnership- building in the Theory of Change or logframe of the project. Tools to support continuous connections and knowledge exchange, and to ensure institutional memory should be part of the response package, such as a project website, SharePoint space for all team members, and a Yammer network or Teams channel. The integration of cross-cutting aspects (HRBA, gender responsiveness, LNOB) also requires expertise with sufficient and dedicated time and resources. Guidance could be development to project managers on how to do this.

EVAL_Trade_UNDA2023W_ToR_2024

Evaluation Terms of Reference  Evaluation of the United Nations Development Account 12th tranche “Global Initiative towards post-Covid-19 resurgence of the MSME sector” (2023W)  

Languages and translations
English

Annex 7: Evaluation Terms of Reference Evaluation of the United Nations Development Account 12th tranche “Global Initiative towards post-Covid-19 resurgence of the MSME sector” (2023W)

TERMS OF REFERENCE

A. BACKGROUND A1. ABOUT THE DEVELOPMENT ACCOUNT

The Development Account (DA) is a mechanism to fund capacity development projects of the 10 economic and social entities of the United Nations Secretariat, namely: the Department of Economic and Social Affairs (DESA), the Economic Commission for Africa (ECA), the Economic Commission for Europe (ECE), the Economic and Social Commission for Asia and the Pacific (ESCAP), the Economic and Social Commission for Western Asia (ESCWA), the Economic Commission for Latin America and the Caribbean (ECLAC), the United Nations Conference on Trade and Development (UNCTAD), the United Nations Environment Project (UNEP), the United Nations Human Settlements Project (UN-Habitat) and the United Nations Office on Drugs and Crime (UNODC). The DA provides capacity development support to developing countries in their implementation of the 2030 Agenda for Sustainable Development, as well as recommendations and decisions made in intergovernmental processes and relevant governing bodies. The DA-funded projects build on the mandates, individual technical capacities and comparative advantages of the respective implementing entities, while providing those mostly non-resident entities with the ability to operationalize their knowledge and know-how to deliver capacity development support at regional, sub-regional and country levels. The Under-Secretary-General (USG) for Economic and Social Affairs is designated as the Project Manager of the Development Account with responsibility for overall coordination, programming, monitoring and evaluation, as well as for reporting to the intergovernmental bodies. The Project Manager is supported by the DA Steering Committee, who advises him/her on strategic policy and project-support matters.166 The Project Manager is also supported by the DA Project Management Team (DA-PMT) located within the Capacity Development Programme Management Office (CDPMO) of DESA, which assists with all aspects of the management of the DA, in particular with regard to programming, monitoring, evaluation and reporting. DA-PMT also liaises with the DA Focal Points in the implementing entities, who are most often the head of the entity’s unit responsible for project planning, project management, capacity development or technical cooperation, on all aspects of the management of DA-funded projects. In response to the COVID-19 crisis, the Development Account has funded five short-term joint projects to help developing countries alleviate the socio-economic impact of the pandemic, including the project on Global initiative towards post-COVID-19 resurgence of the MSME sector (2023W).

A2. ABOUT THE PROJECT The COVID-19 crisis is plunging the global economy into a deep recession and micro, small and medium enterprises – which play a major role in emerging economies – are amongst the hardest hit. Trapped in economic stagnation due to large-scale lockdowns, millions of MSMEs have become the most vulnerable to COVID-19 within the private sector. Compared with large firms, small businesses have fewer resources and lower capacities to cope with the abrupt economic shocks economies are currently facing. With more than two-thirds of the global population employed by MSMEs, the unprecedented outbreak of the pandemic has vividly shown how tightly their activities are woven into the economic and social fabric of the world, as well as their critical role in social and economic resurgence. The objective of the project is to develop and implement capacity-building tools for governments and micro, small and medium enterprises (MSMEs) to facilitate the resurgence and strengthen the resilience of MSMEs in developing countries and economies in transition. These capacity-building tools will seek to mitigate the

economic and social impact of the global COVID-19 crisis and to facilitate the contribution of MSMEs to the SDGs implementation. The project was designed based on the request for assistance for MSMEs from more than 50 Member States, including countries in Latin America and the Caribbean, Asia and the Pacific, Africa, Europe and the Arab regions, as well as intergovernmental demands and resolutions on COVID-19. The project is jointly implemented by UNCTAD, DESA, ECA, ECE, ECLAC, ESCAP and ESCWA, and builds upon the comparative advantages of the participating agencies to provide immediate advice, capacity-building and support to governments and MSMEs during the ongoing global pandemic. The project is structured in five clusters that address the most critical areas of the MSME recovery. Broadly, the roles and lead entities for each of the clusters and workstreams are as presented in the following table:

Table 1. Project clusters and leads Project cluster/workstream Lead agency

Overall coordination UNCTAD

Project cluster/workstream 1 Entrepreneurship and business skills promotion

UNCTAD

Project cluster/workstream 2 Business facilitation/formalization

UNCTAD/DESA

Project cluster/workstream 3 Access to finance/financial literacy

ESCAP

Project cluster/workstream 4 Access to technology and innovation

UNECA

Project cluster/workstream 5 Access to markets

UNECE

The beneficiary countries cover different geographical regions, as shown in Annex 2. The expected outcomes, indicators of achievement, and outputs are presented in the project results framework (Annex 3). The project was developed and implemented under three phases. A new set of outputs was designed or added at each of the three phases of the project. Under the three-phase approach, the project budget was approved by phase. In 2021, when the phase 3 budget was discussed, the Development Account faced a funding gap. To bridge the gap, in November of the same year, the five joint projects were requested to reduce their proposed phase 3 budget by 1 million USD, which led to the curtailment of certain planned activities. For this project, the budget was reduced by $310,000. Overall, a total of $4,490,500 was allocated under this project. Concretely, UNCTAD received $2,671,000, ECLAC received $134,000, ESCAP received $240,000, ECA received $467,000, ECE received $448,500, ESCWA received $370,000 and DESA received $160,000. The project started its implementation in May 2020 and was scheduled to conclude on 31 March 2022, but received approval in February 2022 for an extension until 30 June 2022.

B. EVALUATION OBJECTIVES AND SCOPE B1. EVALUATION PURPOSE, OBJECTIVES AND SCOPE

The present evaluation will constitute a terminal evaluation of the Project. Terminal evaluations are mandatory for all DA-funded projects with a value above $1 million. The evaluation will be largely guided by the UN Development Account Project Evaluation Guidelines, issued in October 2019 and the evaluation policies of the implementing entities, in particular, UNCTAD, which leads the evaluation. The main purpose of the evaluation will be to support accountability for results, and to enable learning. This terminal evaluation of the project has the following specific objectives:

• Assess the results and establish the link between achievements and activities of the intervention;

• Assess the response delivery and external coordination167, including the extent of gender, human rights and disability mainstreaming; and • Identify good practices and lessons learned from the project that could feed into and enhance the implementation of related interventions.

The primary intended users of the assessment are the management of the implementing entities. The evaluation will also provide accountability to project beneficiaries and member States. Furthermore, the evaluation will form a key input to the programme-level evaluation of the DA’s response to COVID-19 to be initiated by the CDPMO/DESA. The programme-level evaluation will entail: a synthesis of the terminal evaluations of five COVID-19 joint DA projects, including this project; a review of relevant 10th and 11th tranche DA projects; and a programme-level assessment. The primary audiences of the programme-level evaluation will include the DA Steering Committee, the DA-Programme Management Team (DA-PMT), and the management of the implementing entities. The results of the programme-level evaluation will also be presented to the General Assembly, through the biennial progress report on the implementation of the DA. The evaluation will cover the duration of the project from May 2020 to 30 June 2022, covering all phases, clusters and activities.

B2. EVALUATION CRITERIA AND QUESTIONS The evaluation will assess the Project’s performance against the main criteria of relevance, efficiency, effectiveness, coherence, sustainability, gender, human rights and disability. In particular, the evaluation is expected to address a number of questions under the following criteria168:

Table 2: Evaluation criteria and tentative questions Relevance 1. To what extent was the project designed to target the new

needs and priorities of participating countries as a result of COVID- 19?

Relevance 2. To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g. COVID-19 Socio-Economic Response Plan)?

Efficiency 3. How well coordinated was the response among the entities implementing the joint project?

Efficiency 4. How did the three-phase budgeting and programming approaches impact the efficient delivery of the project?

Effectiveness 5. To what extent did the programme (Development Account) and project governance and management structures and processes enabled, or hindered, the effective implementation of the joint project and the achievement of its results?

Effectiveness 6. To what extent has the project contributed to the expected outcomes as enunciated in the project document?

Effectiveness 7. How did the response contribute to the participating country Governments’ responses to COVID-19, especially in the area of MSME resurgence?

Effectiveness 8. What innovative approach or tool, if any, did the response use, and what were the outcomes and lessons learned from its application?

Sustainability 9. What measures were adopted to ensure that the outcomes of the response would continue after the project ended?

Coherence 10. To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

Coherence 11. To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non-Secretariat) to COVID-19 in delivering socio-economic support to Member States?

Gender, human rights and disability

12. To what extent were gender, human rights and disability perspectives integrated into the design and implementation of the project? What results can be identified from these actions?

C. EVALUATION APPROACH AND METHODOLOGY The evaluation will be a transparent and participatory process involving the Project’s implementing entities and key stakeholders. It will be conducted based on gender and human rights principles and adhere to the United Nations Evaluation Group (UNEG) Norms and Standards for Evaluation. The evaluation will apply a mixed-method design, including a combination of quantitative and qualitative analysis to inform findings.It is anticipated that travel of the evaluation team may take place in support of elaborating case study/ies, as well as to meet key project stakeholders in Geneva (UNCTAD and ECE). The selection of potential case study/ies and travel requirements will be developed as part of the inception report. Following a preliminary documentation review and a limited number of inception meetings with the core project team, the Evaluation Team will develop an inception report for the evaluation, which will include the finalized overall scope and focus of the evaluation, evaluation questions and methodology, including information on data sources and collection, sampling, key indicators, stakeholder mapping, selection of case study/ies, survey design, and the evaluation timeline. The tentative methodology for the evaluation is presented in Table 4.

Table 3: Tentative methodology for the assessment

a. A desk review of Project documents, including documents/data related to: o Project-level planning, implementation and results achievement, including but not limited to:

▪ Concept note, Phase 2 project proposal, and Phase 3 budget and outputs ▪ Progress report for Phases 1 and 2 (both financial and substantive/narrative report) ▪ Final report (both financial and substantive/narrative report) ▪ Meeting minutes, including the minutes of the bi-weekly/monthly DA network meetings ▪ Monitoring reports ▪ Information on non-DA resources, financial and in-kind, brought in by the participating entities ▪ Information on resources, financial and in-kind, contributed by partners/donors (including information requested under the “supplementary funding” section in the progress reports, which is often incomplete) ▪ Beneficiary/user feedback collected, including, but not limited to, workshop survey results, user feedback on publications, advisory services, guidelines, methodology documents, etc. ▪ Requests for assistance/services received ▪ List of activities completed and details about each activity, including but not limited to:

▪ Agenda, participant lists (name, title, division/unit, organization, country, gender, email address), report and any outcomes document, for each workshop/meeting ▪ Description of each advisory service, beneficiaries (including contact details of the contact persons) and any outputs/deliverables produced ▪ List and description of tool(s), research papers, policy briefs, studies published and information on how each product was disseminated and/or used, list of recipients/users of the product (e.g., dissemination lists)

▪ Documentation related to broader projects or sub-projects of the participating entities of which the Project or its component(s) has constituted an integral part or which are linked to and/or build upon/succeed the work undertaken as part of the Project ▪ Documents and literature related to the Project context ▪ Relevant web and social media metrics related to the outputs of the project;

o Project strategic documents, including but not limited to: ▪ General Assembly's Resolution on Global Solidarity to fight the coronavirus disease 2019 (COVID-19) (A/RES/74/270);

▪ Secretary General's report on "Shared responsibility, global solidarity: Responding to the socio-economic impacts of COVID-19"; ▪ UN Framework for the immediate socio-economic response to COVID-19; ▪ 2021 Programme budget and mandate of implementing entities; ▪ COVID-19 Socio-Economic Response Plan of participating countries.

b. Questionnaires/surveys (in appropriate languages in addition to English) to relevant stakeholders in countries participating in a sample of project activities; c. Telephone, online or in-person interviews with key stakeholders, including but not limited to:

o Project Coordination Team and project focal points of implementing entities o DA-PMT o DA focal points in participating entities o Sample of UN Resident Coordinators/Country Teams, as appropriate o Sample of key global partners o Sample of country-level stakeholders (mainly stakeholders from key beneficiary countries)

d. Case Study/ies, which may include for example a detailed examination of a particular intervention, or of project activities at a regional or national level.

In addition to assessing the mainstreaming of gender, human rights and disability perspectives in the design, implementation and monitoring of the Project (evaluation question 12), the evaluation will integrate these perspectives in the management of the evaluation, data collection and analysis, as well as the development of the evaluation report. Gender balance will be given full consideration in the composition of the Evaluation Reference Group, elaborated in Section D1 (Evaluation management), and the Evaluation Team. Data collected and analyzed in the course of the evaluation will be disaggregated by gender to the extent possible and whenever appropriate, and the evaluation findings, conclusions and recommendations to be presented in the evaluation report will reflect a gender analysis. The evaluation will be carried out according to the UNEG ethical principles and standards.169 The evaluators should demonstrate behavioural independence, impartiality, credibility, honesty, integrity and accountability in conducting the evaluation/assessment to avoid biasing the findings. The evaluators must also address in the design and conduct of the evaluation procedures to safeguard the rights and confidentiality of information providers. The Evaluation Manager will be responsible for ensuring that the Evaluation Team conducts the work assignments without any undue interference from those who were responsible for the implementation of the Project.

D. ORGANIZATION OF THE EVALUATION D1. EVALUATION MANAGEMENT

The independent final project evaluation will be managed/coordinated by UNCTAD’s Independent Evaluation Unit, with the support of an Evaluation Advisory Committee (EAC) that comprises a representative each of the evaluation units of the partner entities (DESA, ECA, ECE, ECLAC, ESCAP, ESCWA) and the Evaluation Officer with the CDPMO/DESA. The EAC primarily serves a quality assurance function and facilitates support to the Evaluation Team as necessary. An Evaluation Reference Group (ERG) consisting of a representative from each UN partner entity (e.g., the DA Focal Point for each entity) and the DA-PMT will review and contribute inputs to key steps in this evaluation such as the TOR and draft final report. Both the EAC and the ERG commit to submitting substantive comments on a timely basis, and comments will be invited on a ‘non-objection’ basis (no response = agree) so that the process is not delayed for an unnecessarily long time. An independent Evaluation Team will be convoked to undertake this assignment. The Evaluation Team (ET) is responsible for conducting the evaluation, applying the methodology as appropriate and for producing the evaluation report. All team members, including the Team Leader, will participate in briefing and debriefing meetings, discussions, and will contribute to the evaluation with written inputs for the draft and final report. A selected number of the evaluation team members will participate in the mission travel(s) if applicable. The ET and the Evaluation Manager will agree on the outline of the report, in consultation with

the EAC early in the evaluation process. The ET will develop its own evaluation tools and framework, within the available timeframe and resources. The team is fully responsible for its report, which may not reflect the views of any of the implementing entities of the project. The evaluation report is subject to quality control by the Evaluation Advisory Committee and clearance by the Evaluation Manager, as set out above. The Team Leader guides and coordinates the team member(s) in their specific work, discusses their findings, conclusions and recommendations and prepares the draft and the final report, consolidating the inputs from the team member(s) with his/her own. The members of the evaluation team should possess a mix of evaluation skills and technical or sectoral/thematic knowledge relevant to the evaluation. In putting together the team, adequate linguistic, geographic and gender representation will also be key considerations. The Evaluation Team will be provided full access to all project reports, documentation, and stakeholder lists and contact information. The Project Coordination Team are required to submit to the evaluation manager project documentation, including data and information residing with the other participating entities, in the last month of the project if possible, if not, immediately following the completion of the project, as well as support the evaluation process, including through facilitating the evaluators’ access to the project’s beneficiaries and other key stakeholders. The roles and responsibilities in the evaluation process are described below:

Evaluation Manager (UNCTAD) will: • Prepare the draft evaluation TOR and revise/finalize based on inputs received • Prepare the TOR for each member of the Evaluation Team (Team Leader, Team Member and Expert(s)) • Recruit and manage the Evaluation Team • Backstop the evaluation process, including supporting the development and administration of surveys, support outreach of the evaluation team to project stakeholders, and access to secondary data listed in Table 3. • Oversee/provide quality assurance to the evaluation and the development of the evaluation report • Facilitate the work of the Evaluation Advisory Committee and the Evaluation Reference Group • Be responsible for clearance of the evaluation report • Support the development of a management response to the evaluation report, including an implementation plan • Organise a virtual workshop on evaluation findings and lessons learned.

Evaluation Advisory Committee comprises a representative each of the evaluation units of the partner entities (ESCWA, ECA, ECE, ECLAC, ESCAP, DESA) and the Evaluation Officer with the CDPMO/DESA. The EAC primarily serves a support and quality assurance function. Specific responsibilities of the EAC include:

• Review and approve the evaluation TOR; • Advise on the selection of the evaluation consultant(s) to ensure that the selection is based on the required skills and qualifications; • Support facilitating access from their respective entities to relevant project documentation and stakeholders; • Review and comment on the inception and evaluation reports; and • Monitor and conduct periodic follow-ups on the implementation of evaluation recommendations addressed to the parties within their entities.

Evaluation Reference Group, consisting of a representative from each UN partner entity (e.g., the DA Focal Point for each entity) and the DA-PMT,170 will review and contribute inputs to key steps in this evaluation such as the TOR and draft final report. The ERG’s key function is to enhance the relevance, credibility and transparency of the evaluation process. Specific responsibilities include:

• To review the draft evaluation ToR and provide substantive feedback; • To facilitate access from their respective entities to relevant project documentation and stakeholders;

• To review the draft evaluation report and provide substantive feedback, including coordinating feedback from other sections, units and offices from headquarters and from the field to ensure quality and completeness; • To participate in the validation meeting of the final evaluation report; • To play a key role in disseminating the findings of the evaluation and implementation of the management response.

Project Coordination Team will: • Facilitate the Evaluation Team’s access to relevant Project documentation and stakeholders, including through:

o Collecting and compiling requested data and information from the participating entities, as requested by the Evaluation Manager o Providing an updated list of stakeholders, and facilitating access to the sample of stakeholders that the Evaluation Team may wish to interview o Facilitating the administration of questionnaires to workshop participants in the participating countries o Ensure the cooperation and contribution of the relevant staff of the implementing entities to the evaluation process, as requested

• Lead the preparation of a response to the recommendations directed to the participating entities, including an implementation plan

DA-PMT will: • Participate in the Evaluation Reference Group • Provide guidance on the allocation of the evaluation budget • Organize a virtual meeting with DA focal points to discuss the key lessons from this evaluation as well as from other COVID-19 joint project evaluations and how to incorporate them in future programming, implementation, monitoring and evaluation of DA-funded projects.

D2. EVALUATION TIME FRAME

The evaluation will be conducted from December 2022 to August 2023. The evaluation process will involve five phases with the tentative timelines as below in Table 5 (the timelines may be adjusted should any exigencies arise):

Table 5: Evaluation phases and tentative timelines Phase Timelines

1. Preparation

August 2022 – December 2022 • Preparation and finalization of evaluation TOR • Establishment of the Evaluation Reference Group • Recruitment of the Evaluation Team • Prepare package of documents required by the Evaluation Team

2. Inception

December 2022 -March 2023 • Preliminary documentation review and preparation of inception report by the Evaluation Team, including development of data collection instruments (questionnaires/ surveys, interview guides) • Brief visit to Geneva (3 days) to meet with UNCTAD Evaluation Unit and key project stakeholders (UNCTAD and ECE) • Draft inception report due: 10 February 2023

• Evaluation Manager review and inception report revision by Evaluation Team: 13 - 22 February 2023 • Reviews by Project Coordination Team, project focal points of implementing entities, and Evaluation Advisory Committee (in parallel): 23 February – 7 March 2023 • Draft final inception report due: 14 March 2023 • Final inception report approved: 20 March 2023

3. Data collection and analysis March- May 2023 • Desk review of remaining Project documents, including requesting additional documentation • Online surveys of stakeholders • Interviews with stakeholders • Data analysis and triangulation

4. Report preparation and reviews May – July 2023 • Data analysis and triangulation • First draft evaluation report due: 16 June 2023 • Evaluation Manager review and report revision by the Evaluation Team: 19 – 28 June 2023 • Reviews by Project Coordination Team, project focal points of implementing entities, Evaluation Advisory Committee and Evaluation Reference Group (in parallel): 29 June – 11 July 2023 • Revised draft evaluation report due: 18 July 2023 • Final evaluation report with annexes: 25 July 2023

5. Dissemination and follow-up August 2023 and onwards • Presentation to the Project Coordination Team, project teams of implementing entities and development and approval of a management response, including an implementation plan for recommendations • Virtual workshop on evaluation findings, lessons learned and follow-up with the DA Focal Points: April 2023

D3. EVALUATION TEAM DELIVERABLES The Evaluation Team will be composed of a team of three consultants (evaluators), namely Team Leader, Team Member and a Gender and Human Rights (HRGE) Expert who also plays the role of Team Member. The two Team Members will report functionally to the Team Leader. The Team Leader will report to the Evaluation Manager. Each of the Evaluation Team has a set of deliverables as described below: Deliverables for Team Leader and Team Member

o Initial review of key Project documents (preliminary document review) o Preparation of an inception report with a finalized evaluation scope and focus, evaluation questions and methodology, including information on data sources, sampling and key indicators, stakeholder mapping/analysis, selection of case study/ies, as well as survey design

o Desk review of remaining Project documents o Data collection and analysis based on the finalized methodology o Preparation of an evidence matrix presenting a summary of evidence collected through each data collection method by evaluation question o Development of a draft evaluation report, based on the template presented in Annex 1, for review by the Evaluation Manager, Project Coordination Team, project focal points of implementing entities, the EAC and the ERG o Revision/finalization of the evaluation report, including all annexes, based on comments received o Preparation of a 3-page summary of the evaluation report and a presentation (PPT) on key findings, conclusions and recommendations o Presentation of evaluation report and discussions with relevant stakeholders such as Project Coordination Team, project teams of implementing entities, DA focal points of participating entities and DA-PMT.

Deliverables for Gender and Human Rights Expert/Team Member

o Initial review of key Project documents (preliminary document review), including identifying gender equality, human rights and disability inclusion dimensions and issues for consideration; o Preparation of an inception report with a finalized evaluation scope and focus, evaluation questions and methodology, including information on data sources, sampling and key indicators, stakeholder mapping/analysis, selection of case study/ies, as well as survey design. Where applicable, gender equality, human rights and disability inclusion considerations will be integrated in the evaluation scope of analysis; evaluation criteria and questions design; methods and tools, and data analysis techniques; o Desk review of remaining Project documents; o Data collection and analysis based on the finalized methodology which would be gender sensitive; o Preparation of an evidence matrix presenting a summary of evidence collected through each data collection method by evaluation question; o Development of a draft evaluation report, based on the template presented in Annex 1 of the Terms of Reference for the evaluation, for review by the Evaluation Manager, Project Coordination Team, project focal points of implementation entities, the EAC and the ERG. The analysis of gender equality, human rights and disability inclusion dimensions and issues should be integrated in the report as an independent section and to the extent possible, these issues should be mainstreamed throughout the report, including in the evaluation findings, conclusions and recommendations. o Revision/finalization of the evaluation report, including all annexes, based on comments received; o Preparation of a 3-page summary of the evaluation report and a presentation (PPT) on key findings, conclusions and recommendations. o Presentation of evaluation report and discussions with relevant stakeholders such as Project Coordination Team, project teams of implementing entities, DA focal points of participating entities and DA-PMT.

E. COMMUNICATIONS AND DISSEMINATION PLAN: The results from the evaluation including key lessons learned, best practices and recommendations will be shared widely with participating entities, partners and stakeholders, and member States. In particular, the following modes of communication could be used:

e. A workshop with all relevant stakeholders to present the key findings, recommendations and lessons learned. The evaluation report will be presented at a workshop attended by the implementing entities, the DA-PMT and other relevant stakeholders for discussion and validation. The implementing

entities will be given the opportunity to present their management response, including an implementation plan for the recommendations; f. A separate virtual meeting will be held with the DA focal points to discuss the key lessons from the evaluation as well as from other COVID-19 joint project evaluations and how to incorporate them in future programming, implementation, monitoring and evaluation of DA-funded projects and projects. g. A copy of the final evaluation report will be published on UNCTAD’s website and the websites of the partner implementing entities, as appropriate; and h. The key findings from the evaluation report will also form a key input to the programme-level evaluation of the DA’s response to COVID-19 to be initiated by the CDPMO/DESA. i. Other communication briefs and products will be produced as appropriate.

EVAL_Trade_UNDA2023W_EvalReport_April2024

United Nations Development Account Terminal Evaluation of Project 2023W “Global Initiative towards post-Covid-19 resurgence  of the MSME sector” (2020-2023) Report completed: April 2024 Evaluation conducted by: Patrick Breard, Ariane Agnes Corradi, Jude Kallick 1 

Languages and translations
English

1

United Nations Development Account

Terminal Evaluation of Project 2023W

“Global Initiative towards post-Covid-19 resurgence of the MSME sector”

(2020-2023)

Report completed: April 2024

Evaluation conducted by: Patrick Breard, Ariane Agnes Corradi, Jude Kallick

2

Evaluators: Patrick Breard, PhD, Team Leader

Ariane Agnes Corradi, PhD, Team Member Jude Kallick, MA, Team Member

Evaluation Manager: Nishta Keeble, Chief, Independent Evaluation Unit, Office of the Secretary-

General, UNCTAD

Contact: Thomas Callaghan, Associate Programme Management Officer, Independent Evaluation Unit, Office of the Secretary-General, UNCTAD. Tel: +41 22 917 5295 Email: [email protected] This report was commissioned by UNCTAD. The findings, conclusions and recommendations of this report are

those of the external evaluator and do not necessarily reflect the views of the UNCTAD.

3

Table of Contents

Lists of figures, tables, and boxes.............................................................................................................................................. 4

List of Acronyms and Abbreviations ........................................................................................................................................ 5

Executive summary ....................................................................................................................................................................... 6

1. Introduction .................................................................................................................................................................................11

2. Description of the Project........................................................................................................................................................11

2.1 Background ...........................................................................................................................................................................11

2.2 Project objectives and expected accomplishments ................................................................................................ 12

2.3 Project strategies and key activities .............................................................................................................................13

2.4 Beneficiaries and target countries................................................................................................................................. 14

2.5 Key partners and other key stakeholders .................................................................................................................. 16

2.6 Resources ........................................................................................................................................................................... 16

2.7 Link to the Sustainable Development Goals (SDGs) ................................................................................................ 17

2.8 Innovative elements ......................................................................................................................................................... 17

3. Evaluation objectives, scope, and questions .................................................................................................................... 17

3.1 Purpose and objectives .................................................................................................................................................... 17

3.2 Evaluation scope, criteria, and questions .................................................................................................................. 18

4. Methodology ............................................................................................................................................................................. 19

5. Findings ....................................................................................................................................................................................... 21

5.1 Relevance ............................................................................................................................................................................. 21

5.2 Coherence .......................................................................................................................................................................... 24

5.3 Efficiency ............................................................................................................................................................................ 29

5.4 Effectiveness ...................................................................................................................................................................... 32

5.4 Sustainability .................................................................................................................................................................... 59

5.5 Gender, Human Rights, and Leave No One Behind ................................................................................................ 64

6. Conclusions ............................................................................................................................................................................... 73

7. Recommendations .................................................................................................................................................................. 76

Annexes .......................................................................................................................................................................................... 78

Annex 1: Project’s Theory of Change ................................................................................................................................. 79

Annex 2: Evaluation matrix.................................................................................................................................................. 80

Annex 3: Data collection instruments .............................................................................................................................. 86

Annex 4: List of documents reviewed ............................................................................................................................... 97

Annex 5: List of individuals interviewed .......................................................................................................................... 99

Annex 6: Evaluation surveys ............................................................................................................................................. 100

Annex 7: Evaluation Terms of Reference ........................................................................................................................ 134

4

Lists of figures, tables, and boxes List of Figures Figure 1: Overview of project activities 13 Figure 2: Allocation of project funding 16 Figure 3: Perceived relevance of the project according to the survey 22 Figure 4: Project outputs per implementing UN entity and phase 27 Figure 5: Number of project outcomes covered by the implementing UN entities 28 Figure 6: Perceived complementarity of the project with other interventions 29 Figure 7: Surge Project outputs delivered per implementing entity and implementation phase 37 Figure 8: DEPAR number of users 38 Figure 9: Effectiveness results of outcome 1.A 38 Figure 10: Effectiveness results of outcome 1.B 40 Figure 11: Effectiveness results of outcome 3 45 Figure 12: Effectiveness results of outcome 4 47 Figure 13: Effectiveness results of outcome 5 48 Figure 14: Outputs per project outcome and implementing entity 53 Figure 15: Project contributions to formulate and implement enabling policies to MSMEs 54 Figure 16: Contribution of the project to improve the resilience and competitiveness of MSMEs in post-. COVID-19 resurgence in a sustainable way 60 Figure 17: Contribution of the project to better outcomes for women and youth entrepreneurs and other vulnerable groups in a sustainable way 61 Figure 18: Contribution of the project to formulate and implement enabling policies for MSME post-COVID-19 resurgence in a sustainable way 61 Figure 19: Contribution of the project to improve the resilience and competitiveness of MSMEs in post-COVID-19 resurgence in a sustainable way 62 Figure 20: Perceived accessibility of project activities for women, youth, people with disabilities or other vulnerable groups 69 Figure 21: Perceived contribution of the project to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups 70 List of Tables Table 1: Project’s beneficiary countries 15 Table 2: Project clusters and lead and participating entities 16 Table 3: Project's implementation phases 17 Table 4: Evaluation questions 18 Table 5: Groups of informants and number of consultations 19 Table 6: Survey recipients and respondents 20 Table 7: Planned and delivered outputs per project phase 37 Table 8: Level of achievement of the Surge project indicators 50 List of Boxes Box 1: ECE’s guidelines and best practices – from a general approach to supporting country-specific responses 55 Box 2: UNCTAD Cross-border Trade and Gender Initiative 68

5

List of Acronyms and Abbreviations

ADB Asian Development Bank

AfDB African Development Bank

DA Development Account

DESA Department of Economic and Social Affairs

EAC Evaluation Advisory Committee

ECA Economic Commission for Africa

ECE Economic Commission for Europe

ECLAC Economic Commission for Latin America and the Caribbean

EMPRETEC Emprendedores (entrepreneurs) and tecnología (technology)

ERG Evaluation Reference Group

ESCAP Economic and Social Commission for Asia and the Pacific

ESCWA Economic and Social Commission for Western Asia

ET Evaluation Team

GDP Gross Domestic Product

GHRP Global Humanitarian Response Plan

HIC High-income Country

HRBA Human Rights-Based Approach

ICT Information and Communication Technology ILO International Labour Organization

IMF International Monetary Fund

LDC Least Developed Country

LIC Low-income Country

LLDC Landlocked Developing Country

LNOB Leaving No One Behind

MIC Middle-income Country

MNE Multinational Enterprise

MPTF Multi-Partner Trust Fund

MSME Micro-, Small and Medium Enterprises

PMT Project Management Team

PRODOC Project Document

RC Resident Coordinator

SDG Sustainable Development Goal

SIDS Small Island Developing States

SPRP Strategic Preparedness and Response Plan

SRO-SA Subregional office for Southern Africa

TCS Technical Cooperation Section

TOC Theory of Change TOR Terms of Reference

UN United Nations

UNCTAD United Nations Conference on Trade and Development

UNDP United Nations Development Programme

UNIDO United Nations Industrial Development Organization

UNOSSC United Nations Office of South-South Cooperation

UNSD United Nations Statistics Division

WHO World Health Organization

WTO World Trade Organization

6

Executive summary Project overview

The project “Global Initiative towards post-Covid-19 resurgence of the MSME sector” aimed at enhancing the resilience of Micro, Small, and Medium Enterprises (MSMEs) in developing countries and economies in transition, especially in the wake of the global COVID-19 crisis. The primary objective of the project was to develop and implement capacity-building tools for both governments and MSMEs. These tools were designed to mitigate the economic and social repercussions of the pandemic, focusing on MSMEs’ contribution to the SDGs. Operationally, the project was structured according to the Entrepreneurship Policy Framework (EPF) of UNCTAD. The EPF aims to support developing country policymakers in the design of initiatives, measures and institutions to promote entrepreneurship. The EPF features 6 key components: 1: Formulating a National Entrepreneurship Strategy; 2: Optimizing the Regulatory Environment; 3: Enhancing Entrepreneurship Education and Skills Development; 4: Facilitating Technology Exchange and Innovation; 5: Improving Access to Finance; and 6: Promoting Awareness and Networking. Building on these components1. The project was operated under five clusters, addressing critical areas of MSME recovery. These clusters included mobilizing entrepreneurial ecosystems, simplifying business registration processes, improving access to finance and financial literacy, increasing access to technology and innovation, and enhancing access to markets. The activities were designed to create an enabling entrepreneurship ecosystem by improving regulatory environments, providing access to innovation, technology, finance, and markets, and reaching out to vulnerable groups such as women and informal workers.

The project commenced in May 2020. The initial completion date was planned for March 2022 but this was extended to June 2022. It underwent three phases involving project startup and approval, initial project delivery and design of scaling up initiatives, and the launch of new activities based on previous results. Beneficiaries of this project included governments, policymakers, MSMEs, business associations, support services, and relevant technical staff in institutions and ministries. The project provided support to 96 beneficiary countries, employing various interventions such as advisory services, training, workshops, seminars, and online platforms. Jointly implemented by UNCTAD, DESA, and the UN regional commissions for Africa (ECA), Europe (ECE), Latin America and the Caribbean (ECLAC), Asia and the Pacific (ESCAP), and the Arab region (ESCWA), the project received financial allocations totalling $4,490,500, with each participating agency implementing its allocated component and managing day-to-day project operations. UNCTAD served as the lead coordinating entity. Key partners in this initiative included UN Development Partners, UN Resident Coordinators, UN Country Teams, UNITAR, UNDP, UNOSSC and ITC. Moreover, the project collaborated with EMPRETEC Centres and other stakeholders such as business incubators and support services. In alignment with the post-2015 development agenda, the project aimed to contribute directly to specific SDGs, particularly SDG 4 (Quality Education), SDG 8 (Decent Work and Economic Growth), and SDG 9 (Industry, Innovation, and Infrastructure).

Evaluation purpose and scope

This evaluation analysed the relevance, coherence, efficiency, effectiveness, and sustainability of the project and its mainstreaming of gender, human rights and disability considerations. The evaluation was carried out between February 2023 and September 2023 following a structured process of data collection and analysis, which included desk review, key informant interviews and online surveys. The evaluation conclusions and recommendations are intended to inform the work of UNCTAD and other UN implementing entities as well as the Development Account Programme Management Team (DA-PMT), which will conduct a synthesis from this evaluation and those of the other four DA Covid-19 projects.

1 According to the Project Document for Phase 2, interventions were selected based on several criteria including to target capacity building areas that are proven to have key impacts on entrepreneurship and MSMEs promotion as based on the formulation and implementation of UNCTAD’s Entrepreneurship Policy Framework (EPF): enabling ecosystem and facilitation of entrepreneurship competencies/motivation, access to finance, technology and markets, networking.

7

Conclusions

Relevance

The project responded to the needs of Governments and MSMEs. Interventions contributed to and were informed by needs and impact assessments. Recipients of project interventions were often involved in or contributed to the design and delivery of project activities and outputs. On various occasions, project outputs were tailored to the needs of target users and beneficiaries, being countries or vulnerable groups. The relevance of the interventions was somewhat mitigated by the mandates and capacities of the implementing UN entities. The latter are equipped for supporting medium- and long- term policy changes rather than immediate crisis responses. Other challenges included the restrictive Covid-19 measures and the short time frame for implementation of the project. Nonetheless, on the whole, the implementing UN entities exercised adaptive management to ensure high relevance of their interventions. The phased approach, in particular, provided the opportunity to introduce new activities not foreseen at an earlier stage.

Coherence

The project was anchored in the mandates and comparative advantages of the implementing UN entities. Selected interventions followed previous work and specific requests from member States and were often coordinated with or complementary to existing activities. At conception, the target of the project was to address specific constraints faced by MSMEs. It was designed around the Entrepreneurship Policy Framework to show the complementarities across interventions that each implementing UN entity would deliver in response to regional priorities and capacities. Some collaborations between implementing UN entities were pursued and complementarities established, but on a limited level. A few synergies in the form of joint outputs were integrated in the 3rd phase of the project. By design, technical task forces created through the project were expected to bridge the implementing UN entities. However, this proved difficult to launch and sustain, owing to several constraints, including a highly ambitious objective given the global crisis and competing priorities within each agency. Nevertheless, the coordination and complementarities established by the project among the implementing entities contributed to expanded dissemination and outreach of outputs, avoided overlaps between them, and allowed significant knowledge exchanges aligned with and supportive of a “One UN” system. On the other hand, collaboration of the implementing UN entities with other UN organisations, including UNCTs, was limited. Despite this shortcoming, at national level, target recipients of project outputs found the interventions complementary to those of other UN agencies.

Efficiency

Project coordination was complex and demanding, involving seven UN entities and the target delivery of around 100 outputs, of which some were composed of many activities. Nevertheless, the coordination of the project was found to be efficient overall given the circumstances and resources available. The coordination of the design phase of the response was actively supported by the DA-PMT. Coordination of project implementation was led by UNCTAD in collaboration with a Steering Committee that met on a regular basis, most often bi-monthly. UNCTAD’s Budget and Project Finance Section (BPFS) produced the project’s financial monitoring table every month, which included the expenditure data of UNCTAD as well as the other implementing entities. A monitoring dashboard was created by UNCTAD to facilitate the tracking of UNCTAD’s project delivery. Data from some of the other implementing UN entities was added, when provided, at two reporting points during the lifetime of the project.

The project would have benefited from the allocation of more resources towards the coordination and monitoring of overall implementation. Across the implementing UN entities, the project was considered complex and hard to follow outside of the interventions under their direct control. Some staff perceived that there were too many participants in the coordination meetings, that the project lacked a Theory of Change, and that it was primarily a compilation of activities rather than a cohesive and mutually reinforcing bundle of interventions supporting in depth any given country. Some staff in the UN Regional Commissions questioned the efficiency cost of a global or inter-regional response versus regional responses. The project was implemented in three phases, which were supportive of adaptive management and perceived by staff as the most rational approach considering the circumstances. However, it was also pointed out that clearer visibility from the onset on the funding available for future phases would have facilitated planning and the search for synergies.

8

Effectiveness

The Development Account programme, as a funding modality, was quick to respond and adapt to the COVID- 19 crisis. The prompt availability of resources and rapid orientation toward a global response contributed to the rapid launch of a wide range of interventions. However, questions remain as to its adequacy for addressing the immediate needs of a crisis in comparison with other UN agencies and mechanisms with a mandate for humanitarian response. The governance of this project, with DA-PMT’s oversight, the management structure with UNCTAD in the lead coordinating role, and each implementing entity leading the operational implementation at the regional level, ensured the global and regional scope of project delivery. At the operational level, implementing entities relied more on partnerships with local and regional institutions rather than coordination within the larger project management structure. The project governance and management mechanisms evolved in tandem with the COVID-19 crisis and the project’s emerging needs. The result was a high delivery rate but with limited inter-agency collaboration in the process. Yet, despite limited collaboration, this independent evaluation identified that the project was effective in producing identifiable results at the outcome level.

Overall, the project delivered 85% of the planned outputs. Phase 3, particularly, delivered the highest number of outputs but had the lowest outcome effectiveness rate, mostly because of budget cuts and some outputs still in progress at the time of this evaluation. There is evidence of the effective improvement of national capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship and MSME promotion (outcome 1.A) [such as the adoption of a revised entrepreneurship strategy by South Africa, Uganda and Seychelles]; improved resilience and competitiveness of MSMEs (outcome 1.B) [for example with 64.5% of participants opening a new business after attending Empretec-based training]; facilitated MSME registration and formalization through e-platforms (outcome 2) in El Salvador, Benin, Cameroon and Mali; improved access to finance, including upskilling in financial literacy (outcome 3) [for example with 97% of the MSMEs in Latin America that attended trainings reporting improved financial literacy in accounting and reporting and also improved capacity to manage financial resources]; increased MSME access to innovation and technology (outcome 4) [including through capacity development on green technologies for SMEs in Southern Africa]; and increased access to local, regional and international markets through digitalization and non-tariff measures (outcome 5) [for instance with case studies on competition in Thailand, South Africa and Brazil, followed by webinars and the creation of an online course on SMEs and competition policy, primarily for government officials].

In relation to the project indicators, the assessment of their effectiveness was based on limited information, proxies, and expert judgement since they often lacked SMART criteria. It was possible to infer that 85% of them showed some level of progress, either through objective measures (e.g., sales increase) or proxies (e.g., post-training satisfaction assessments and survey responses). The high effectiveness results can be partly attributed to the conceptual framework provided by the EPF, as well as the cluster-based approach with each cluster addressing specific regional constraints and responding to demand from member States. In addition to clustering about 100 outputs from seven implementing entities into 5+1 outcomes, the EPF provided a coherent thread to relate outputs that cut across outcomes. Further analysis would be needed, however, to clearly identify which of those outputs are the most suitable or adaptable for a crisis response.

The project improved the capacity of policymakers in designing and implementing policies supportive of MSMEs, especially in terms of contributing to a country’s government responses, country-specific studies, technical assistance, training courses, and the development of digital tools and regional interventions. This improved capacity is reflected in beneficiaries’ reports of how they have been considering the needs of MSMEs, including those led by women and youth, in their daily work. These results could become more transformative and sustainable with more institutional support to networks of policymakers and communities of practice for mutual and regional learning on supportive policies for MSMEs, as well as by mainstreaming gender and Leaving No One Behind (LNOB) approaches in government officials’ capacity-building.

Sustainability

The project developed approaches, tools and capacities that are being transferred at multiple levels. At the policy level, the addition of more functionalities to e-government tools, expanding training courses to more countries, and the establishment of agreements to implement the project recommendations are all strong evidence of the sustainability of the project’s achievements. At the behavioural level, beneficiaries are applying new knowledge and skills to their daily work, be it by including MSMEs’ issues in policy making or by improving MSMEs’ management, performance, outputs and, by extension, resilience. Challenges to this transfer of

9

knowledge relate to the lack of financial resources, need for follow-up mentoring, and lack of a favourable business environment.

Gender, human rights, and disability

The overall project design was well aligned with the two key UN documents that provide clear direction for the integration of a human rights-based approach, which include addressing the aspect of gender equality and Leaving No One Behind. Although these aspects were well-articulated in the project documents, strong follow-through and documentation of their implementation was limited to a few project components. For those components that did include these aspects, gender was more commonly integrated and youth to a lesser degree. There was very little evidence of the outreach, participation, or impact of project activities for people with disabilities or other vulnerable groups. The UNCTAD component on Women and Cross-Border Trade targeting five countries in Africa was a good practice in how to design and implement this type of intervention with a strong reflection of the needs of some of the most vulnerable women across border areas.

Recommendations Recommendation 1: (i) UNCTAD should further leverage the experience gained through the project to map out how components of the Entrepreneurship Policy Framework relate to and can be best positioned to support MSMEs in their recovery from different types of crises and (ii) DESA and the Regional Commissions should add their analysis of how their work can contribute towards the objective. UNCTAD, DESA and the Regional Commissions could build on the project to map their areas of intervention in support of the MSME sector, as well as capacities and knowledge on the implementation of the EPF components, including in a crisis context, and opportunities for broadening the uptake of EPF components at the regional level based on national needs. UNCTAD, DESA and the Regional Commissions could further consider identifying areas of joint interventions that would trigger complementarities and synergies between the agencies. This could involve collaborating on the development of capacities of all national and sub-national actors, i.e. Governments, MSMEs, other partners (e.g. Chamber of Commerce, Business Incubators, etc.) in line with United Nations Sustainable Development Cooperation Frameworks (SDCF) in respective countries; strengthening or contributing to facilitate access to finance for the MSMEs (including seed money, grants, access to credit, etc.); improving the coordination of MSMEs related policies across ministries; increasing interventions at the local level, such as by supporting NGOs or MSMEs outside of the main cities. The application of a human rights- based approach, gender responsiveness and inclusion of other vulnerable groups (LNOB) should be ensured. Recommendation 2: UNCTAD should continue building on the momentum generated by the project to continue fostering knowledge exchanges and promoting the Entrepreneurship Policy Framework. UNCTAD, DESA and the Regional Commissions should identify means to more meaningfully continue to share good practices and lessons learned on the demand-driven support they provide to the MSME sector, including on areas such as green/circular economy; innovation policies and ecosystems; MSME formalization and strengthening MSME capacities for the empowerment and leadership of women, youth and groups in vulnerable situations. UNCTAD and the Regional Commissions could also propose organizing regional events and/or a global conference to promote entrepreneurship policy and further advance the goals and impact of the Surge project. Furthermore, learnings from the experiences with the Surge about external partnerships should encourage UNCTAD to promote the EPF and entrepreneurship development to other UN agencies also engaged in this area (e.g. ILO, FAO, UN Women, etc.), to development banks, or to related initiatives such as the recent Global Accelerator on Jobs and Social Protection. UNCTAD could also consider joining and supporting events that promote the achievement of SDG 8.3 as an avenue to further promote the EPF. Recommendation 3: The DA-PMT should develop a clear framework for assessing the costs and benefits of implementing a global or inter-regional project versus regional projects. As a global crisis can affect regions and countries differently, global or joint projects should be developed only when there are clear benefits of joint implementation. Thus, a global or inter-regional vs. regional response would not be a priori decision, but a result of a clear assessment. A specific guideline or framework should be developed for this. Some of the assessment criteria could include the need or demand from member States for an integrated response; the range of common versus entity-specific activities and added value of complementary interventions (i.e. in terms of geographical coverage, reach of the target population, capacity, and/or coverage of multiple reinforcing technical areas, or networks and partnerships); capability to execute joint interventions (e.g. in terms of time, resources, logistics, and flexibility to pivot interventions without bureaucratic procedures);

10

coordination costs (which increase with the number of participating UN entities); project inception modalities and governance and knowledge management requirements to facilitate collaboration and knowledge sharing; scaling and sustainability plans; expected results of spreading resources versus concentrating on fewer countries; and so forth. The time taken to conduct such assessments will increase project coherence and effectiveness and facilitate the identification of the financial and human resources needed for project implementation. The network of DA Focal Points is a key existing asset for this assessment. Recommendation 4: Implementing UN entities should ensure that they have a comprehensive Results Framework for the entire project as well as an adequate monitoring plan, with indicators that are designed to support the ongoing monitoring. The results framework should have one objective and ideally have one outcome per cluster/workstream. The objective should state the intended goal of the project, describe the overall achievement targeted by the project, involving a process of change aimed at meeting the needs of identified beneficiaries, and reflect the overall funding available to the project. Each objective should include reference to the project’s beneficiaries and its substantive focus. The objective should not attempt to explain the ways in which the project intends to achieve the objective (i.e. it should not include the word ‘through’ or describe the internal work of the UN using verbs such as ‘support’, ‘facilitate’ or ‘contribute’). The outcomes (OCs) should describe the changes that are expected to occur as a result of the completion of outputs. The OCs should be achievable within the project’s timeframe and budget, and should be specific enough to be measured by the associated indicators of achievement. The indicators of achievement (IAs) should provide measures for monitoring progress towards achieving the OCs and reporting on them after completion of the project. Every indicator needs to provide clearly defined baselines, units of measurement and targets, detailing the quantity, quality and timing of expected results. The monitoring, evaluation, accountability, and learning (MEAL) system should also be designed to capture HRBA, gender and LNOB aspects. In phased interventions or during project execution, any changes in the logframe if/when pivoting activities should be clearly explained to the wider team. Recommendation 5: Implementing UN entities should ensure that sufficient resources are allocated to project coordination, technical collaboration, and partnership building. The absorption capacity of implementing entities can be challenged by crisis response projects which add to the planned programme of work. This is further compounded by projects that come with an extensive UN partnership and a global scope. Sufficient resources should be dedicated to global coordination and to building global partnerships with strategic stakeholders (e.g., UN organisations engaged in supporting the MSME sector; development banks). Capacities should also be directed to supporting technical collaboration and the staff implementing interventions, including towards synergy or liaison with the UNCTs. When designing the project, implementing UN entities should consider featuring coordination and partnership-building in the Theory of Change or logframe of the project. Tools to support continuous connections and knowledge exchange, and to ensure institutional memory should be part of the response package, such as a project website, SharePoint space for all team members, and a Yammer network or Teams channel. The integration of cross-cutting aspects (HRBA, gender responsiveness, LNOB) also requires expertise with sufficient and dedicated time and resources. Guidance could be development to project managers on how to do this.

11

1. Introduction

1. This Evaluation Report presents the independent evaluation of the United Nations Development Account Project 2023W – “Global Initiative towards post-Covid-19 resurgence of the MSME sector” (the MSME Surge project or project). The objective of the project was to develop and implement capacity-building tools for governments and micro, small and medium enterprises (MSMEs) to facilitate their resurgence from the COVID-19 crisis and strengthen the resilience of MSMEs in developing countries and economies in transition. The project was implemented by UNCTAD, UN DESA and the UN regional commissions for Africa (ECA), Europe (ECE), Latin America and the Caribbean (ECLAC), Asia and the Pacific (ESCAP), and the Arab region (ESCWA). Project implementation started in May 2020 and ran until June 2022.

2. The final evaluation of the MSME Surge project aims to assess the results of the project and establish the link between the achievements and activities of the intervention; to assess the response delivery and external coordination of the project, including the extent of gender, human rights and disability mainstreaming; and to identify good practices and lessons learned from the project that could feed into and enhance the implementation of related interventions.

3. The evaluation started in February 2023 and concluded in September 2023. The evaluation conclusions and recommendations are intended to inform the work of UNCTAD and the implementing UN entities, as well as the UN Development Account Programme Management Team (DA-PMT).

2. Description of the Project

2.1 Background

4. The first diagnosed cases of ‘viral pneumonia’ became public on 31 December 2019. On 30 January 2020, WHO declared the coronavirus outbreak a public health emergency of international concern (i.e., WHO’s highest level of alarm) and soon after it launched a COVID-19 Strategic Response and Preparedness Plan (SPRP) and asked the UN Secretary-General to activate the UN crisis management policy2. COVID-19 was declared a “pandemic” on 11 March 2020. On 19 March 2020, the SG report “Shared Responsibility, Global solidarity: Responding to the socio-economic impacts of COVID-19”3 launched a call for action with a focus on people – women, youth, low-wage workers, small and medium enterprises, the informal sector and on vulnerable groups who were already at risk. The UN published the Global Humanitarian Response Plan (GHRP) for COVID-194 on 25 March 2020, initially calling for USD 2.01 billion. On 2 April 2020, the General Assembly adopted the Resolution on Global Solidarity to fight the coronavirus disease 2019 (COVID-19)5. On 5 April the COVID-19 Response and Recovery Multi-Partner Trust Fund (MPTF) was established to channel funds for a system-wide immediate socio-economic response to COVID-19. The UN Framework for the immediate socio-economic response to COVID-196 further set out the structure for the United Nations’ urgent socio-economic support to countries and societies in the face of COVID-19. The Framework presented five streams of work connected by a strong environmental sustainability and gender equality imperative to build back better. One pillar of the Framework focused on protecting jobs, supporting small and medium-sized enterprises, and informal sector workers through economic response and recovery programmes.

5. From its onset, the advent of COVID-19 confronted governments, the development and the humanitarian community and society with a deteriorating socio-economic context. COVID-19 affected poverty, trade and employment levels, and put at risk the achievement of the SDGs. The World Bank estimated the COVID-19 pandemic to have pushed an additional 119 million to 124 million people into extreme poverty

2 The UN Crisis Management Team brings together 23 UN entities to coordinate a comprehensive whole-of-UN response. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/interactive-timeline/#event-47. 3 https://www.un.org/sites/un2.un.org/files/sg_report_socio-economic_impact_of_covid19.pdf 4 UN OCHA. 2020. Global Humanitarian Response Plan for COVID-19. Geneva. 5 United Nations. 2020. Resolution adopted by the General Assembly on 2 April 2020. A/RES/74/270. General Assembly. New York. Link: https://undocs.org/en/A/RES/74/270. 6 UN. 2020. A UN framework for the immediate socio-economic response to COVID-19. April 2020. New York.

12

in 20207. The IMF estimated a 3.5 percent contraction in global GDP in 20208. UNCTAD reported on the use of trade policy instruments with trade-restrictive effects in over 180 countries, most of them in developing countries9. ILO estimated that 8.8 per cent of global working hours were lost in 2020 relative to the fourth quarter of 2019, equivalent to 255 million full-time jobs10. At the beginning of the pandemic, most of these job losses affected women, and, by August 2020, the participation of women in the labour force was over 15 per cent lower than the baseline – male participation was about 10 per cent lower11. Annual unmet SDG financing needs before COVID-19 were USD 2.5 trillion. The pandemic created additional needs in 2020 for USD 1 trillion in COVID-19 spending while the drop in external private resources for developing countries was USD 700 million12.

6. The COVID-19 crisis plunged the global economy into a deep recession and micro, small and medium enterprises were amongst the hardest hit, with decreased liquidity or cash flow availability, decreased demand for products and services, and decreased supply of inputs13. According to UNCTAD’s analysis of the World Bank data in selected countries, on average 13% of small-size firms were temporarily closed due to COVID-19 pandemic, almost 75% of SMEs experienced a decrease in demand for their products and services, over two-thirds of SMEs experienced decrease in supply of their inputs14. A survey implemented by UNECA and IEC Ltd of African MSMEs at the start of Covid-19 found that four-fifths of the survey respondents indicated being significantly affected by the current COVID-19 crisis (rating the effect as highly severe or severe). MSMEs make up 90 per cent of the economic engine of developing countries and are a major source of employment and self-employment, including for vulnerable groups, such as women, elderly and youth. Trapped in economic stagnation due to large-scale lockdowns, millions of MSMEs became the most vulnerable to COVID-19 within the private sector. At the sectoral level, demand and supply stagnation was seen in many industries. MSMEs are major players in non-essential services,15 which became the most affected sectors by lockdown and other isolation measures. In addition, many micro and small businesses are in the informal economy, which was hit first and hardest by the pandemic.

2.2 Project objectives and expected accomplishments

7. The main objective of the project was to develop and implement capacity-building tools for governments and MSMEs to facilitate the resurgence and strengthen the resilience of MSMEs in developing countries and economies in transition. These capacity-building tools sought to mitigate the economic and social impact of the global COVID-19 crisis and to facilitate the contribution of MSMEs to SDG implementation.

8. The initiative brought together UNCTAD, UN DESA and the UN regional commissions for Africa (ECA), Europe (ECE), Latin America and the Caribbean (ECLAC), Asia and the Pacific (ESCAP), and the Arab region (ESCWA) with funding provided by the UN Development Account (DA). The project expected to ensure both global reach and regional presence, international cooperation, and exchange of knowledge and good practices from all over the world. The project also aimed to establish a coherent approach towards MSME resurgence reflecting the holistic and comprehensive nature of efforts needed to ensure and facilitate MSMEs’ green, resilient and inclusive recovery.

7 https://blogs.worldbank.org/opendata/updated-estimates-impact-covid-19-global-poverty-looking-back-2020- and-outlook-2021 8 IMF. 2021. World Economic Outlook Update. January 2021. Washington. 9 UNCTAD. 2021. Impact of the COVID-19 pandemic on trade and development: Recovering, but unevenly - Situation as at 31 March 2021. https://unctad.org/programme/covid-19-response/impact-on-trade-and-development- 2021#aTradePolicy 10 ILO. 2021. ILO Monitor: COVID-19 and the world of work. Seventh edition. 25 January 2021. Geneva. 11 UNCTAD. 2021. Impact of the COVID-19 pandemic on trade and development: Recovering, but unevenly - Situation as at 31 March 2021. https://unctad.org/programme/covid-19-response/impact-on-trade-and-development- 2021#aTradePolicy 12 OECD. 2020. Global Outlook on Financing for Sustainable Development 2021. Paris. 13 UNCTAD. 2021. Impact of the COVID-19 pandemic on trade and development: Recovering, but unevenly - Situation as at 31 March 2021. https://unctad.org/programme/covid-19-response/impact-on-trade-and-development- 2021#aTradePolicy 14 UNCTAD. 2021. Global Initiative towards post-Covid-19 resurgence of the MSME sector. MSME surge project - Addendum Phase 3 Project Proposal. Geneva. 15 The exact definition of these services varies by country, but they are generally recreational businesses, such as accommodation, catering, entertainment and tourism.

13

2.3 Project strategies and key activities

9. The project followed the conceptual approach of clustering interventions under the overall umbrella of the Entrepreneurship Policy Framework (EPF)16 of UNCTAD. The five clusters addressed the most critical areas of MSME recovery:

1- Mobilize entrepreneurial ecosystem and strengthen business skills 2- Simplify business registration and facilitate formalization 3- Improve access to finance/financial literacy 4- Increase access to technology and innovation 5- Enhance access to markets

10. Activities were to be delivered through coordinated and complementary efforts of participating agencies covering key interrelated components of an enabling entrepreneurship ecosystem, such as improving a regulatory entrepreneurship environment and mobilizing entrepreneurship potential, enhancing MSMEs’ access to innovation and technology, finance and markets, including at a policy level and at MSME level, and reaching out to most affected target groups, including women and informal workers. The project also included a number of activities to facilitate the green and sustainable recovery of MSMEs.

11. The project started its implementation in May 2020 and was scheduled to conclude on 31 March 2022, but received approval in February 2022 for an extension until 30 June 2022. The project was developed and implemented under three phases:

• Phase 1 (May-June 2020): The start-up of the project was approved by the DA Steering Committee based on a concept note presenting an overview of the project intended to be implemented over an 18-month period (to December 2021), the intended outcomes for Phases 1 and 2, and the detailed budget for phase 1 only.

• Phase 2 (July-December 2020): The Project Document submitted for approval of Phase 2 was expected to cover Phases 2 and 3, with the expectation that it would be revised in September 2020 to include the finalized Phase 3 activities and budget, and the project’s monitoring and evaluation plan, for Phase 3 approval.

• Phase 3 (initially January-December 2021, extended twice, first to March 2022 and then to June 2022): The addendum to the Project Document focused interventions on scaling up the implementation of the online outputs developed in Phases 1 and 2 and launching new activities in selected countries based on demand and results in the previous phases.

12. Over its 3 phases the project implemented more than 290 activities (Figure 1). Activities were sometimes multi-faceted, for example with reports being used to feed training materials, conferences, or webinars. Activities involved varying levels of effort, from one-time webinars to reports or online platforms requiring several months of development.

Figure 1: Overview of project activities (indicative17).

16 Entrepreneurship Policy Framework and Implementation Guidance | UNCTAD 17 Some activities were described by the UN entities with interchangeable terms, such as webinars and trainings, while some other activities were not necessarily described, such as disseminating a report through a workshop. The evaluation reconstructed the number of activities based on a review and interpretation of the project logframe.

14

Source: Independent evaluation, 2023.

13. The Project Document did not formulate a Theory of Change (TOC) but presented a results framework that the evaluation used jointly with inputs provided by informants to reconstruct a simplified (draft) TOC at evaluation (Annex 1).

14. According to the Project Document (Phase 2), the monitoring arrangements planned for the project included:

● Bi-monthly online meetings of the Project Steering Committee: Representatives from all seven entities were sought to monitor project delivery to ensure smooth and steady implementation. Representatives were also expected to meet on an as-need basis for important decisions that affected all seven entities.

● Inputs and feedback from the Project Design Team: Representatives from UNCTAD, DESA, ECA, ECE, ECLAC, ESCAP and ESCWA, who participated in the project design and its adjustments as needed, in accordance with the COVID-19 situation, were considered to be a key part of the project to evaluate and act upon stakeholder commentary.

● Task Forces: Task Forces comprised of experts from the partner entities were to be established to provide ongoing coordination of work of the five clusters.

● Annual progress reports: Annual or phase-based progress reports were to be provided to the DA- PMT on all aspects of project implementation.

● Success stories: based on request and template provided by the DA-PMT.

2.4 Beneficiaries and target countries

15. The main direct beneficiaries targeted by the project included: Governments, policy makers, Micro-, small and medium enterprises (MSMEs), Business or industry associations, Business support services, Commercial Registry Offices, Technical/experts staff in relevant institutions and ministries, and Multinational Enterprises (MNE).

7

101

29

90

40

17

8

2

0 20 40 60 80 100 120

Online systems and platforms (e-Registration systems, knowldge hubs, websites, search engine, etc.)

Trainings (Workshops, online trainings, online toolboxes, etc.)

Webinars (Global, regional, national; series or unique events)

Reports (Books, Assessments, Policy Reports, Guidelines, Case Studies, Maps, etc.)

Online training tools (e-Learning programmes, course materials, self-training, etc.)

Conferences (Meetings, roundtables, inter-governmental discussions, online events, policy dialogues, etc.)

Technical assistance (Entrepreneurship strategies, national policies, etc.)

Networks (Community of Practice, Policy Network)

The project conducted more than 290 activities

15

16. The beneficiary countries covered different geographical regions. The project compiled a list of 96 beneficiary countries in the final report, as shown in Table 1. These countries were supported by the Surge project, to varying degrees, either through physical/in-person activities or through online modalities. Some of the forms of interventions (in-person or online) included advisory services, trainings, workshops, seminars, conferences and events, platforms and systems. In many cases, implementing entities also provided direct technical assistance to countries through policy advice or in the form of assessment reports, research studies, or tailored guidelines18. Project partners organized online seminars targeting specific countries and also regional or global audiences in many cases.

Table 1: Project’s beneficiary countries.

Africa

1. Algeria 2. Angola 3. Benin 4. Botswana

5. Cameroon 6. Egypt 7. Eswatini 8. Ethiopia

9. Ghana 10. Kenya 11. Lesotho 12. Malawi

13. Mauritius 14. Mozambique 15. Namibia 16. Nigeria

17. Seychelles 18. South Africa 19. Tanzania 20. The Gambia

21. Uganda 22. Zambia 23. Zimbabwe

Americas

24. Argentina 25. Bahamas 26. Barbados 27. Belize

28. Bolivia 29. Brazil 30. Chile 31. Colombia

32. Costa Rica 33. Cuba 34. Dominica 35. Dominican Republic

36. Ecuador 37. El Salvador 38. Grenada 39. Guatemala

40. Guyana 41. Jamaica 42. Mexico 43. Nicaragua

44. Panama 45. Paraguay 46. Peru 47. Saint Kitts and Nevis

48. Saint Lucia 49. Trinidad and Tobago 50. Uruguay 51. Venezuela

Asia

52. Afghanistan 53. Armenia 54. Azerbaijan 55. Bangladesh

56. Bhutan 57. Brunei Darussalam 58. Cambodia 59. China

60. Georgia 61. India 62. Indonesia 63. Islamic Republic of Iran

64. Jordan 65. Kazakhstan 66. Kyrgyzstan 67. Lebanon

68. Lao PDR 69. Maldives 70. Malaysia 71. Mongolia

72. Myanmar 73. Nepal 74. Pakistan 75. Palestine

76. Philippines 77. Saudi Arabia 78. Singapore 79. Sri Lanka

80. Tajikistan 81. Thailand 82. Türkiye 83. United Arab Emirates

84. Viet Nam

Europe

85. Albania 86. Belarus 87. Bosnia and Herzegovina 88. Montenegro

89. North Macedonia 90. Republic of Moldova 91. Romania 92. Russia

93. Serbia

Oceania

94. Fiji 95. Papua New Guinea 96. Tuvalu

18 Some of the countries that received direct technical assistance include for example Armenia, Bangladesh, Benin, Bosnia and Herzegovina, Botswana, Brazil, Cameroon, El Salvador, Georgia, Kazakhstan, Kenya, Kyrgyzstan, Malawi, Mali, North Macedonia, Republic of Moldova, Serbia, Tajikistan, Tanzania, Thailand, The Gambia, Ukraine, Zambia.

16

2.5 Key partners and other key stakeholders

17. Jointly implemented by UNCTAD, DESA, ECA, ECE, ECLAC, ESCAP and ESCWA, the project built upon the comparative advantages and mandates of the participating agencies to provide immediate advice, capacity-building and support to governments and MSMEs during the ongoing global pandemic. Broadly, the roles and lead entities, based on the mandates and expertise of the participating agencies, for each of the five project clusters and workstreams were as presented in table 2.

Table 2: Project clusters and lead and participating entities. Source: Project document Phase 2.

Project cluster/workstream UNCTAD DESA ECA ECE ECLAC ESCAP ESCWA

Overall coordination19 O Project cluster/workstream 1 Entrepreneurship and business skills promotion

O O O O

Project cluster/workstream 2 Business facilitation/formalization

O O O

Project cluster/workstream 3 Access to finance/financial literacy

O O O

Project cluster/workstream 4 Access to technology and innovation

O

Project cluster/workstream 5 Access to markets

O O O O O O

O: Lead institution O: Participating institution

18. UNCTAD was the lead project coordinating entity20. Day to day management of the project was entrusted to each implementing agency for its own component. Each participating agency managed and implemented its component with funds allocated to it. Within UNCTAD, project oversight was ensured by UNCTAD’s Enterprise Branch within the Division on Investment and Enterprise.

19. Key project partners included the UN Development Partners with the UN Resident Coordinators (UNRCs), UN Country Teams (UNCTs), UNITAR, UNDP, UNOSSC, ITC. The project was also implemented with the EMPRETEC Centres21. Other key stakeholders included technical/expert staff in relevant institutions, ministries, and business incubators and support services.

2.6 Resources

20. Overall, the United Nations Development Account (UNDA) allocated a total of $4,490,500 under this project. Concretely, UNCTAD received $2,671,000, ECLAC received $134,000, ESCAP received $240,000, ECA received $467,000, ECE received $448,500, ESCWA received $370,000 and DESA received $160,000 (Figure 2).

Figure 2: Allocation of project funding.

19 Phase 1 of the project was co-led by UNCTAD and ESCWA. 20 UNCTAD and ESCWA co-led phase 1 of the project. 21 EMPRETEC is a flagship capacity-building programme of UNCTAD for the promotion of entrepreneurship and micro, small and medium-sized enterprises (MSMEs) to facilitate sustainable development and inclusive growth.

17

Source: Final report.

21. The project budget was approved and distributed by phase (Table 3). The budget for phase 1 was $325,000 and the budget for phase 2 was $1,310,000. Budget for phase 3 was reduced in November 2011 from a provisional $3,165,500 to $2,855,500 (see section 5.3).

Table 3: Project's implementation phases

Phases Implementation period Effective budget allocations

I May-June 2020 $325,000

II July-December 2020 $1,310,000 III January 2021-June 2022 $2,855,500

2.7 Link to the Sustainable Development Goals (SDGs)

22. The project aimed to contribute to the post-2015 development agenda by making direct contributions to the sustainable development goals (SDGs), in particular goal 4 on “Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all” (target 4.4); goal 8 on “Promote development- oriented policies that support productive activities, decent job creation, entrepreneurship, creativity and innovation, and encourage the formalization and growth of micro-, small- and medium-sized enterprises, including through access to financial services” (target 8.3); and goal 9 on “Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation” (targets 9.3 and 9.5).

2.8 Innovative elements

23. The project demonstrated several innovative elements. At the institutional level, the project relied on increased consultative processes and a phased approach which enabled adaptive management. At the programmatic and technical levels, the project contributed to the introduction of MSMEs into policy discussions in response to the pandemic crisis, and e-government services. At the operational level, the project developed innovative approaches and tools to respond to country needs, such as online delivery of trainings and knowledge sharing events.

3. Evaluation objectives, scope, and questions

3.1 Purpose and objectives

$160,000

$370,000

$448,500

$467,000

$240,000

$134,000

$2,671,000

$0 $2,000,000 $4,000,000

DESA

ESCWA

ECE

ECA

ESCAP

ECLAC

UNCTAD

3.56%

8.24%

9.99%

10.40%

5.34%

2.98%

59.48%

DESA

ESCWA

ECE

ECA

ESCAP

ECLAC

UNCTAD

0% 20% 40% 60% 80%

18

24. As per the TOR (Annex 7), the final evaluation of the MSME Surge project has the following specific objectives:

● Assess the results and establish the link between achievements and activities of the intervention;

● Assess the response delivery and external coordination22, including the extent of gender, human rights and disability mainstreaming; and

● Identify good practices and lessons learned from the project that could feed into and enhance the implementation of related interventions.

3.2 Evaluation scope, criteria, and questions

25. The evaluation covers the duration of the project from April 2020 to June 2022. The evaluation focuses on the countries covered by the project. The evaluation analysed unintended positive (or negative) outcomes beyond the 96 countries identified by the project as beneficiary countries. The evaluation conclusions and recommendations are intended to inform the work of UNCTAD and other UN implementing entities as well as the Development Account Programme Management Team (DA-PMT), which will conduct a synthesis from this evaluation and those of the other four Covid-19 surge projects. The evaluation took a retrospective and forward-looking approach. It was summative but also formative aiming to support UNCTAD and UN partners in their next steps.

26. The evaluation addressed the questions in table 4. The evaluation questions were unpacked into an evaluation matrix with suggested measures (Annex 2) and guided data collection methods (Annex 3).

Table 4: Evaluation questions.

CRITERIA KEY QUESTIONS

RELEVANCE

1. To what extent was the project designed to target the new needs and priorities of participating countries as a result of COVID-19?

2. To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g., COVID-19 Socio-Economic Response Plan)?

COHERENCE

3. To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

4. To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non-Secretariat) to COVID-19 in delivering socio-economic support to Member States?

EFFICIENCY

5. How well coordinated was the process for the response among the entities implementing the joint project?

6. How did the three-phase budgeting and programming approaches impact the efficient delivery of the project?

EFFECTIVENESS

7. To what extent did the programme (Development Account) and project governance and management structures and processes enable, or hinder, the effective implementation of the joint project and the achievement of its results?

8. To what extent has the project contributed to the expected outcomes as enunciated in the project document?

9. How did the response contribute to the participating country Governments’ responses to COVID-19, especially in the area of MSME resurgence?

10. What innovative approaches or tools, if any, did the response use, and what were the outcomes and lessons learned from their application?

22 The OIOS COVID-19 response evaluation protocol identifies the following three cross-cutting focus areas: 1) response delivery; 2) external coordination (or “Delivering as one”); and 3) business continuity. “Response delivery” is further defined as consisting of delivery of: 1) the existing mandate needed to implement previously mandated activities in the new environment created by the pandemic; and 2) the COVID-19 specific response (health and non-health) needed to address the pandemic specifically. See OIOS (October 2020), “COVID-19 Response Evaluation Protocol”, para 3-4.

19

SUSTAINABILITY 11. What measures were adopted to ensure that outcomes of the response would

continue after the project ended? GENDER, HUMAN RIGHTS AND DISABILITY

12. To what extent were perspectives on gender equality, protection of human rights and reaching underserved groups integrated into design and implementation of the project? What results can be identified from these actions?

4. Methodology

27. The evaluation collected and analysed data from a range of sources to deepen understanding and triangulate the assessment. The following data collection instruments were used:

• Desk review: Study of secondary resources (Annex 4) as per the project management process and logframe in order to validate achievements, including UN GA resolutions, UN strategies and policies, documents/data related to project-level planning, implementation and results achievement (including post-training assessments, whenever data allowed23), project outputs and monitoring reports, and external reports (Annex 2).

• Interviews and focus groups: Interviews were conducted with a selected number of staff, partners, and stakeholders (Annex 5). Contact details of UN staff and partners were provided by UNCTAD (38 target informants), ECLAC (10), UNECE (10), UNECA (8), DESA (5), ESCAP (5), ESCWA (3). All prospective informants were invited to inform the evaluation, with at least one follow-up reminder message sent in absence of any response. The evaluation interviewed 58 informants. The canvas for semi-structured interviews was tailored to ensure specific relevancy to the selected stakeholders. To optimize time, a few interviews took the form of focus groups. Consultations were conducted virtually with Zoom or Teams. The following consultations per stakeholder group were conducted (Table 5):

Table 5: Groups of informants and number of consultations.

Informant groups Number of informants

Project Coordination Team 10 Project focal points of implementing entities (i.e. members of Task Forces) 12

DA-Project Management Team and DA focal points in participating entities 8

UN and Development Partners (UNCT members, UNDP) 3

Governments (Ministries, national institutions) and policy makers 6

MSMEs, Business or industry associations, Commercial Registry Offices 8

Technical/experts staff in relevant institutions, including EMPRETEC Centres 11

Total 58

• Survey: The evaluation carried out six external surveys (Annex 6) to inform the assessment of the relevance, coherence, and effectiveness of the project and its contribution to outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups. The surveys targeted participants to project activities and beneficiaries. The lists of contacts were provided by UNCTAD, DESA, ESCAP, ECLAC, ECA, and ECE (Table 6)24. The sampling strategy was convenience sampling. In addition, in consultation with UNCTAD Independent Evaluation Unit, the evaluation used purposive sampling to exclude from the lists provided by the UN entities (i) the staff from the same UN entities who were part of those lists as having attended or contributed to the events; (ii) participants to Trainings of Trainers workshops as their role was to train project beneficiaries; (iii) participants to one-time only webinar sessions as having had very limited exposure to the project.

23 Not all post-assessment data could be used by the evaluation team, because some were responded by a very small number of training participants, in relation to the total number of participants in a given training. 24 ESCWA was requested to provide a list of survey recipients but did not share one.

20

The surveys were composed of questions that were common to all six questionnaires and some specific to each of the 5+1 project outcomes25. The questionnaires were made available in English. They were translated in Spanish for outcomes 3 and 5 as target recipients were primarily in the Latin America and Caribbean region. The surveys were anonymous and remained open for 2 weeks, from Thursday 20 July to Friday 4 August. Two reminder messages were sent to increase the response rate. The surveys were launched to a combined list of 1454 persons from at least 120 countries (information on the localisation of survey recipients was not available for all recipients), with 89 messages bouncing back. Altogether, the surveys compiled feedback from 133 respondents. Responses were received from at least 53 countries (some participants did not indicate their location). Responses were received from at least 62 males and 42 females (some participants did not indicate their gender). All survey questions were optional. Questionnaires partially completed were kept in the batch of results when they contained information that was judged credible and meaningful. Statistics were calculated on the basis of the number of valid responses per question and not on the basis of the overall number of respondents to the surveys. The overall response rate to the email surveys is circa 9.7%. The surveys presented the opinion of those who responded but not of the entire list of recipients of the questionnaires nor of all the beneficiaries of the project.

Table 6: Survey recipients and respondents.

Outcome Email addresses Bounced back Valid email Valid responses Percentage

1A 574 38 536 52 9.70% 1B 258 24 234 40 17.09% 2 21 0 21 4 19.05% 3 219 4 215 11 5.12% 4 98 1 97 13 13.40% 5 284 22 262 13 4.96%

Total 1454 89 1365 133 9.74%

• Cross-cutting thematic analysis on human rights, gender and inclusion: As an integral part of the above-mentioned methods of data collection, the evaluation team explored the extent to which gender equality, human rights and leaving no one behind perspectives were considered in the design and implementation of the project. The UN framework for the immediate socio-economic response to COVID-1926 guided the assessment as it outlines how the responses to the pandemic should be consistent with international human rights standards, ensure gender equality and special measures to protect the most vulnerable and marginalized groups, such as women, youth, and migrants.

28. The evaluation used a combination of complementary tools for analysis of the data collected.

● Qualitative analysis of data, secondary resources and interviews/focus groups. The evaluation used ATLAS.ti for coding qualitative inputs.

● Quantitative analysis including systematizing post-training assessments, indexing and cross- tabulations of survey data, and quantitative coding of survey qualitative inputs.

29. The evaluation confronted several constraints or limitations that were mitigated as follows:

● Remote data collection: The evaluation did not include country visits that would allow for face- to-face interviews and direct observations, which may have limited the collection of evidence

25 The project outcome 1 was subdivided into outcome 1A and 1B. 26 A UN framework for the immediate socio-economic response to COVID-19, April 2020 https://unsdg.un.org/sites/default/files/2020-04/UN-framework-for-the-immediate-socio-economic-response-to- COVID-19.pdf

21

at the outcome level. Mitigation: Use of complementary data collection methods to enrich and triangulate findings.

● Limited availability of informants: The interviews (individual and group) are a key instrument for this evaluation. Given turnover and time since the project was completed, some country staff were not available for interviews as they, for example, had retired or left the organization, did not recall exactly what happened, or had too much work or competing demands for their time. Mitigation: Support was requested from the Project Manager for securing interviews.

● Lack of generalisation of survey results: Convenience sampling cannot ascertain that survey recipients were statistically representative of the entire community of project beneficiaries. Furthermore, reminder messages mitigated but did not prevent any non-response bias. Respondents also required to have internet access. The surveys presented the opinion of those who responded but not of all the beneficiaries of the project. Surveys were used as one among other sources of findings.

● Limited evaluability of some indicators: Because some indicators do not comply with the SMART criteria and are elaborated in a broad way, it was difficult to identify the evidence that answers to them. Additionally, they were associated with the work of specific implementing entities, rather than the project as a whole. This posed an additional challenge, especially when the entity associated with a certain indicator was not clear. Mitigation: Targeted consultation about these indicators, corresponding evidence directed at the responsible entity, and an inductive approach to associate results achieved within an outcome to specific indicators.

● Too short a time between end of project and the evaluation to observe impact: Since most of the project’s activities take time to show impact, this evaluation reports on indications of possible future impact on beneficiaries, governments, and partners. Mitigation: Self-reported survey for beneficiaries, and data triangulation generated this evidence.

5. Findings

30. This section presents the evaluation findings per evaluation criteria and question.

5.1 Relevance

To what extent was the project designed to target the new needs and priorities of participating countries as a result of COVID-19?

31. The project was designed to respond to demands of Member States to mitigate the effects of the COVID-19 pandemic. The project was based on ownership by beneficiary countries and relevance towards national and sub-national sustainable development priorities. A demand-driven approach was mainstreamed throughout the project lifecycle. The project was designed based on the request to UN Secretariat entities for assistance for MSMEs from Member States, as well as intergovernmental demands and resolutions on COVID- 19. The Project Document for phase 2 reported requests for support received from more than 70 countries across the 5+1 project outcomes. For example, the Governments of El Salvador, Benin, Cameroon and Mali, requested UNCTAD to create online services that streamlined and simplified business registration. The Governments of Malawi, Tanzania and Zambia, requested UNCTAD to scale-up the format of the cross-border trade trainings piloted in these countries and to replicate them at other borders in the same countries. Georgia and North Macedonia expressed interest for ECE to develop country-specific reports based on the findings of the regional Guidelines and Best Practices for MSMEs in delivering energy efficient products and in providing renewable energy equipment. Several staff from the implementing UN entities also mentioned that in-country interventions were conditioned by the receipt of a Letter of Agreement from Member States. In a few cases, informants further illustrated the demand-based approach of the project by indicating that some initial plans for collaboration were parked sometimes due to changing country needs and priorities.

32. The project conducted or contributed to needs and impact assessments to inform interventions. Across all regions the project collaborated with Member States and national stakeholders to conduct surveys, needs assessments, or impact studies that informed project design and implementation as well as national responses. In South-east and Central Asia, and the Pacific, countries such as Samoa, Bangladesh, Nepal,

22

Cambodia and Kazakhstan participated in ESCAP in-depth country assessments. In the Southern African region, ECA carried out a survey across its 11 member states to assess the impact of Covid-19 and the war in Ukraine on MSMEs in association with national business organizations, The survey gauged policies needed to foster regional integration and technology and innovation in post Covid-19 recovery strategies. ECE produced a rapid impact assessment series on end-to-end supply chain activities to support long-term development efforts for five beneficiary countries and presented them for intergovernmental discussion. ECLAC ran diagnostics on competition policy and consumer protection, and on SME support policies, to identify needs for project activities or products in target countries, including the needs of women and vulnerable groups. In Kenya, DESA and the Kenya Micro and Small Enterprises Authority assessed how MSMEs were affected by the pandemic. The survey results were disseminated to stakeholders, who were brought together to participate in a validation workshop to discuss most needed support systems and formulate policy advice to be shared with the Ministry of Cooperatives and MSME Development. In several cases informants also recalled that needs assessments are part of the project design methodologies implemented by UN entities. For example, the first step of the EPF is to assess the status of the national entrepreneurial ecosystem. According to the evaluation survey, the vast majority of respondents reported that project activities have responded to their priorities and were relevant to their work (Figure 3).

Figure 3: Perceived relevance of the project according to the survey (n=133 respondents).

Source: Independent evaluation survey, 2023.

33. Stakeholders, including policymakers, MSME entrepreneurs and development partners, participated in project design and implementation. On various occasions, evaluation informants stressed that the involvement of Member States and stakeholders in designing and implementing interventions was also a factor contributing to addressing their needs and priorities. In Kenya for example, in addition to ensuring buy-in from the Government before implementing cross-border trade trainings, UNCTAD relied on national institutions to facilitate project delivery on the ground. UNCTAD asked the Government to identify training participants and the Government requested local associations to identify participants and to help with logistics. A representative of the Ministry of Trade of Kenya travelled to the border to introduce the workshops. This was the first instance of high-level government support to the project. Several Empretec centres also mentioned that the identification of workshop participants was done in collaboration with government agencies and departments. In Zimbabwe, the Empretec centre selected primarily businesswomen and youth whose businesses were declining or faltering. Another example involved the creation of training materials on Core Indicators for Sustainability and SDG Reporting (GCI). A series of trainings of trainers (TOT) were organized by UNCTAD and participants’ feedback was used to revise the materials before training entrepreneurs.

34. Project activities and products were tailored to Member States and target beneficiaries. Project activities and products were often tailored to the needs of target recipients. Many regional reports were localized through national studies. For instance, ECE developed guidelines and best practices for MSMEs to

41%

44%

11%

1% 1%

1% 1%

The project activities responded to my priorities and were relevant to my work

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

23

assure resiliency and progress towards a circular economy in sustainable resource management and critical raw material supply chain solutions, as well as guidelines and best practices for MSMEs in delivering energy- efficient products and in providing renewable energy equipment27. Four countries of the ECE region were chosen as pilot countries for which the guidelines were customized, before spanning to other countries. In Tanzania, the Empretec centre delivered a training on entrepreneurship skills development that was based on the UNCTAD-EMPRETEC methodology but was adjusted to participants with limited literacy skills. UNECA delivered an online training course on the role of technology and innovation for MSMEs under Phase 2 and feedback from the training was used to develop a second course on role of green technologies in MSME development under Phase 3. For many activities and products, UN entities also ensured the translation of materials in official UN and local languages to facilitate access and outreach at global, regional and national levels. In the early months of the response, ECE partnered with UNDP (which had a Zoom license) to deliver workshops with simultaneous interpretation as this could not be accommodated by ECE online platforms.

35. Implementing UN entities adapted to maximize the relevance of interventions aimed for longer term change. While some Surge project outputs were found to be more crisis-response driven and with a shorter path to outcomes, such as the implementation of e-registration systems, other activities such as the design of a national entrepreneurship strategy were referred to as yielding an impact after a longer period of time. This is typical of DA projects and other socio-economic UN initiatives. Several interviewees were of the opinion that the UN socio-economic pillar did not generally have many crisis response products. Despite the achievements of the project (see section on Effectiveness), the capacity of the UN to respond to the needs and priorities of participating countries as a result of COVID-19 depended on institutional factors that were not always under their direct control. It was further indicated that at the onset of the pandemic, countries needed immediate financial support to help their companies and MSMEs to stay alive. Several survey respondents reported that complementing capacity-building activities for entrepreneurs with grants would have been beneficial28. Although the EPF and cluster-based approach proved an appropriate conceptual framework to articulate the response (see section on Coherence), the latter could have benefited from some prior analysis of the relief-recovery-development pathway to facilitate the identification of appropriate crisis mitigating interventions. Implementing UN entities therefore used adaptive management to ensure adequacy of the services in addressing demand-orientation and longer-term outcomes.

To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g., COVID-19 Socio-Economic Response Plan)?

36. The project was aligned with the COVID-19 Socio-Economic Response Plans (SERPs) in many participating countries, but the design occurred before the SERPs were finalized. The project was part of the general strategic plan of the United Nations called “A UN framework for the immediate socio-economic response to COVID-19”29 and specifically contributed to Pillar 3 “Economic Response and Recovery: Protecting Jobs, Small and Medium-Sized Enterprises, and Informal Sector Workers” of this system-wide framework30. This UN framework also served to guide the COVID-19 Socio-Economic Response Plans (SERPs) which were developed by UN Country Teams and Member States and stakeholders. However, while the concept note of the project was released in April 2020 and the Project Document for phase 2 in June 2020, many SERPs were published later, i.e. in or after August 202031. The design of Phase 3 of the project was finalized in early 2021 but most outputs were a continuation of previous work. Several informants also mentioned that the implementing UN entities have limited country presence, reducing the capability to mainstream the project in the SERPs. Despite these limitations, the evaluation reviewed a purposeful sample of 10 SERPs32 showing their systematic coverage of pillar 3 of the UN framework and some frequent references

27 UN Development Account project | ECE 28 See for example: Training and grant support for potential entrepreneurs and start-ups in the Sea of Azov region, Ukraine (ilo.org) 29 https://unsdg.un.org/sites/default/files/2020-04/UN-Framework-for-the-immediate-socio-economic-response-to- COVID-19.pdf 30 The UN framework built upon the UN General Assembly’s resolution on “Global solidarity to fight the coronavirus disease 2019 (COVID-19) (A/RES/74/270)” and on the Secretary-General’s report on “Shared responsibility, global solidarity: Responding to the socio-economic impacts of COVID-19”. 31 UNSDG | Resources Library 32 The evaluation selected 2 SERPs per region and countries where the project implemented interventions, i.e. Argentina, Bangladesh, Bhutan, BiH, Cameroon, Jordan, Moldova, Peru, Thailand, and Zimbabwe.

24

to or links with the outcome areas of the project, with a prevalence of connections with outcomes 4, 3 and 1A. The evaluation also found references sometimes to the project outputs. For example, the Socio-Economic Response and Recovery Plan for the Republic of Moldova (June 2020)33 was informed by the ECE’s survey- based assessment of the COVID-19-induced economic crisis and changes in non-tariff measures to contain the pandemic on MSMEs (May 2020) and by the Assessment on the impact of the crisis on female-owned enterprises (June 2020).

37. Independently of the SERPs, implementing UN entities considered the COVID-19 socio-economic responses of participating countries during project design and implementation. As noted in the earlier section, the project delivered many regional and national needs assessments and impact studies, which were a source for aligning project activities with the COVID-19 socio-economic responses of the participating countries. For example, UNECA organised, at the request of the Government of Mauritius and in association with the SADC Business Council, a regional seminar on the impact of Covid-19 on MSMEs in Southern Africa and the recommendations were intended to support the development of a roadmap for technical assistance at a regional level. In Latin America, ECLAC analysed the policies implemented by governments to face the MSME crisis generated by COVID-19. Experiences in countries having MSME fostering institutions were prioritized. Good practices were systematized and shared among public institutions in charge of MSMEs policies. Virtual meetings were organized to share implementation experiences about measures to help MSMEs in order to enhance the coordination of public policies for economic recovery. In the Gambia and Kenya, DESA ensured that the design and implementation of project activities were aligned with the national agendas to contribute to the relevance of the interventions and strengthen ownership by the countries. In the Gambia, work was carried out with the Ministry of Trade, Industry, Regional Integration and Employment (MOTIE), UNDP and the UNRCO. Project implementation served to strengthen the capacity of policy makers and other stakeholders to implement new policies and to pursue coherence among the already formulated policies in the country. Several evaluation informants indicated the project was relevant for bringing MSMEs to the policy debate where they were often absent.

5.2 Coherence

To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

38. The project was anchored in the mandates, comparative advantages, and programme budgets of the implementing UN entities, paving the way to complementarities with previous interventions. The initial concept note and Project Document presented a detailed review of the respective mandates and comparative advantages of the implementing UN entities as a rationale for their contribution to the project34. Among these

33 MDA_Socioeconomic-Response-Plan_2020.pdf (un.org) 34 Many factors were put forward to stress the institutional coherence and rationale for the project. Some highlights include: (i) UNCTAD is a focal point in the UN on entrepreneurship and MSME policy as formally mandated by two United Nations General Assembly resolutions on Entrepreneurship for Sustainable Development. UNGA resolutions /RES/71/221 and A/RES/73/225 both call on “the United Nations system, and in particular the United Nations Conference on Trade and Development, to continue to provide support to and assist member States, at their request, to identify, formulate, implement and assess coherent policy measures on entrepreneurship and the promotion of micro-, small and medium-sized enterprises”. UNCTAD also provides technical assistance and capacity-building support to a number of developing economies, including advice and training to policy makers to inform and guide the development and implementation of national entrepreneurship policies based on UNCTAD’s Entrepreneurship Policy Framework (EPF), which was endorsed by member states through a series of intergovernmental discussions and formally launched at the Ministerial Conference UNCTAD XIV in 2012. (ii) DESA brings relevant expertise from implementing the project “Enhancing national capacities for enhancing potentials of MSMEs in achieving SDGs in developing countries (MSME project)” funded by the UN Peace and Development Fund (PDF). (iii) ESCWA has developed and launched an SME information portal for the region with an aim to support entrepreneurs and small businesses access information needed to support their business. (iv) ECE has conducted rapid impact assessment of the COVID-19 pandemic on end-to-end supply chain activities, with a view to supporting national and regional recovery and long-term development efforts. (v) The ECA sub-regional office for Southern Africa leverages its mandate and implementation of a UNDA 13th tranche project for integrating a component to build capacities of MSMEs in Southern Africa to harness technological applications to address the impact of the pandemic. (vi) ECLAC has a long experience in studying the MSME performance in Latin America and in supporting public institutions in developing, implementing, and evaluating MSME fostering policies. (vii) ESCAP responds to ESCAP Resolution 70/5: Strengthening regional cooperation and capacity for enhanced trade and investment in support of sustainable development, and has planned to work with existing initiatives and organizations to support MSMEs in the region.

25

enabling institutional factors, references were primarily made to supporting policy makers on MSME development as well as to building capacities of MSMEs and entrepreneurs. Significant evidence was found showing that the project was consistent with and sometimes a continuation of previous activities. UNCTAD for instance relied on its network of Empretec Centres to deliver activities on the capacity-building of entrepreneurs. In collaboration with centres and experienced Empretec trainers, UNCTAD delivered on-line trainings and developed demand-driven, customized tools to assist the centres in coping with short-term and medium-term pandemic-induced challenges to their business operations. UNCTAD also built on earlier contacts to support the establishment of e-Registration platforms in El Salvador and Benin, which was accelerated by the pandemic. ESCWA grounded its proposed contribution to the 1st phase of the project in previous meetings and surveys. ECLAC delivered courses that were the result of prior studies and a long preparatory phase of getting to know the issues of SMEs in e-commerce. ESCAP’s “Bangladesh Startup Ecosystem Assessment Report”35 delivered by the Trade, Investment and Innovation Division followed earlier work from another division.

39. Interventions were often coordinated with and complementary to other internal activities that were underway in the implementing UN entities. Within each implementing UN entity, internal complementarity was sought with other projects. ECE for example used the impact assessments on the novel COVID-19 pandemic on end-to-end supply chain activities, conducted under UNDA 10 “Strengthening the national capacities of selected ECE countries for evidence-based regulatory and procedural trade policies to achieve SDGs”, to further draw two national assessments in Armenia and Moldova focusing on female-owned enterprises. DESA leveraged its expertise and understanding of country needs gained with the project “Enhancing national capacities for enhancing potentials of MSMEs in achieving SDGs in developing countries (MSME project)”36 funded by the UN Peace and Development Fund (PDF), DESA complemented the PDF Kenya and The Gambia to improve contributions of MSMEs to social and economic resurgence after the pandemic and strengthen their roles as enduring institutions for jobs and entrepreneurship to reach those further behind. ESCAP took advantage of the Asia-Pacific MSME Policymakers Network established with the project to present and launch the 2nd edition of the “Policy Guidebook for (M)SME Development in Asia and the Pacific”37, and its accompanying “Online Resource Centre for MSME Development”. Several knowledge products from ESCAP were also co-financed by the project and other sources. For instance, the publication on MSME Access to Finance: The Role of Digital Payments38 was funded from the Regular Programme of Technical Cooperation for the studies on Cambodia and Nepal, and from the Government of Canada (through Global Affairs Canada, in the context of ESCAP’s Catalysing Women’s Entrepreneurship Programme), for the studies on Bangladesh and Samoa. The UNECA Sub-regional office for Southern Africa leveraged the project to build the foundations of a UNDA 12th Tranche project on innovation and technology for SMEs, which had been approved. ESCWA presented the DEPAR portal39 and MSME toolbox40 at the first Arab SME Summit41, organized in Jordan from 30 October to 1 November 2022 by another ESCWA project.

40. The Surge project increased internal collaborations between departments in the implementing UN entities. Evaluation informants often shared the perspective that the project has contributed to increased communication between internal departments that were used to working separately. Several project outputs were developed on the basis of internal cross-collaborations between teams. In UNCTAD for example, the SME Entrepreneurship Branch and the Empretec centres collaborated with the Trade and Gender team, the Competition Branch, and the Accounting team. Staff from these sections participated in coordination meetings, exchanged tools and new materials, and were consulted to identify beneficiaries. The UNCTAD Business registration team also commended the project for providing an opportunity to have an open channel of communication with the Entrepreneurship section. This contributed to sharing experiences and good practices and for these colleagues to be better positioned to promote e-Registration. In ECE, project activities helped to break down silos and foster collaboration between different teams working in the area of sustainable trade, innovation, circular economy, rational use of natural resources, PPPs and women’s empowerment. In ESCWA, the work on the MSME toolbox involved 7 divisions, reflective of the 7 foci of the toolbox. Each specific team

35 Bangladesh startup ecosystem assessment report | ESCAP (unescap.org) 36 UNPDF | Enhancing national capacities for unleashing full potentials | United Nations 37 Policy guidebook for MSME development in Asia and the Pacific, 2nd edition | ESCAP (unescap.org) 38 ESCAP. 2022. MSME Access to Finance: The Role of Digital Payments, MSME Financing Series No.7. Bangkok. Available at: https://www.unescap.org/kp/2022/msme-financing-series-role-digital-payments. 39 Communities | DEPAR (unescwa.org) 40 MSME Toolbox Dashboard | DEPAR (unescwa.org) 41 Arab SMEs Summit | DEPAR (unescwa.org)

26

helped with research, data collection, and finalising materials. Weekly meetings were organized with the coordinators under each division. The teams used Trello to see what others were doing. In ECLAC, the International Trade and Integration Division and the Production, Productivity and Management Division jointly developed a course promoting digital economy and digital trade. In ECA, the ECA subregional office for Southern Africa (SRO-SA) and the ECA Digital Center of Excellence (DCE) collaborated to jointly produce a study on the “Role of Digitalisation in Strengthening Capacities of Micro, Small and Medium-size Enterprises (MSMEs) in Southern Africa”42. The ECA Subregional Office for Southern Africa collaborated with the ECA Africa Institute for Economic Development and Planning (IDEP) to deliver two training courses on role of technology and innovation for MSMEs. In some cases, informants mentioned that the Surge coordination meetings organized by UNCTAD helped identify other units from the same implementing UN entity involved in the project. Despite such examples, other staff also stressed that the overall emergency context meant there was little time to pursue internal synergies as teams concentrated most often on activities under their direct responsibility and on achieving immediate results.

41. The project enabled some level of technical collaboration and complementarities between implementing UN entities. According to the concept note, the project was conceived to propose a coherent approach towards MSME resurgence reflecting the holistic and comprehensive nature of efforts needed to ensure and facilitate the MSMEs’ green, resilient and inclusive recovery. Activities sought complementary and synergies in impact among participating agencies covering key interrelated components of an enabling entrepreneurship ecosystem. Inter-agency collaborations expanded the dissemination of agency-specific products while coordination and communications helped to avoid overlapping activities. Some joint products were also developed by the implementing UN entities, most often involving UNCTAD as one of the partners (see also next paragraph). UNCTAD and ESCWA, for example, cooperated to inform and build awareness on the e-registration platform for MSMEs. ESCWA leveraged US$ 30,000 from the project to organize a capacity development workshop with UNCTAD to familiarize member states in the Arab region with the e-registration system. This generated interest and ESCWA was later able to mobilise US$ 600,000 from different sources for two e-registration projects in Jordan and Syria43. UNCTAD also produced a global report on market access and competition policy44 to which ESCWA and the other Regional Economic Commissions contributed through advice, inputs, data, and review of the document. In Europe, ECE’s COVID-19 impact assessment targeting MSMEs in Georgia45 spurred discussions with the Ministry of Economy and Sustainable Development leading to the integration of Georgia’s non-tariff measures (NTM) information into UNCTAD’s NTM database46,. In Romania, ECE took up the Empretec methodology and provided grants for the Asociatia pentru Antreprenoriat din Romania (APAR) to conduct two in-person workshops of 9 days each which were attended by 60 MSMEs. In coordination with the Regional Economic Commissions, UNCTAD organized a series of regional capacity-building events to raise the awareness of policy makers on the role of competition-related policies for access to markets in the post-COVID-19 resurgence of MSMEs. UNCTAD, ESCAP and the Trade and Competition Commission of Thailand (TCCT) organized, for example, a conference in June 2022 on the Contribution of Competition Policy to the Resurgence of MSMEs post-COVID-1947, to which DESA and ESCWA also contributed. UNECA and UNCTAD co-organised a Regional Policy Dialogue on “The role of Competition Policy in supporting MSMEs economic recovery in the post COVID-19 crisis” and collaborated on a case study on South Africa for the UNCTAD global report on “How Covid-19 affects MSME access to markets and competition: a review of key issues and recommendations for future action”. Evaluation informants also mentioned that the project provided a unique and successful opportunity to learn about the work of the other implementing UN entities in the area of entrepreneurship and MSME development, therefore contributing to the “One UN” agenda. The project website48, developed to gather outputs and increase their visibility and sustainability, was also commended by many informants. However, most of these collaborations had a

42 The role of digitalisation in strengthening capacities of Micro, Small and Medium-Size Enterprises (MSMEs in Southern Africa to take advantage of the AfCFTA): ECA Sub-Regional Office for Southern Africa (SRO-SA) & ECA Digital Centre of Excellence (uneca.org) 43 ESCWA also mobilized an additional US$300.000 for an e-registration project in Sudan but the political context in the country did not allow for implementation. 44 The covid-19 pandemic impact on micro, small and medium sized enterprises: Market access challenges and competition policy (unctad.org) 45 Impact_COVID-19_Georgia.pdf (unece.org) 46 UNCTAD TRAINS 47 Conference on the Contribution of Competition Policy to the Resurgence of MSMEs post-COVID-19 | UNCTAD 48 Home | UNCTAD

27

bilateral character and the evaluation noted the difficulties for Regional Commissions to collaborate with one another.

42. Several factors limited opportunities for amplifying synergies between interventions and for establishing a stronger global coherence. From a total of 100 project outputs formulated across the three phases of the project logframe, only 6 were identified by the evaluation as joint outputs from 2 implementing UN entities (Figure 4, in yellow), out of which just 4 were effectively delivered (i.e., UNCTAD and ECLAC on outcome 5). Joint outputs were formulated for phase 3 of the project, owing to several factors such as the short duration of phases 1 and 2 and the need for a sufficient amount of time to design joint interventions identified after a national agenda, the number of implementing partners progressively increasing between phases 1 and 2, or the limited cross-institutional awareness of each partner’s expertise on and capacities for supporting MSMEs.

Figure 4: Project outputs per implementing UN entity and phase.

Note: Joint outputs are referred to in yellow. Source: PRODOC.

43. Staff from different Regional Commissions attempted to establish synergies with other Regional Commissions for this project but with limited success. ESCWA for example reached out to ECE and ECA to seek their prior experience in supporting MSMEs with a view to uploading their materials on the DEPAR portal to be used in the region and globally. Despite several meetings and some exchange of materials, there was no concerted effort to populate the DEPAR portal. Several evaluation informants in UNCTAD and the Regional Commissions seconded the perspective of an ECE staff member that “everybody was too busy and there was no time to make the effort of cooperation”. According to a staff member, if “capacity development by Regional Commissions is to be jointly done, this is a long process cycle” not suited to a crisis situation. Evaluation informants also mentioned that the geographical focus and mandates of the Regional Commissions created various challenges to collaboration as the Regional Commissions come with different areas of expertise and niches. Furthermore, needs of Member States also varied across and within regions. In addition, although the EPF was found to be a comprehensive and flexible framework, none of the implementing UN entities outside of UNCTAD had the capacity to cover all pillars. On average, UN entities covered about 2 out of 5+1 project outcomes (Figure 5), i.e., they remained geographically and technically focused. Accordingly, several informants shared the perspective that the project was a compilation of activities and outputs based on a unifying and valid conceptual framework (i.e., the EPF) and cluster-based approach but with limited synergies, moderate coherence, and high overall complexity. According to a staff member at ESCAP, “The project did not install joint indicators and reporting. If there was to be a joint event, it would indicate specifically who would deliver what. It was not about the project producing a pool of papers without referring to one or another agency; products were assigned by entity. From then on, it was clear agencies would have different streams of work.” Some evaluation informants questioned the cost and benefit of a global project in a crisis context compared to several inter-regional projects (see section on Efficiency), despite this project enabling strong knowledge exchange between participants.

Figure 5: Number of project outcomes covered by the implementing UN entities.

28

Source: Final report. To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non-Secretariat) to COVID-19 in delivering socio-economic support to Member States?

44. The project triggered some collaboration with other UN entities at national, regional, and global levels. At global level, UNCTAD partnered with UNITAR to provide the e-learning course “Policymaking: Entrepreneurship for Sustainable Development”49, which was followed by 317 policymakers from over 104 countries. ESCAP also published a series of knowledge products on MSME Financing50 that benefitted from a partnership between ESCAP and the United Nations Capital Development Fund (UNCDF). Complementarities with other UN organisations were also at national level. In several cases, the UN RCOs and UNCTs were referred to as project partners. In the Gambia, the Ministry of Trade, Industry, Regional Integration and Employment together with DSDG/DESA and the UN Country Team organized a high-level policy implementation forum in December 2020 on supporting MSMEs in the post-Covid-19 pandemic era, focusing on promoting MSME formalization51. In Europe and Central Asia, UNDP was often involved substantively and/or logistically in the delivery of online or hybrid workshops and dissemination events. In Armenia for example, ECE, UNDP, and other partners organized in March 2022 a conference on “Unveiling Market Opportunities for Boosting Residential Energy Efficiency and Alleviating Energy Poverty”52. UN Women also contributed to the development of a roadmap in Moldova based on the recommendations outlined in a study on women-led MSMEs, conducted by the project. Country office staff from several UN organisations including FAO, UNDP, OHCHR, and UNHCR also attended some of the online trainings or events delivered by the project. Despite such examples, evaluation informants were often of the opinion that the project had not maximised partnerships with other UN entities owing to several constraints or limitations, including the respective crisis response priorities and challenges in UN development agencies, limited staffing capacities from the project to focus on partnership building at global level, limited funds directed towards creating synergies with other agencies, lack of dedicated outputs and indicators referring to joint work with other agencies, and the lack of country presence of the implementing UN entities (see also §46).

45. The project was implemented with a range of partners that complemented the responses of the UN entities. Besides UN entities, project implementation involved a range of other partners at international, regional and national levels that helped to complement the responses from other UN organizations. Expert speakers in ECE events included, for example, important players in greening the MSMEs agenda, including the International Chamber of Commerce (ICC), World Trade Organization (WTO), Organisation of Economic Co- operation and Development (OECD), European Bank for Reconstruction and Development (EBRD), and a number of national authorities and private sector players. In Southern Africa, the project contributed to strengthening the ECA SRO SA partnership with the SADC Business Council and national chambers of commerce and industry in all 11 Southern African countries. Joint events were organized by ECA and the SADC Business Council at the SADC Industrialisation Week in Malawi and the Dubai Expo 2020. ECA also developed a digital platform on technology and innovation for MSMEs to be hosted by the SADC Business Council. According to the evaluation survey, the majority of respondents were of the opinion that the project complemented interventions implemented by other international organizations working in their

49 E-Learning Course on Policymaking: Entrepreneurship for Sustainable Development | UNCTAD 50 ESCAP’s MSME Financing Series | ESCAP (unescap.org) 51 High Level Policy Forum on MSMEs | United Nations Development Programme (undp.org) 52 From buildings to small companies, UNECE supports countries to reap benefits of improving energy efficiency | UNECE

1 1 1

5

1

2

3

2

1 1

6

1 1

2 2

5

1

0

2

4

6

UNCTAD DESA UNECA ESCAP UNECE ESCWA ECLAC

Phase 1 Phase 2 Phase 3

29

country/region (Figure 6). As illustrated by a private sector representative in North Macedonia, “A lot of organizations were conducting projects regarding COVID. However, this one was the only one providing actual information on practical ways to mitigate some challenges arising from the pandemic”.

Figure 6: Perceived complementarity of the project with other interventions according to the survey (n=130 respondents).

Source: Independent evaluation survey, 2023.

46. Partnerships with other UN entities and organisations proved challenging to harness. Despite the above and some other cases, the evaluation found that the project was not able to establish a cohesive eco- system of strategic partnerships. The initial concept note of the project considered that project governance would establish working groups on each outcome area, including “Digital economy solutions for advancing SME resilience (ITC, ITU, UNCDF, UN/CEFACT)”, “Resource Efficient and Cleaner production (led by UNEP and UNIDO)”, “Zoning/urban issues (led by UN-Habitat)”, “Employment (led by ILO)”. The Project Document for Phase 2 of the project also mentioned that “Close cooperation and partnerships should also be sought with World Bank, IFC.” This proved over-ambitious. In practice, the evaluation found limited global collaboration with UN entities also engaged in responding to the crisis and providing support to MSMEs, such as the ILO53, UN Women54, or FAO55. The evaluation also did not find evidence of the project attempting to leverage funding from other UN COVID-19 response mechanisms, such as the UN COVID-19 Response & Recovery Multi- Partner Trust Fund (MPTF) which financed projects at the national or subnational level in some of the countries where the project was implemented. Some informants stressed that Member States were looking for financial resources to support MSME resurgence, which is rather in the realm of the development banks. However, connections with the World Bank and the regional banks were limited. Partnerships appeared, therefore, primarily based on a bottom-up approach, relying on legacy collaborations or immediate opportunities, but not necessarily globally strategized and pursued. It should be noted though that the project did not dedicate specific resources to such activities (see next section).

5.3 Efficiency

How well coordinated was the process for the response among the entities implementing the joint project?

47. Despite unprecedented circumstances with the Covid-19 pandemic, and the lack of clear dedicated resources, the administrative, management and financial processes for the response were well coordinated overall. According to the initial concept note, Phase 1 of the project aimed to implement two components.

53 wcms_854253.pdf (ilo.org) 54 WEA-ActionBrief3-SMEs.pdf (weps.org) 55 COVID-19 Response and Recovery Programme | Resource Mobilization | Food and Agriculture Organization of the United Nations (fao.org)

28%

43%

18%

3% 2% 1%

5%

The project complemented interventions by other international organizations working in my country/region

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

30

Component 1 was to be led by ESCWA and planned to establish a virtual knowledge hub. Component 2 was to be led by UNCTAD and targeted the provision of hands-on assistance to countries on several sub- components grouped as 1+5 thematic clusters56. Although the narrative of the concept note did not identify an agency in charge of the overall coordination of the project, the budget featured the output “Coordination and proposal preparation” for which UNCTAD was to be provided US$ 27,000. This lack of clarity in the initial setup of the coordination of the project was reflected in the evaluation interviews, informants from the various implementing UN entities, including UNCTAD and ESCWA, having different perspectives on the scope of work and responsibilities for the coordination of the process during the first phase of the project (see also section on Effectiveness). The Project Document for Phase 2 clarified that UNCTAD would be the lead agency for the overall coordination of the project. This role was reflected in the budget of the project, with UNCTAD receiving US$ 40,000 for “Output –.1 - Overall coordination”, but not included in the project logframe. A Project Steering Committee was to monitor project delivery and make necessary adjustments to ensure smooth implementation 57. In practice, evaluation informants distinguished three different periods regarding the coordination process. The first period coincided largely with the preparation and implementation of Phase 1 of the project (from April to June 2020) during which the DA-PMT was reported by UN entities’ informants as having a very active coordination role. The second period spanned from August 2020 until April 2021, covering Phase 2 and part of Phase 3 of the project. It had regular (i.e., about bi-monthly) Project Steering Committee meetings coordinated by UNCTAD. Then, from April 2021 until the closure of the project, a third period saw the Project Steering Committee meetings attended by a larger number of participants (up to 40 participants). Project Steering Committee meetings held during the 1st, 2nd and 3rd phases were not technical but provided room to discuss and align activities. According to an informant who attended the 3rd phase meetings, “they were also used by UNCTAD to propose participants to build synergies on topics, but the project was so broad that this seldom happened (sic)”. Most often, the evaluation informants reported that these 3rd phase meetings were useful to learn about the activities of other implementing entities. However, the complexity of the project also made these 3rd phase meetings at times quite long and difficult to follow. Furthermore, the different time zones made it challenging for all staff to participate. In terms of administrative and financial management, project staff in UNCTAD reported an efficient and supportive DA team. This was valued as, according to a staff in UNCTAD, “the UN requirements to obtain the funds are onerous. There is a need for expertise for administrative management and administrative rules to prepare requests and reporting.” Monthly financial statements were provided to project management in UNCTAD. The DA also helped in understanding who among the UN entities was behind schedule and who was on track. According to an informant in UNCTAD, “In the project management meeting, one UN entity could have a narrative saying that all was going great but then, with the DA, we would see the financial delivery was only 12%. Then we knew we had to push delivery. The DA provided the implementation rate. Very helpful.”58 To support its internal coordination, UNCTAD specifically designed in April 2021 a new product, the project monitoring dashboard, consolidating information on UNCTAD’s planned outputs and how each intervention was progressing. Several informants from UNCTAD reported this as a very useful, centralized tool. The dashboard was regularly updated, despite being demanding to maintain. Collecting information from staff was time-consuming. Furthermore, the dashboard was very detailed, recording information at the activity level (some outputs could entail a dozen activities) and across 11 data fields. In preparation for the progress report for Phases 1 & 2 in May 2021, the dashboard was used to compile information from all the implementing UN entities. Despite most informants reporting appropriate and efficient project coordination considering the circumstances, informants in UNCTAD, and across the partner entities, shared the perspective that the project could have benefited from additional staffing capacities dedicated to global coordination as well as to coordination with countries and UNCTs, and to partnership building.

48. The technical coordination of the response proved sometimes difficult to install and sustain. According to the concept note (Phase 1), working groups and task forces were to be formed around thematic clusters to support a coordinated approach and complementary efforts among participating agencies. It was

56 The concept note indicated the creation of the following clusters: A- Access to Resources (Component 1); B- Entrepreneurship and business skills facilitation; C - Business facilitation; D- Access to Finance/financial literacy; E- Access to Technology; F- Access to Markets. 57 As per the Project Document for Phase 2: “Project Steering Committee - Representatives from UNCTAD, DESA, ECA. ECE, ECLAC, ESCAP and ESCWA will have online meetings once in two months to monitor project delivery to ensure smooth and steady implementation. Representatives from all seven entities will meet on an as-need basis for important decisions that affect all seven entities.” (p. 53). 58 As a side note, DA Focal Points reported that meetings of the DA Focal Points network became more dynamic and substantive with the response to the Covid crisis.

31

initially envisaged that members of these task forces would include the implementing UN entities as well as other UN partners. The Project Document (Phase 2) narrowed down the prospective setup for the clusters’ technical coordination by referring to Task Forces comprised of experts from the implementing entities. According to an informant, “The discontinuation of the original concept note was positive because it was unrealistic. The problem is that staff members were on other jobs, no one exclusively working on the project. It was time-consuming to coordinate and staff had different agendas and there were different priorities between partners.” In practice, this cluster-based thematic coordination was loosely implemented but fluid, sometimes involving sharing of information between several implementing agencies, though more often one- on-one bilateral and direct exchanges. As noted earlier, interviewees reported information sharing with UNCTAD and sometimes directly between the Regional Commissions “but then entities were doing their own part”. One of the cluster leads for example proposed that the Regional Commissions undertake a global analysis on market access and COVID-19 to develop a joint policy paper, but this did not work: “Colleagues wanted it but there were so many things to do. Project managers did not approve it and it was not in the logframe.” In that sense, the technical coordination of the project and its contribution to the efficiency of the response was eventually more closely aligned with the aim stated in the initial concept note as “(t)he effort will help to enhance coordination in the area of the MSME promotion in the UN system, and avoid confusion, duplication, and waste of resources”. Informants in UNCTAD and the Regional Commissions shared the perspective that directing adequate staffing capacities specifically to technical coordination may have facilitated the establishment of stronger synergies between the implementing entities. Furthermore, despite most UN informants being supportive of the global architecture of the project, including as a modality to enlarge partnerships and seize the benefits of a “One UN” system approach, a few staff from the Regional Commissions suggested to commit more time in the future to analyse the added value of global/inter-regional versus regional projects. It was argued that coordination costs increase with the complexity of the project and with the number of actors involved. As indicated by a staff in ECE, options to balance would include designing a global project or inter-regional or regional projects “and then coming together for dissemination at global level". Therefore, “the added value of a global project should be thoroughly assessed before project design. But during Covid it was a global challenge. […] Regional projects might have been an option. If going through inter-regional projects, their added value should also be well assessed. But in crisis, with the short timing and need to bring everybody under the project, one needs to cut some corners.”

How did the three-phase budgeting and programming approaches impact the efficient delivery of the project?

49. The phased approach was found to be a valid mechanism to cope with the uncertainty of the crisis. The project was developed and implemented under a three-phase budgeting and programming approach: Phase 1 spanned over 2 months (May-June 2020), Phase 2 was implemented in 6 months (July-December 2020), and Phase 3 was provided a total of 18 months (initially January-December 2021, extended twice, first to March 2022 and then to June 2022). On the programming side, during Phase 1 various entities were able to leverage existing products to deliver some immediate responses to countries that had requested assistance. In general, during Phase 2, the project contributed to develop tools, deliver technical support, and customizing materials required by countries. Phase 3 enabled implementation at country level of the tools developed during phase 2 and, building on country experience, to collect good practices and lessons learned that further informed policy makers. Technical staff interviewed by the evaluation were largely positive about the 3- phased approach. Interviewees recalled that this was a very difficult period and that it was unclear when the pandemic would end. Although a clear project plan for the entire period would have been beneficial, the context was too unstable to warrant it. According to a staff member in one of the Regional Commissions, the 3-phased approach “was the optimal and rational thing to do”. It was well aligned with the uncertain circumstances and supportive of a learning process. According to staff at UNCTAD, “Phases helped adaptive management” as “each phase was an innovative stage that gave a chance to introduce new things not foreseen at the beginning”. Incidentally, as put forward by a staff member in one of the Regional Commissions, it shows that the UN had an agile way of thinking to cope with the challenge. On a few occasions, a more nuanced assessment was conveyed by interviewees. Several informants reported that the phased approach added to the complexity and uncertainty of the project and made it more difficult to understand its design, and that a Theory of Change was missing.

50. The project would have benefited from providing clearer visibility on the funding available. From a financial standpoint, the five Development Account COVID-19 projects, including this project, were funded from various DA funding sources. This entailed relying on interest savings, residual balances from the 10th and other closed tranches, and savings from the 11th tranche. Accordingly, the overall available funding was

32

confirmed by phase. It was determined in late 2021 that the combined proposed phase 3 budgets submitted by the five projects exceeded the funding that became available by 1 million USD. As a result, the projects were requested in November 2021 to reduce their proposed phase 3 budgets, and for this project, the budget was reduced by $310,000, from a total of $3,165,500 to $2,855,500. UNCTAD received the final instalment for phase 3 in December 2021. Due to the requirement to reduce the budget and revise the planned activities for phase 3, all five projects were extended by three months to March 2022. However, according to informants at UNCTAD, this initial 3-month extension did not fully account for the late final instalment in the context of a global crisis. A UN staff member mentioned, for example, that if implementing UN entities “want to recruit a consultant, they need funds, then to identify candidates, then 2-3 weeks to issue the contract, then the consultant needs to do the work. That can take 3 months in normal circumstances”. However, the context of the pandemic imposed additional delays. Some activities that were planned to be delivered in person had to be delivered online instead in 2022, which required time for reprogramming based on the new budget. Furthermore, counterparts were also challenged as there were uneven capacities in beneficiary countries to put in place some of the interventions. Accordingly, activities for which disbursements were made shortly before the closure of the project in June 2022 were still underway several months later. Informants indicated that this contributed to the delayed completion of the final report of the project, together with limited resources for project monitoring and reporting in the Regional Commissions, particularly when the DA Focal Points were not associated with project implementation (see next section). Some staff also felt that the phased approach created a lack of visibility on the funds that would be mobilized by the DA. This was sometimes found to be a challenge when designing the project, as it prevented setting clear expectations and a clear design. Better visibility on the resources in the pipeline could have helped to construct a different logframe, which would have been designed at phase 2 and used at phase 3 with little revision. According to a UN staff member, a clearer view on the funding available for the entire duration of the project could have helped the teams to consider additional scenarios, such as focusing some of the activities on a more limited number of countries with greater depth.

5.4 Effectiveness

To what extent did the programme (Development Account) and project governance and management structures and processes enable, or hinder, the effective implementation of the joint project and the achievement of its results?

51. The Development Account programme, as a funding modality, was an effective tool in supporting the design of a global response to support the resurgence of MSMEs post-COVID-19, with remaining questions about it being the most adequate tool in comparison with other UN agencies and mechanisms with a mandate for humanitarian response. DA is a regular budget capacity development programme. It funds, among others, operational workshops, advisory services, and travels to countries to deliver capacity-building activities. Projects are approved by the General Assembly as part of the programme budget for the first year in the biennium. The project implementation period (from receipt of funds by implementing entities to the financial closure of the project) usually is 4 years, following a design or planning period that takes about 1.5 years. 59 Given project specificities and circumstances, and, possibly, limited knowledge of the DA rules and procedures, evaluation participants reported different views on the duration of DA-funded project cycles, the requirements for partnerships and indicators, and the DA governance structure. The converging perception is that a regular DA-funded project cycle is long and onerous to plan for. Nevertheless, to provide a swift and global answer to the COVID-19 crisis, an adaptive management approach was adopted. These procedures were made flexible, the design phase was significantly shortened, and a phased planning was introduced. For the five COVID-19 projects, the Surge project included, the GA approval of project concepts was skipped, while the endorsement by the DA Steering Committee remained and the use of residual balances from closed and closing projects to fund the five projects was retrospectively reported in the fascicle for 2022, which was submitted to the GA in 2021.60 Hence, the concept note of the Surge project and 1.5 years of implementation

59 Under regular tranches of DA, the design or planning phase of projects starts with the launch of a DA new tranche by the USG for Economic and Social Affairs and the development of concept notes by 10 DA entities, and ends with the approval of the project documents by the DA Programme Management Team and the endorsement of DA budget and funded projects by the General Assembly. 60 A report commentator referred that “this has happened in the past when developing projects using residual balances from the tranche budget, but has never happened, nor is allowed to happen, for regular tranche projects.”

33

period was endorsed to initially respond as quickly as possible to the urgent requests from Member States to address the socio-economic fallouts of the pandemic. It was widely reported by informants that this was the best approach to the circumstances, as no one knew how long the crisis would last, with expectations that it could be just a few months. An advantage of this alternative path to access residual balances from closed and closing projects, reported to this evaluation by a DA representative, is the almost immediate availability of resources. This promptness is praised by stakeholders in many implementing entities as a ‘unique’ achievement.

52. Nevertheless, when the DA was compared with other UN agencies and mechanisms with mandate and resources to provide humanitarian assistance in a crisis context, informants referred to the difficulties to be as prepared as these other agencies. The strategy, then, was to focus on post-crisis recovery and development, as a suitable DA approach to actively support countries and, specifically to the Surge project, MSMEs. Yet, informants from the regions referred that adaptations to the project document guidelines kept the highly demanding requirements of the fund and this was assessed by them as an issue to be reviewed if the fund is to be used in future crises. A better crisis-fit approach would have involved an even more agile track, and a focus on deliverables of immediate effect to mitigate the crisis’ impact on MSMEs and government policies (e.g., enhanced access to emergency finance and digital tools for trade). Informants shared expectations about the DA-PMT’s review of the five COVID-19 evaluations toward helping to inform the DA’s role in dealing with future shocks.61 Among members of the project coordination team, for instance, there are ideas about the usefulness of the Entrepreneurship Policy Framework as an overarching tool with relevant potential outputs for crisis response, as discussed later. Considering that the EPF is the key framework of UNCTAD to fulfil its role as the UN focal point for entrepreneurship and MSME policy for sustainable development (RES/71/221 and A/RES/73/225), EPF-related ideas can be considered as a tool to support crisis response funded by the UNDA.

53. Project governance and management structures and processes, overseen by the DA-PMT, supported a quick and overall effective response in light of the UNDA standards, identifying available resources and potential partnerships that ensured the delivery of an impressive number of outputs and achievements at the outcome level, even if joint delivery between implementing entities took time to come to fruition and some DA-FPs were ambivalent about the extent to which they were involved. Addressing a crisis of global scope such as the COVID-19 pandemic was new to the DA’s management structure. Seeking to find quick and effective ways to deal with it, the Head of the Capacity Development Programme Management Office of DESA, in his role of assisting the DA Programme Manager, sent out a memo to the DA focal points in the 10 implementing entities on 18 March 2020, inviting them to a Skype call to discuss the DA's COVID-19 support to Member States, in particular the possible reorientation of the ongoing 10th, 11th and 12th tranche projects, on 20 March 2020. The meeting minutes indicate that the participants were informed of two proposals for potential response initiatives from ESCWA (on SMEs) and from DESA (on statistics). A follow-up meeting was convened on 26 March, where five other project proposals were discussed, and other implementing entities were requested to provide comments on those proposals, as well as submit any additional proposals. After these extensive consultations with DA-implementing entities, DA-PMT selected five topics considered as the most relevant to a socio-economic response to COVID-19 and built on comparative advantages of DA- implementing entities. This included strengthening the capacity and resilience of MSMEs to mitigate the economic and social impact of the pandemic – ESCWA’s proposal. The preliminary idea of this project, as reflected in its 1-page concept note, focused on digital tools to support SMEs. UNCTAD further enriched it with additional ideas, such as the e-registration platform and entrepreneurship for SMEs. The project concept note finally took shape with the inputs of more entities, including DESA and other four regional commissions. As more implementing entities joined the project, UNCTAD supported the clustering of activities in 5+1 outcomes, with implementing entities taking outcome leadership according to their expertise and capacities. This structuring of the project governance, with DA-PMT’s oversight, and the management structure with UNCTAD in the overall coordinating role and each implementing entity leading the operational implementation at regional level ensured the global and regional scope of the project delivery. At the level of the ongoing processes, implementing entities relied more on partnerships with local and regional institutions rather than coordination within the larger project management structure. The online meetings of the steering committee

61 An updated information about this review received in feedback to this evaluation report refers that “this programme- level evaluation had to be cancelled due to the delay with the completion of four of the five project evaluations (only one has been completed to date, and two are expected to spill into 2024). A meeting of the DA focal points to discuss the findings of the five project evaluations will be organized by DA-PMT as soon as they are completed; the DA's role in dealing with future shocks would certainly be discussed at this meeting.”

34

and the smaller-scale coordinating role of the task forces to weave efforts worked to a limited extent, as these meetings were not as regular as planned in the project document. The result was a high delivery rate with limited inter-agency coordination in the process. Yet, this independent evaluation identified that the higher- level governance and management structures and processes were effective in bringing the project together with identifiable results at the outcome level.

54. Given the uncertainties about how the pandemic would evolve, and considering the pressing immediate needs, a first phase of the project was launched with a limited number of outputs (n=7), in May 2020. It resulted from meetings of the DA Network in March and April 2020. From April 2020, these became bi-weekly meetings of the DA focal points. It is noteworthy that this process was not recollected as such by the informants of this evaluation. There is a perception that not all DA-FPs were involved from the start, that this inclusion was gradual and followed advances in the project. Informants acknowledged that these meetings also included staff from the implementing entities to discuss the next steps to be taken, the different country and regional needs, and the installed regional expertise to propose responsive actions62. This trickled down into several smaller-scale bilateral meetings at the regional and local levels. It became clear that the DA’s mandate on development had to be taken into consideration when planning the project outputs and adapting activities associated with crisis response (e.g., providing direct health support was out of the scope of possible answers). The DA’s development mandate, instead, could support the strengthening of institutions that needed preparedness and resilience to design supportive measures in a post-pandemic recovery perspective. Hence, out of five projects, the Surge was one with the objective of developing and implementing capacity-building tools for governments and MSMEs to facilitate the resurgence and strengthen the resilience of MSMEs in developing countries and economies in transition. There was a need to bring the relevant expertise of different entities quickly on board. Because of its global mandate and expertise on entrepreneurship and MSME policy, UNCTAD became the lead agency of the Surge project, and coordinated the elaboration of a project document to deliver a global response with more entities. For the first time, the DA-PMT was intensively involved in the oversight and monitoring of project implementation, with more direct contacts with the technical cooperation staff – rather than going through organizational-level DA focal points. “The DA PMT was in contact with the DA-FPs but had more contacts with the project managers than it would normally have.” (DA-PMT representative). This was made possible by the small number of projects responding to the COVID-19 crisis. This centralized approach allowed for a swift response at a global level, with a record time endorsement of the concept note and the Phase 1 budget by the DA Steering Committee. DA-PMT’s oversight and direct contact with technical staff resulted in the institutionalization of periodic meetings with DA-FPs and other stakeholders. UNCTAD DA-FP, represented by the Technical Cooperation Section (TCS), served as a bridge between the DA-PMT and UNCTAD project teams, especially at the design stage. UNCTAD TCS also provided substantive support to the UNCTAD project coordinator in the draft of the concept note of the MSME Surge project. During the implementation stage, UNCTAD DA-FP participated in several project Steering Committee meetings and addressed questions from project teams. UNCTAD, as the leading entity, and under the guidance of the DA-PMT, communicated directly with the project focal points to monitor progress. This monitoring was supported by UNCTAD Budget and Project Finance Section through the sharing of financial information on implementation rate by the implementing entity. This, and the evolution of the pandemic, brought more clarity about the needs and the implementing capacity of UN entities and member states in responding to the crisis. It supported the design and implementation of phases 2 and 3. There is consensus between informants that the introduction of the phased planning was consistent with the uncertainties of the pandemic crisis, and they would not recommend another way to respond to it, despite reporting some bottlenecks.

55. There are different perspectives on how well the DA procedures were adapted for crisis response. Following the requirements for joint proposals as much as possible, according to informants, felt like squeezing a 4-year long implementation period into 1.5 years. It was suggested by some informants that, instead of a concept note and a PRODOC, a crisis response could have required only one of them. Outcomes were over- ambitious for a 2-year project, but project planners felt they had to comply with the DA requirements, even if this would imply challenges to deliver at the outcome level. Indeed, some outputs were delivered after the end of the project (see next section). There was and internal quality control of the PRODOC with multiple inputs, oversaw by the DA-PMT to ensure a ‘good enough quality’ level, however, a higher-level involvement of all relevant DA-FPs in dialogues and feedback loops from the start and the gender review and other quality assurance steps (i.e., internal clearance processes of the implementing entities of interim documents) could

62 Other informants referred to these meetings as more about sharing information than coordination between implementing entities.

35

have improved the quality of the PRODOC further. For instance, it could have ensured that project indicators cover the SMART63 criteria and be better aligned with a crisis response context – some were the same Empretec-based indicators in use for the past 10 years. In one example suggested by an informant, instead of having an indicator on increased sales of MSMEs, the project could have one about ensuring that a certain percentage of MSMEs that received project support remain in business. Informants confirmed that designing the logframe of the project was challenging because of the scale of the COVID-19 crisis, the number of implementing entities involved, and the uncertainty about the level of funding associated with the phased approach. The high number of planned activities and countries would imply a thin distribution of financial resources. What some project teams did to manage the uncertainty of resource availability and ensure delivery in the Surge project was saving resources from regular projects. Informants acknowledged that these managerial and processual arrangements were the best that could have been done during the crisis and the uncertainties associated with it, but also acknowledged that, even with some trimming in the proposed activities, the end result was less focused than would usually be the case. A lesson learned is the need to assess what crises the DA programme is equipped to respond to (e.g., economic, financial, market, health, climate, national, regional, global, etc.) and what tools can be immediately made available to countries in need. For instance, the e-registration platform was mentioned as an existing technology for e-government that was rapidly scaled up to respond to the needs of MSMEs in the COVID-19 crisis.

56. The project governance and management structures and processes were effective in supporting bilateral collaborations between UNCTAD and individual Regional Commissions in delivering project outputs, but there were limited project-level management mechanisms. Nevertheless, the operating mechanisms supported communication and seeded exchanges of information between regions with increased joint deliveries toward the end of the project. From the perspective of the DA-PMT, according to interview data, one of the purposes of bringing all implementing entities together in bi-weekly meetings was to foster dialogue and help collaboration for a quick response to the crisis. It seems that this did not represent an inter-entity coordination function of these meetings, but a sharing of knowledge to be taken up by other coordination structures. A project coordination team, with two representatives of UNCTAD and one of each of the other implementing entities, was set up. The actual coordination was mostly centralized in UNCTAD, as the project lead. The perception of some members of the PCT is diverse in relation to how the PCT worked, with some of them referring to themselves as focal points rather than members of the PCT, and others not providing substantive evidence on how the PCT, as a whole-of-project coordination structure, worked. Evidence from deliverables indicates that collaboration was bilateral, mostly between UNCTAD and individual Regional Commissions, and built on previous successful collaborations. Some informants referred to parallel streams of work without coordination with the work of other Regional Commissions. Others saw the Surge project as an opportunity to learn about what other Regional Commissions were doing and to set the stage for future collaboration. For instance, ESCAP, ESCWA and ECA exchanged information about the DEPAR portal, exchanged materials, and participated in meetings; ECE and ESCAP acknowledged that mutual cooperation can be facilitated by them having member States being in both commissions. Interviewees from all implementing entities referred to attending events organized by other entities. An advanced level of cooperation was achieved by ECLAC and ECA (through its Africa Trade Policy Center (ATPC) and IDEP), on the online course material on competition policies delivered in Portuguese. They engaged in initial conversations and, because the pace of implementing this specific output was different in each entity, this was an asynchronous cooperation, mostly involving the sharing of course materials. Yet, this is reported by ECLAC as a successful South-South cooperation during a turbulent crisis context.

57. UNCTAD, as the lead agency, focused on bilateral cooperation according to regional expertise and planned outputs. UNCTAD cooperated with ECLAC, ESCAP, ESCWA, ECA, and ECE in the delivery of outputs such as “The COVID-19 pandemic impact on micro, small and medium-sized enterprises – Market access challenges and competition policy” (phase 1, output F7). With ECLAC, UNCTAD collaborated in delivering a training course on competition law and policy, an online course on competition and SMEs and cross-border trade, outputs on competition policy, and technical assistance for projects on Asia exports in the LAC region. With ESCAP, UNCTAD collaborated with the creation of the ASEAN SME policymakers’ network, and a discussion paper and meetings proceedings of this network. With ESCWA, UNCTAD collaborated in actions on topics such as e-registration, and the organization of an event on digitalization. This partnership grew stronger and new partnerships emerged in the area of competition. With ECE, UNCTAD collaborated with a report on SMEs, and counted on ECE speakers contributing to its workshops. This is consistent with UNCTAD’s traditional approach of engaging in bilateral cooperation, rather than interregional. A factor associated with

63 Specific, Measurable, Achievable, Relevant, and Time-Bound.

36

this approach is the source of demands for assistance, which normally are country- or regionally based. In addition to collaboration between implementing entities, the Surge project also promoted intra-agency cooperation. This was reported within UNCTAD, involving Empretec, the competition and consumer protection policies branch and the investment branch, within ESCAP, on the Bangladesh-related outputs, including the UNCTAD Voluntary Peer Review of Competition law and policy of Bangladesh, with a focus on SME, and within ECLAC, between the economic affairs and international trade divisions. This independent evaluation identified that, toward the end of the project, in phase 3, there were more joint deliverables involving different Regional Commissions (e.g., the online events on competition policy and MSMEs held in phase 3), which suggests that cooperation increased as the project advanced. A lesson learned from these collaborations is that cooperation depends on a combination of countries’ needs, sources of resources (e.g., donors’ requirements, modalities of funding and what they allow to be funded), continuous presence of staff and time for coordination. This makes planning for cooperation a challenge, especially under a global crisis of the COVID-19 scope. Nevertheless, higher collaboration could have been fostered had the project coordination team worked more effectively and planned joint outputs. Hence, despite Surge’s opportunities for cooperation, actual results of these initial efforts are at an early stage.

To what extent has the project contributed to the expected outcomes as enunciated in the project document?

58. Eighty-six outputs were delivered across the world’s regions, built on the expertise of UNCTAD and the Regional Commissions, and some degree of inter-entity collaboration. These deliverables composed a mosaic of actions that, on a global scale, contributed to achieving the outcomes enunciated in the project document. Implementing entities adapted resources and expertise that they already had and expanded (mostly bilateral) inter-entity partnerships to quickly attend to the most urgent needs of entrepreneurs and policymakers to support MSMEs in the first 2-3 months of the project. These actions comprised making information digitally available64, converting face-to-face training into online, developing digital platforms to support MSMEs and governments in responding to the crisis, and producing and disseminating assessment reports on the impact of COVID-19 on MSMEs. UNCTAD, ESCWA, and ECE delivered the eight outputs of phase 1, with some collaboration with the other entities to collect data for the development of these outputs. For the delivery of the Competition and Consumer Protection assessment report (output F7 of phase 1), under UNCTAD lead, for instance, all regional commissions were involved. Outputs in phase 1 were delivered not knowing how long the crisis would last but considering it could extend to 2021. As successive COVID-19 infection waves hit the world, the end of sanitary measures was not foreseeable. Phases 2 (planned to last until the end of 2020) and 3 (planned to last until the end of 2021) expanded the project to support more countries and MSMEs, and increasingly relied on inter-entity collaboration to ensure a high rate and quality of delivery. The PRODOC of these phases, then, involved seven implementing entities and shifted from general responses (phase 1) to the delivery of a wide range of country- and region-based interventions65. The project’s responses to these needs depended on the locally installed capacities to develop more resilient institutions and supportive policies to MSMEs. Some of these deliverables, mostly those related to online awareness- raising, policy dialogue and workshops, relied on inter-entity partnerships to be successfully delivered. Examples from phases 2 and 3 are the UNCTAD-ESCAP Regional Dialogue held in cooperation with the ASEAN Secretariat, the series of Online regional capacity-building events on the role of competition policies for access to markets in post COVID-19 resurgence of MSMEs (UNCTAD-ECE, UNCTAD-ECLAC, UNCTAD-ESCAP), the UNCTAD-ESCWA-ECA Regional Policy Dialogue: The role of Competition Policy in supporting MSMEs economic recovery in the post COVID-19 crisis, the Sub-regional workshop: Global initiative towards post- Covid-19 resurgence of the MSME sector – Women in informal and small-scale cross-border trade (UNCTAD- ECA), the online course Oportunidades y retos para Mipymes de América Latina en el e-commerce transfronterizo66 (ECLAC-UNCTAD), and the Global Policy Dialogue: Post COVID-19 Resurgence of MSMEs and Competition Policy (all seven implementing entities), The Surge project, therefore, effectively delivered a wide range of interventions (i.e., advisory services, trainings, workshops, seminars, digital portal, events, and

64 Smart search engine: Manara Portal (unescwa.org); MSME knowledge portal: https://msme-resurgence.unctad.org/ 65 From a project management perspective, phase 2 was to develop intervention tools and phase 3 was to implement them at country level. The analysis of the deliverables, however, shows a mixed picture, determined by the local capacities to move from the development of a tool to its implementation. Many outputs in both phases 2 and 3 combine, for instance, course development and delivery (e.g., OP 1.5 and 1.6, OP 3.4 and 3.5, and OP 5.10 in phase 2, and OP 1.14, and 5.3 in phase 3). 66 Translation: Opportunities and challenges for MSMEs in Latin America in the cross-border trade.

37

direct technical assistance through policy advice, assessment reports, research studies, and tailored guidelines), directly assisting 96 countries in specific ways. A good practice that comes from this approach is that a global response can be made of multiple local and regional actions that are the most relevant and impactful for its recipients during a crisis. Figure 6 shows the distribution of project-planned activities per phase and implementing entity. The number of outputs planned increased from 7 in phase 1, to 38 in phase 2 and 60 in phase 3 (+57.9% from phase 2), totalling 105 outputs, even under a budget cut of USD 310,000. UNCTAD was responsible for 50% of the outputs in phase 2 and 43% in phase 3.

Figure 7: Surge Project outputs delivered per implementing entity and implementation phase67.

Source: Project’s final report, 2022.

59. It is noteworthy that the number of outputs slightly changed between the PRODOC and the project final report. Additionally, this independent evaluation received evidence of deliverables completed after the conclusion of the final report, in 2022 (e.g., five outputs delivered by UNECA in phase III), and others that do not clearly fit in any of the project planned outputs (e.g., ESCAP’s papers on MSME Financing Series, delivered in 2022). Table 7 summarizes these changes and updates and presents the percentage of outputs delivered.

Table 7: Planned and delivered outputs per project phase. Phases PRODOC

outputs Final report

outputs Delivered outputs*

% delivered Not delivered**

1 7 8 8 100 2 38 39 36 92.3 4.3, 5.9, 5.13

3 60 54 42 77.8 1.25, 2.2, 2.3, 3.2, 3.3, 3.4, 4.1, 4.3, 4.5, 4.7, 5.5, 5.6

Total 105 101 86 85.2 * Based on evidence collected in this independent evaluation. **These outputs fall into the following situations: not delivered due to budget cuts, in progress (i.e., reports in the inception phase by the time of this evaluation), or missing information.

60. Overall, 85% of all project outputs were delivered. Phase 3 has the highest number of outputs and the lowest percentage of effectiveness, around 78%. It was impacted by the budget cuts, the longer time needed to conclude some outputs and the lack of information for this independent evaluation. In cases of budget cuts, this evaluation counted as delivered those outputs with at least 50% of the activities concluded. It is noteworthy that the delivery of some of these outputs was concluded after the end of the project68, given factors such as the pandemic barriers to implementation, coordination difficulties, personnel turnover, and

67 Figure 7 presents the number of outputs fully delivered as stated in the project’s final report. In addition, 6 outputs were still in progress when the final report was submitted (ECLAC 1 output, UNCTAD 1 output, UNECA 4 outputs in progress). 68 Interviewees used the project’s final report (2022) as reference for the end of the project, since some of their deliverables, pending then, were concluded afterwards.

Phase 1

Phase 2

Phase 3

0

5

10

15

20

UNCTAD DESA UNECA ESCAP UNECE ESCWA ECLAC

3

0 0 0 2 2

0

19

2 4 4 4

1 2

19

1 3 2

9 7

4

Number of project outputs delivered per phase

38

limited capacities of member states. Considering all these barriers, this independent evaluation considers the level of effectiveness high, since these rates of delivery contributed to the achievement of the main project objective through significant achievements in each project outcome, as described next.

61. National capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship and MSME promotion in post-COVID-19 resurgence (outcome 1.A) improved through e-learning courses, awareness-raising activities, technical assistance in designing and implementing national entrepreneurship policies, the creation of regional networks of policymakers, and knowledge production and hubs on MSME’s policies. Deliverables to support national capacities started in phase 1, with the launch of the DEPAR portal by ESCWA. This portal provides a wide range of tools and services to MSMEs, such as the MSME toolbox69, with business guides, inspiration stories, start-up tools, external tools and news from partners on innovation, technology, policy-making, etc. It allows visitors to become part of a community of practice, in which participants can share content, build their own community, create events, develop courses, and announce opportunities. One of the ideas for the portal was to provide a one-stop shop for materials from other Regional Commissions too, but, later, it became clear that this would lengthen the path70 for MSMEs and policymakers to access materials from their respective regions and this was not implemented. Figure 8 indicates a growing number of users to the portal, with about 2000 users four months after launch, and about 3000 users one year after launch. Most of these users are from Jordan (59%, according to data from 20 June 2023). There was no qualitative information to explain the quantitative trend.

Figure 8: DEPAR number of users.

Source: ESCWA.

62. Other deliverables under outcome 1.A included e-learning courses based on the EPF; a series of webinars to policymakers on entrepreneurship policies for MSME resurgence; technical assistance in designing and implementing national entrepreneurship policies; the creation of the Asia-Pacific MSME policymakers’ network and follow-up workshops; the creation of a knowledge hub on policy measures, tools and practices on MSMEs’ resurgence; regional workshops to promote dialogue on women’s role in small-scale and informal cross-border trade and tailored recovery; development of the ‘Compendium of Renewable Energy Technologies’ with an online toolbox and training materials on green recovery of MSMEs; policy roundtables with communities and SMEs; and design and implementation of entrepreneurship policies and strategies based on regional assessment. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, with approval rates above 74% across project dimensions (Figure 9). It is noteworthy that, given the small response rate, survey results need to be interpreted with caution, keeping in mind that these findings reflect the perceptions of those who responded to the survey questions, and are not representative of all participants (See the methodology section for details).

Figure 9: Effectiveness results of outcome 1.A (n=51 respondents).

69 https://depar.unescwa.org/msmetoolbox. 70 This would increase the need to liaise with ESCWA to upload information according to regional needs (i.e., more time to have information available online), and could impose a barrier to MSMEs and policymakers from other regions to access their regional information (i.e., by adding ESCWA as an intermediary institution between local stakeholders and their respective RECs).

39

Source: Independent evaluation survey, 2023.

63. In the second half of 2021, the 5-week UNCTAD/UNITAR EPF e-course launched with the objective of enhancing the capacity of policy makers to provide policy response and support measures on MSMEs for post-COVID-19 resurgence and develop longer-term strategies for a resilient and competitive MSME sector. One of the course contents explicitly addressed how the environment for and role of entrepreneurship evolved during and in response to the COVID-19 pandemic. It was developed in English, French and Spanish, and covers all five pillars of the EPF. It was preceded by the launching of webinars with the participation of UNCTAD officers, UNITAR representatives, policymakers, and thematic experts. The UNCTAD / UNITAR 2021 Summary Report of this EPF online course presents data for each of its three versions. Results indicate a gender balance between the number of male (n=221) and female (n=223) registrants to the course in the English version, a higher number of female registrants (female=65, male=48) in the Spanish version, and a higher number of male registrants (male=78, female=52) in the French version. Between 5-7% of registrants indicated another gender in the three course versions. The majority of survey respondents, in the three versions, indicated that the course presented new information (>75%) and was relevant to their jobs/occupations (100%). The likelihood of survey respondents applying the information acquired from the course is above 96%, and all respondents would recommend the course to a friend or colleague. This e-course supported UNCTAD’s assistance to Uganda, Seychelles and South Africa in designing and implementing national entrepreneurship policies (NES) based on the EPF. The NES of South Africa focuses on Youth Entrepreneurship, the NES of Uganda on migrant and refugee entrepreneurs, and the NES of Seychelles on the marine biotechnology sector with reference to youth entrepreneurs. Although there was an impact assessment of the NES implemented before the COVID-19 pandemic in The Gambia, this was not delivered due to the budget cuts in phase 3.

64. A set of deliverables by ESCAP included the launch of the terms of reference of the Asia-Pacific MSME Policymakers’ Network (February 2021), followed by a concept note. Three online regional dialogues of the Network were organized by ESCAP in partnership with UNCTAD and ASEAN secretariats. They covered the digital economy (including how to support women entrepreneurs through ICT, business skills training and innovative financing), the role of competition policy in strengthening the business environment, both in March 2021, and the launch of the Policy Guidebook for MSME Development in Asia and the Pacific71, in May 2022. Documents produced to support the Network include a paper on the digital economy72, UNCTAD’s broad survey on the impacts of the COVID-19 on the business environment, particularly in relation to competition issues (2020)73, and the regional report ‘The Role of Competition Policy in Strengthening the Business

71 This book describes the MSME contribution to achieving the SDGs, with comprehensive and practical information to policymakers on MSME development. 72 Callo-Müller, M. V. (2020). Micro, small and medium enterprises (MSMEs) and the digital economy. 73 UNCTAD (2020). Covid-19: Firmer Action Needed to Better Protect Consumers. [online] https://unctad.org/news/covid-19-firmer-action-needed-better-protect-consumers.

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

provided access to information and best practices on government support measures for post COVID-19

recovery

improved my knowledge on entrepreneurship/MSMEs policies design and implementation in the context of

post COVID-19 recovery

contributed to identifying new/improved policy measures for MSME promotion in post COVID-19

resurgence

The project...

Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

40

Environment for MSMEs in the ASEAN Region’ (2021)74. Following up on the second meeting, there was a report with recommendations to governments, competition authorities, development agencies, and multiple stakeholders on competition policy measures in a pandemic recovery context. Assessment data is available for the two first meetings and shows that more than 75% of the respondents indicated enhanced knowledge and skills, allowing them to effectively receive from and share information with others in the region regarding MSME policies (>67%), and providing opportunities to enhance regional cooperation in competition policy and law (>69%). Comments from participants referred to the advantages of sharing experiences with other countries, learning how they try to overcome MSMEs’ problems during COVID-19, and providing ideas on how to promote digitalization to MSMEs via education. Interview data indicates that the Network became inactive afterwards, since ESCAP dropped the MSME agenda after the project to focus on other demands.

65. In September 2021, the ‘UN-ESCWA Entrepreneurship Community Workshops and Policy Roundtables – How to improve existing government and non-government programs’ took place, with a set of interactive discussions on existing government programs, existing non-government programs, needed government programs, and needed non-government programs, with follow-up recommendations on these areas. Specifically on the health economy, a set of online conferences on ‘Entrepreneurship in the new health economy’ were delivered in October 2021. One targeted the Asia-Pacific region75, with 45 attendees, another targeted Latin America76, with 25 attendees, and another, Africa77, with 33 attendees. They were organized in partnership with private sector organizations in the health sector for policymakers. It is noteworthy that, except in the African event, these conferences did not include policymakers among their panellists. These conferences generated inputs to the publication ‘Entrepreneurship & innovation in the new health economy’78, launched by UNCTAD in 2022. This document highlights the role of SMEs and start-ups in the new health economy in developing countries, with main findings on the role of regulation in the e-health sector, and the role of public institutions in building bridges between different stakeholders.

66. The resilience and competitiveness of MSMEs in post-COVID-19 resurgence (outcome 1.B) improved through a large set of Empretec-related activities (including trainings tailored to low literate entrepreneurs), cross-border trade workshops for female traders, adaption of the Farming as a Business program, and country-tailored guidelines and best practices on circular economy and sustainable resource management. Outcome 1.B is the one with the highest number of deliverables (n=28), each encompassing sets of activities and supporting MSMEs in multiple countries. They can be grouped in four packages: Empretec (responsible for most of these deliverables and demonstrating the effectiveness of UNCTAD’s pre-existing capacity to deliver trainings, including onsite, during the COVID-19 pandemic), informal and small-scale cross-border trade for women traders, UNCTAD’s Farming as Business program, and Guidelines and best practices on circular economy and sustainable resource management79. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, with approval rates above 68% across project dimensions (Figure 10).

Figure 10: Effectiveness results of outcome 1.B (n=39 respondents).

74 ESCAP (2021). The Role of Competition Policy in Strengthening the Business Environment for MSMEs in the ASEAN Region. 11 February 2021. NOTE: there is no authorship in the document. This reference may need revising. 75 Scaling innovation in the new health economy – lessons learned from the Asia-Pacific region. 76 The rise of medtech in Latin America. 77 Unlocking digital health innovation in Africa. 78 UNCTAD (2022). Entrepreneurship & innovation in the new health economy. Geneva: UNCTAD. 79 Given the higher emphasis on government advice, more details on these guidelines are in the highlight box on the contribution of the Surge project to the country’s government responses to the COVID-19 crisis regarding the resurgence of MSMEs.

41

Source: Independent evaluation survey, 2023.

67. Effectiveness evidence of the Empretec package of deliverables indicates that development of the updated online training course (E6DM) was a strategy to facilitate post-COVID-19 entrepreneurship recovery. Ten Empretec webinars, jointly organized and delivered by UNCTAD and Empretec Centres between April and December 2020, were attended by Jordan, Malaysia, Ghana, Nigeria, Russia, South Africa, The Gambia, Argentina, Benin and Zimbabwe. In tandem, 5-day E6DM TOTs were delivered in seven batches with participants from 15 countries80, between June and October 2020. In total, 65 men and 32 women participated in these trainings. Training assessments show positive results, with more than 85% of the respondents rating the course content as good or very good, and as a useful opportunity to progress as an Empretec trainer or trainee trainer. The 21-day TOT, delivered in English, French and Spanish in November 2020, had 35 participants from African countries81 and Romania, and 35 participants from Latin America82. The content was assessed as good or very good by more than 83% of the respondents (16 in Africa and Romania, and 25 in Latin America), and useful for their progression as Empretec facilitators (>91%). Training survey comments highlighted, for instance, the online approach, the follow-up and participant-centered approach, and the possibility of interacting and sharing opinions with colleagues as the most interesting aspects of the training. In sequence, ten 6-day Entrepreneurship Training Workshops (E6DM) were delivered in seven countries83 between September 2021 and July 2022. The total number of participants across countries was around 30084, with about 50% of women (estimated on the data available) and some countries reporting the participation of youth entrepreneurs up to 54% (i.e., Ghana). When post-training assessment is available, results are positive with more than 88% rating the overall workshop as effective/useful/good or very good/excellent85. More than 84% rated the workshop content as good-excellent/relevant. Good-very good improvements in entrepreneurial skills ranged between 43% and 100%, good-very good relevance of the training to run the business was above 80%, and estimated good-very good impact on the future of their businesses was between 33% and 100% in a set of 10 possible impacts. Subsequently, UNCTAD delivered an additional online 1-day E6DM TOTs in September and October 2022, as a pioneer effort to homogenize the application of new versions of the Empretec method to different Empretec Centres and trainers. Participants totalled 109 (64 male, 45 female) from 19 countries86.

80 Argentina, Benin, Cameroon, Ethiopia, Ghana, Jordan, Kenya, Peru, Romania, Russia, Tanzania, The Gambia, South Africa, Venezuela, and Zambia. 81 Benin, Botswana, Ghana, Mauritius, Romania, South Africa and Tanzania. 82 Argentina, Chile, Colombia, Ecuador, Panama, Peru and Venezuela. 83 Benin, Nigeria, Cameroon, Zimbabwe, The Gambia, Ghana, and Malaysia. 84 Note: Some country reports do not inform the total number of participants. 85 Measurement scales could be different between countries. 86 Angola, Argentina, Botswana, Colombia, Ghana, Ecuador, El Salvador, Jordan, Kenya, Malaysia, Mauritius, Mozambique, Namíbia, Panama, Romania, Saudi Arabia, South Africa, Tanzania, and Uganda.

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

provided information useful for starting a new business or expanding a business venture

improved my knowledge on entrepreneurship and business development

contributed to identifying new/improved measures to increase business sales

The project...

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

42

68. Other innovations to the Empretec programme implemented in 2021 were the development of a version for low-literate people and a full online training. Between April and May 2021, UNCTAD delivered three sessions of the TOTs for low-literate people, in English, French and Spanish, for 62 male and 58 female participants. Trained trainers, then, delivered three 8-day workshops for low-literate people, between March and July 2022, in Benin, Malaysia and Uruguay. The total number of participants was 72, 57% female. The assessment was positive87 in relation to the workshop in general, its content, and its relevance for the participants’ businesses. Regarding the development of the online Empretec training course using gamification and other IT-based tools88, there is evidence of three pilot workshops with entrepreneurs, delivered in hybrid format and in partnership with SEBRAE (Empretec host institution in Brazil) between December 2021 and August 2022. Each pilot tested the effectiveness of the digital tool and led to the identification of, and solutions to, technical issues. Interviews for this independent evaluation conducted with Empretec centers and UNCTAD staff indicated that the performance of Empretecos in the online course was below face-to-face training. An informant said that “workshops are better when people share in the classroom, with safe environment, with facilitator. Online does not facilitate that.” However, even if the online format is not suitable for a workshop that requires six full days of commitment, some procedures, e.g., tracking participants’ progress, and resources, such as web platform for Empretec centers, can be online. Another challenge of delivering the Empretec training online was conciliating the objective of reaching out to vulnerable beneficiaries with no access to the necessary technology. The solution, then, was to keep Empretec workshops offline. Only the TOTs remained online, to ensure there would be trainers when the presential workshops could be resumed.

69. The Surge project delivered a series of webinars on the role of Empretec on enhancing entrepreneurship promotion in post-COVID-19 resurgence. At the global level, it supported the virtual 7th Empretec Global Summit, ‘Boosting Entrepreneurship: The Contribution of Empretec into the Post-Covid-19 Resurgence of the MSME Sector’, in April 2021. The Summit was attended by over 570 participants from 64 countries and was interpreted in seven languages89. “It was also followed by 783 viewers on UNCTAD Facebook Live and almost 2,000 views were recorded on UN WebTV from 94 countries.” Another global event was the Global Entrepreneurship Congress, in Riyadh, in March 2022. UNCTAD contributed to the Ministerial Roundtable on Entrepreneurship. Regional webinars were held face-to-face in Colombia, in November 2021, with Empretec center’s representatives from Colombia, Argentina and Ecuador and entrepreneurs; and with the francophone Empretec centres, with 68 participants from Benin, Cameroon and Mauritius, in May 2022. Country webinars included an online event with NAWEN in Malaysia, in December 2021.

70. To expand knowledge on relevant topics of the modernized version of Empretec, UNCTAD delivered a series of ad-hoc online courses between August and October 2021. They covered business model generation (64 attendants from nine countries90), design thinking (83 participants from 11 countries91), entrepreneurship and marketing (Seychelles, no attendance data available), capacity-building for women in cross border trade (59 women participants in Kenya and Tanzania), and a 4-day TOT on sustainable businesses and SDGs (62 participants from 10 countries92). Post-training survey data (22 respondents) is available for the last course, indicating 90% of participants were satisfied with the training content and 86% agreed that sustainability as per the 2030 Agenda should be included in their Empretec training activities.

71. An impact survey conducted by UNCTAD in March 2023 collected data from a representative sample of Empretecos in Benin, Cameroon, Ghana, Nigeria, The Gambia and Zimbabwe. The Empretec programme was positively assessed by respondents (8.75 points in 10) and was considered better than the average of other business training tools by 54%. Most respondents reported sales growth after the ETW (67%), and 94% believed sales will increase in 2023-24. Among non-entrepreneurs, 60% reported an increase in their income levels after the workshop, 88% felt more motivated to venture after the ETW, 67% foresaw opening a business in the coming three months, and 91% of the Empretecos believed their employability level had increased after the ETW, a trend even stronger among women. Interviews with Empretec centers for this independent

87 100% of good-excellent ratings in Benin, and an average range between 4.5 and 4.7 in a scale of 5 in Uruguay. The training report for Malaysia did not present specific assessment data. 88 LMBInterativa (2022). Empretec Online. Delivery report. 89 Arabic, Chinese, English, French, Portuguese, Russian and Spanish. 90 Ecuador, Ethiopia, Ghana, Jordan, Kenya, South Africa, Tanzania, Zambia and Zimbabwe. 91 Ecuador, Ethiopia, Jordan, Kenya, Malaysia, Romenia, Saudi Arabia, South Africa, Tanzania, Zambia and Zimbabwe. 92 Angola, Argentina, Brazil, Colombia, Dominican Republic, Ecuador, Guatemala, Peru, Uruguay, and Venezuela.

43

evaluation indicated that, in Zimbabwe, for instance, women and youth facing business difficulties were the majority of those trained. Two of these participants are the founders of the Women in Agriculture Union. They learned how to keep records of funds received from members, and the advantages of doing so. Young entrepreneurs in agribusiness improved product processing knowledge, leading to expansion and new markets, in Zimbabwe. In Argentina, course participants prefer the online course format, even when their access to the internet is hard, because of the flexibility of time and schedule and the possibility to connect with people across the country. The number of participants is much higher in the online version in Argentina. In Jordan, the online TOT targeted vulnerabilities, such as internet connection and digital literacy. The online delivery was a challenge also from the Empretec centres’ perspective. More than three hours of online training was not possible; and the programme is based on learning by doing, i.e., it requires observation of behaviours. The new online tools helped to mitigate this challenge, but they did not always work because of poor IT literacy, people’s commitment, and internet connection.

72. The outputs related to the UNCTAD component on women and cross-border trade, were delivered in phases 2 and 3 of the Surge project. Evidence indicates 6-day presential workshops93 delivered in Zambia (36 participants), Malawi (32 participants), Kenya (64 participants) and Tanzania (64 participants), between February and November 2021. They tackled two main critical issues: lack of knowledge about trade rules and customs procedures, and lack of entrepreneurial skills. Workshop beneficiaries were mainly small- scale/informal cross-border traders, especially women, representatives of cross-border trade associations, representatives from the Revenue Authorities, and other authorities based at the borders. Workshop assessments were positive, with more than 45% of the participants rating that their knowledge about trade rules and customs procedures had improved very much or extremely. Most of them acquired confidence in crossing the border through normal channels (>61%) and will be able to formalize within the next 12 months (>54%). Assessment data for Kenya and Tanzania indicated that more than 80% of the participants rated the programme as excellent, the training content as very relevant for running their businesses, and more than 90% indicated the training will help them improve professional behaviour, management skills, business planning skills, establish a network with other business owners, learn about business opportunities and help learn about funding possibilities. The workshop’s methodology, content and results are compiled in the activity report94 commissioned by UNCTAD. Country-specific guides on ‘Women in informal cross-border trade: A small- scale trader’s guide to trade rules and procedures’ developed by UNCTAD provided tailored information for female traders in Kenya, Botswana, Tanzania, Malawi and Zambia. These guides, except for Malawi and Zambia, contain traders’ obligations regarding COVID-19 measures related to crossing the border and a checklist that includes COVID-19 certificates.

73. A 2022 impact assessment on project activities carried out by UNCTAD on women and cross-border trade95 indicated that 100% of the participants became very or extremely familiar with their rights as cross- border traders, 95% became very or extremely familiar with the obligations of cross-border traders, and 43% acquired considerable knowledge on the use of COMESA and EAC STRs and the SADC Trade Protocols. The enhanced knowledge about the use of official border points was very or extremely helpful for 92% of the respondents. “Some traders reported positive results in terms of increased profits, a larger clientele, and the ability to offer a more diversified range of products” associated with the enhanced use of official border points. Almost all participants (96%) reported that they had adapted their business model. Also, 80% of the respondents considered registering their businesses. Responses were positive on acquiring extremely good or very good understanding of the COVID-related rules (65%). Qualitative data indicated that the training helped trainees to be proactive in protective measures, such as in encouraging customers to wear masks and wash their hands. Regarding new strategies, “some traders turned to digital tools to continue their businesses, including Facebook, Instagram, WhatsApp groups, and online platforms.” Interviews with trainers conducted by this independent evaluation indicated that the results of the training for low literacy beneficiaries in cross- border trade were ‘amazing’, based on a follow-up four months after the training. Proper understanding of the trade rules and procedures, rights and obligations of the traders coupled with upgrading of their entrepreneurship skills helped traders to overcome the adverse trade environment caused by the Covid-19

93 They built on training activities completed by UNCTAD in 2019 in the framework of the project ‘Informal cross-border trade for the empowerment of women, economic development and regional integration in Eastern and Southern Africa’. 94 Tigere, F. (December 2021). Phase III Final Report – Global initiative towards post-COVID-19 micro, small and medium enterprises (MSME) sector: Kenya and the Republic of Tanzania. 95 UNCTAD (2022). Cross-border Trade in the Pre- and Post-Pandemic Environment Evidence from Malawi, the United Republic of Tanzania and Zambia. Geneva.

44

pandemic. Some were able to bounce back and build back their businesses. More information on female traders in cross-border trade is in the specific section on gender and LNOB.

74. The delivery of the Farming as Business (FaaB) programme took place in phases 2 and 3 of the Surge project. Adaptation of this programme referred to the online delivery of the TOT, between February and June 2021. Training material does not refer to the pandemic crisis96. The English version of the TOT trained 25 male and 28 female small farmers from 13 countries97. The French version trained 25 male and 28 female participants from Angola, Benin and Cameroon. The Spanish version trained 9 male and 7 female participants from eight countries98. Post-training assessments, available for the English (15 respondents) and French (4 respondents) versions, were positive. On average, 79%, rated the course content as good or very good, 84% found it a useful learning opportunity, and 95% considered the course useful for them to progress as Empretec trainer or trainee trainer. Following the TOT, a grant agreement between Empretec Ghana Foundation and UNCTAD allowed for training of 65 vegetable farmers in Ghana, in November 2021. A report on this training99 indicated that 90% of the participants were male and 10% female. There is no reference to resilience in post-COVID-19 recovery.

75. The Surge project implemented tools that facilitated MSMEs’ registration and formalization (outcome 2) through an e-registration platform, policy toolkits for governments on formalization, and virtual workshops for knowledge dissemination. Under this outcome, UNCTAD delivered the e-registration platform, implemented it initially in El Salvador (cuentamype100), and expanded implementation to Benin, Cameroon and Mali. DESA developed policy toolkits for the governments of Kenya and The Gambia in streamlining MSME formalization and inclusive delivery of formalization services. The dissemination of these toolkits was with virtual workshops in the two countries. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, but, because the number of respondents was between 3 and 4, no further conclusions can be drawn from our survey.

76. Interview data indicated that the pilot implementation of Cuentamype in El Salvador involved private and public institutions, and the signing of an inter-institutional agreement, considered one of the biggest project achievements in the country. It brought together, for instance, social security institutions, the Ministry of Finance, and municipalities, and attracted the interest of financial institutions in relation to providing credit to MSMEs. The preparation of the platform included the organization of sectoral working tables with these institutions, and a pilot, in 2020, with a group of 20-25 entrepreneurs for feedback, for around 3-5 months. After adjustments, the platform launched in a forum where entrepreneurs could learn about the tool. The project trained government technicians as trainers for the end-users of the platform – 3-4 training days of about 15 nationwide professionals. During technical visits to MSMEs (e.g., women’s owned beauty salons), specific needs of beneficiaries were identified, such as basic knowledge in accounting and individual monitoring, mostly for women. The answer to these needs included the development of a printed simplified booklet on accounting (i.e., a paper version of cuentamype), follow-up visits for six months, and the creation of a WhatsApp group for direct contact with the registry office (CONAMYPE) to get direct support in interpreting financial analysis outputs and suggest improvements to the platform. Out of about 400 trained entrepreneurs101, CONAMYPE estimates that at least half of them use the tool regularly (about 60% of them are women and covering entrepreneurs from 18 to 70+ years old). The e-registration platform was, then, expanded to Benin, Cameroon (guichet electronique) and Mali (guichet unique) in 2021. The online platform increased MSMEs’ registration 91% in Benin (84% women, 181% youth), and 40% in Mali (49% women, 110% youth). Replicating the case of El Salvador, these e-registration platforms are incorporating additional services, such as modifications in business registry and grant applications. Real-time data generated by these platforms have been used to design better entrepreneurship policies.

96 The trainer’s guides (i.e., coffee and dairy farming), in English and French, were produced before the pandemic and their content was not updated to the new situation. The guide on dairy farming in Spanish was issued in 2021 and reproduces the content of previous guides, also not referring to the COVID-19 pandemic situation. 97 Angola, Benin, Botswana, Ghana, Kenya, Malaysia, Myanmar, Panama, Saudi Arabia, South Africa, Tanzania, Zambia and Zimbabwe. 98 Argentina, Chile, Colombia, Ecuador, El Salvador, Peru, Uruguay and Venezuela. 99 Empretec Ghana (Feb.2021). Report on training of farmers on the UNCTAD Farming as a Business (FaaB) programme - Organized for vegetable growers in the Ayawaso West municipaliy – Greater Accra region. Ghana. 100 https://cuentamype.org/ 101 This included entrepreneurs who could not read or write and were not tech savvy. In these cases, entrepreneurs indicated collaborators to take part in the trainings.

45

77. Policy toolkits issued by DESA considered regional and country-based approaches. A regional toolkit was ‘Best Practices: Formalization of Micro-, Small and Medium-Sized Enterprises (MSMEs) in Africa’102, a document that covers a wide range of best practices associated with formalization (e.g., institutional frameworks, regulatory environment, supply and value chains, access to finance, human capital development, and social dialogue). It assembles data from African countries’ best practices, such as Kenya, Nigeria, Rwanda, South Africa, Tanzania, and Zimbabwe, and benchmarks on examples from countries in other regions, such as India, Sri Lanka, China, Argentina and Colombia. Country-based policy toolkits focused on Kenya and The Gambia and included policy documents and virtual or hybrid workshops for knowledge dissemination. In Kenya, the focus was on leveraging policies governing cooperatives of MSMEs, with the issuing of a report103, a toolkit with policy recommendations for the formalization and growth of MSMEs through a cooperative model104, policy guidelines for the formalization of MSMEs in Kenya, modelled on the guidelines for the formalization of cooperatives105, and the toolkit promotion in a virtual workshop in March 2021. A workshop assessment (responded by 60 participants, 41 male, 19 female from African, Asian and Europe countries106) indicated that 98% of the participants were satisfied or very satisfied with the event, and 100% considered the event relevant to their work. Later, in 2022, DESA supported an assessment of the impact of COVID-19 on MSMEs led by women and youth in Kenya 107 and stakeholder consultations, based on these assessments, in a hybrid workshop. For instance, 100% of the 22 respondents (14 male, 8 female) of the assessment of the workshop on the Assessment of the Covid-19 Impact on Women and Youth-led MSMEs in Nairobi, were satisfied or very satisfied with the workshop, and considered it relevant to their work.

78. MSMEs’ access to finance (outcome 3) improved through online training to policymakers and MSMEs (e.g., financial literacy, accounting, SDG reporting), publications, case studies, training of trainers, and national and regional workshops for knowledge dissemination. Outputs under outcome 3 were carried out by UNCTAD and ESCAP. They produced online training material for policymakers on MSMEs’ access to finance, developed training courses for MSMEs for financial literacy and accounting and reporting, including on the SDGs – supported by a guidance –, TOT’s courses on accounting and reporting for MSMEs, published a book on MSME finance, developed case studies on accounting and reporting for MSMEs, and delivered national and regional workshops based on the online materials produced. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, with approval rates above 70% across project dimensions, keeping in mind that the number of respondents is low for robust conclusions and this result needs to be interpreted in qualitative terms (Figure 11).

Figure 11: Effectiveness results of outcome 3 (n=10 respondents).

102 DESA (2021). Best Practices: Formalization of Micro-, Small and Medium-Sized Entreprises (MSMEs) in Africa. 103 DESA (2021). Leveraging policies governing cooperatives to encourage the formalization of micro-, small and mediu- sized enterprises (MSMEs) in Kenya. 104 DESA (2021). Promoting MSME Formalization through the Cooperative Enterprise Model. 105 DESA (2021?). Policy guidelines for the formalization of micro-, small and medium enterprises in Kenya. 106 Kenya, South Africa, Burundi, Tanzania, The Gambia, Lesotho, Morocco, Philippines, Indonesia, Germany. 107 MSEA (2022). Assessment of the impact of COVID-19 among micro, small and medium-sized enterprises in Kenya and their resilience mechanism. Nairobi: Micro and Small Enterprises Authority (MSEA).

46

Source: Independent evaluation survey, 2023.

79. ESCAP led the delivery of a book that set out a post-crisis policy agenda for MSME finance, in 2021108. It addresses MSMEs’ finance gaps and the financial landscape for MSMEs before, during and after the pandemic crisis. The book draws policy recommendations and practical suggestions in MSME finance in relation to, for instance, business services ecosystem, regulatory sandboxes, supply chain and trade finance, financing women-led MSMEs, multi-stakeholder collaboration for mutual benefits, and regulatory framework for fintech. Two thematic studies followed-up, in 2022. One was on the role of banks in Asia in lending to MSMEs109, and the other on the role of digital payments110, including a topic on women-led MSMEs and SDG 5.

80. UNCTAD developed the guidance on core indicators (GCI) ‘Implementation of core SDG indicators for sustainability reporting by companies’ in English, Spanish, French, Arabic, Chinese and Russian, and corresponding training material in partnership with UNITAR. This guidance supported GCI workshops on accounting and reporting for MSMEs in Kenya (23 participants), China (150 participants), Latin America (55 participants, 14 countries), Francophone countries (122 participants, 11 countries) and the MENA (79 participants, 4 countries) and Eurasian (200 participants, 10 countries) regions, between February and November 2021. Across workshop sessions, assessments responded by 246 participants (78 male, 47 female111) indicated that more than 90% of them rated the overall course content as good-excellent/satisfied-very satisfied.

81. MSME’s access to technology and innovation (outcome 4) increased through a combination of survey-based reports assessing the impacts of Covid-19 and the Ukraine crisis on MSMEs at country and regional levels, regional seminars for knowledge dissemination and sensitization of policymakers on needs of MSMEs, online courses on the role of technology and innovation for entrepreneurs and policymakers, including on harnessing green technologies, and knowledge products on a range of areas including building linkages between MSMEs and multinational companies. Activities under outcome 4 were led by ECA, through its Subregional office for Southern Africa, and included surveys circulated to more than 3,000 MSMEs across its 11 member states in Southern Africa, to assess the impacts of the Covid-19 and Ukraine crises on MSMEs112, the development of an online training course for entrepreneurs and policymakers on the role of technology and innovation in addressing this impact (December 2021), an online training course on harnessing green

108 ESCAP (2021). Rethinking MSME Finance in Asia and the Pacific: A Post-Crisis Policy Agenda. Bangkok. 109 ESCAP (2022). Small and Medium-Sized Enterprises Lending Approaches: The Role of Banks in Asia. MSME Financing Series No. 6. Bangkok. 110 ESCAP (2022). MSME Access to Finance: The Role of Digital Payments, MSME Financing Series No.7. Bangkok: United Nations. 111 No gender disaggregated information for the Eurasian workshop. 112 The result was 11 country level reports which, at the time of the evaluation, were being finalized and not yet published.

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

provided useful information on financial inclusion and MSMEs access to finance

improved my knowledge on accounting and reporting, including on the SDG reporting, and

improved my capacity to manage financial resources

contributed to identifying new/improved measures for financial inclusion and MSMEs access to finance

The project...

Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

47

technologies to enhance MSME competitiveness in Southern Africa (August 2022), two side events at the margins on the SADC Industrialisation Week on strengthening linkages between African MSMEs and Southern led MNCs and on the role of technology incubators in MSME development in collaboration with the SADC Business Council Southern Africa113. An additional unplanned output, at the request of the Government of Mauritius, was a regional seminar on “The impact of Covid-19 on MSMEs in Southern Africa: Country Experiences and a Focus on Building Back Better in Mauritius” was held at the margins of Dubai Expo 2020, in collaboration with the SADC Business Council and the Ministry of Industrial Development, SMEs and Cooperatives of Mauritius. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, with approval rates above 83% across project dimensions, keeping in mind that the number of respondents is low for robust conclusions and this result needs be interpreted in qualitative terms (Figure 12).

Figure 12: Effectiveness results of outcome 4 (n=12 respondents).

Source: Independent evaluation survey, 2023.

82. Evidence from the technical report114 of the 4-week online training on the role of technology and innovation for African businesses in addressing the impact of COVID-19 indicated that 41 participants attended the course. Out of those who responded to the post-training assessment, 95% noted that the course modules were relevant to their professional needs and 90% felt satisfied with the relevance of the topic and the modules. Regarding the course on green technologies for African SMEs, the assessment report indicates that 30% of the 155 registrants completed the course successfully by passing the quizzes. Out of these, 45 responded to the post-course assessment. Results indicated that 93% of respondents rated the quality of the course as good or very good, 93% indicated that the content of the course is relevant to their work, and 100% indicated that they will use the knowledge acquired in this course.

83. MSME’s access to markets (outcome 5) increased through activities that combined the production of national and regional assessments, studies and reports with online events for knowledge dissemination of findings, and online trainings for policymakers and MSMEs at the regional level on topics such as competition policies and access to markets, agricultural quality and food loss, and the promotion of export capacity. Outcome 5 is the second in number of outputs planned (n=25) and the first in collaborative deliveries between UNCTAD and the Regional Commissions. Deliverables cover a wide range of activities on competition policies to regulate access to markets during the pandemic crisis and promote the resurgence of MSMEs in post- pandemic recovery. Survey evidence from this independent evaluation corroborates the positive assessments observed for individual deliverables, with approval rates above 66% across project dimensions, keeping in

113 Updated information, received after the finalization of this independent evaluation, indicated that, as of October 2023, the two publications on strengthening linkages between African SMEs and Southern led MNCs and the role of technology incubators for MSMEs development in Southern Africa are completed and being professionally edited. Two other publications, finalized in 2023, are “Opportunities for MSMEs within the Blue and Green Economy: the case of SADC” and “The role of digitalization in MSMEs development in the context of the AfCFTA”. 114 IDEP, ECA (2022). The role of technology and innovation for African businesses in addressing the impact of COVID-19 – Technical report.

0% 20% 40% 60% 80% 100% 120%

provided useful information on MSMEs access to innovation and technology

improved my knowledge on how to increase MSMEs access to innovation and technology

contributed to identifying new/improved measures to increase MSMEs access to technology

The project...

Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

48

mind that the number of respondents is low for robust conclusions and this result needs to be interpreted in qualitative terms (Figure 13).

Figure 13: Effectiveness results of outcome 5 (n=12-13 respondents).

Source: Independent evaluation survey, 2023.

84. A good illustration of coordinated outputs to enhance access to markets to MSMEs is the joint work produced by UNCTAD’s competition and consumer protection policies branch with ECLAC, ESCAP, ESCWA, ECA and ECE. During 2020, multiple regional preparatory meetings between UNCTAD, the Regional Commissions and regional stakeholders discussed how to mobilize participation and build collaboration in designing and implementing these dialogues to raise awareness of the role of competition policies for post- pandemic access to markets by MSMEs. The resulting five online regional dialogues took place between March and April 2021 and had approximately 650 attendees across regions115. This inter-institutional partnership supported the delivery of a global report on the articulation between competition policy and MSMEs (produced in phase I, between June and September 2021)116. This global report provided a snapshot of the challenges MSMEs faced around the world to deal with the impact of the COVID-19 pandemic and drew key recommendations centered around levelling the playing field for MSMEs. It was disseminated with a global policy dialogue, organized by UNCTAD in partnership with ECLAC, ESCAP and ESCWA, in December 2021 (phase 3). This global dialogue explored how competition policy could support MSMEs post-COVID-19, with the presence of representatives and officials of government MSME bodies and competition agency representatives from across the world. It was divided into three sections, one with a focus on digitalization, another on access to finance and government support, and the third on inter-agency coordination between MSME agencies and competition authorities. It was delivered in English, French, Spanish, Chinese, Russian, and Arabic.

115 The UNCTAD-ESCAP-ASEAN dialogue was delivered in English, Thai, Burmese, Bahasa Indonesian and Bahasa Malay and had 149 participants. The UNCTAD-ECA dialogue was delivered in English and French and had 97 registrants. The UNCTAD-UNECE dialogue was delivered in English and Russian and had 140 attendees, 30% from outside the UNECE region. The UNCTAD-ECLAC dialogue was delivered in English, Spanish and Portuguese and had 115 registrants. The UNCTAD-ESCWA dialogue was delivered in English and Arabic and had 150 attendees. 116 UNCTAD (2021). How COVID-19 affects MSME access to markets and competition: A review of key issues and recommendations for future action. NOTE: the previous title is in a press release by UNCTAD and the next refers to the report shared with the evaluation as output F7. Alternate title and reference: UNCTAD (2022). The COVID-19 pandemic impact on micro, small and medium-sized enterprises. Market access challenges and competition policy. Geneva.

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

activities and publications provided useful information on MSMEs access to markets

improved my knowledge on how to increase access to markets, including export and integration into value

chains

activities contributed to identifying new/improved measures on consumer protection and competition

activities contributed to identifying new/improved measures on agricultural quality and food loss reduction

The project...

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

49

85. Other cooperation-based and replicated outputs were the three country case studies on the impact of COVID-19 on specific SME sectors in Brazil117, Thailand118 and South Africa119, delivered between March and December 2021. They were implemented with the support of national institutions to ensure a grounded approach in understanding what competition policy is, how it is framed in the country, and how it can impact MSMEs in the context of the COVID-19 crisis. Each case study provided recommendations to competition authorities and representatives and support entities for MSMEs. A global event in June 2021, ‘DA COVID-19 technical cooperation project on Competition Policy & MSMEs’ resurgence’, disseminated the findings of the case studies and promoted policy advocacy on this subject to 238 attendees. Also, five regional webinars with competition authorities and MSMEs’ institutions delivered on how the recommendations of the global and the three national reports could support the resurgence of MSMEs. A follow-up hybrid global workshop, held in Bangkok in 27-28 June 2022, to discuss ‘The Contribution of Competition Policy to the Resurgence of MSMEs post-COVID-19’ had panellists from UNCTAD, ESCAP, DESA, ECLAC, ESCWA and African countries. This event covered recommended practices for digital platforms for MSMEs120 and presented the guidance document for Thai competition and SME institutions121 for 534 virtual participants. It was assessed as relevant (>95% of participants) and effective in enhancing skills, regional cooperation and methods for integrating MSMEs into regional value chains (>95%). This workshop presented the newly designed online course on SMEs and competition policy, primarily for government officials. The country case studies are cited as having inspired the course showing what capacities SMEs needed to engage in better trade practices. This 5-module course was delivered between November and December 2022 to 141 participants (73 male, 68 female) from 41 countries122. The post-course survey indicated that the experience was very/extremely valuable to 98% of the 72 respondents, 81% felt that the course provided them with learning opportunities not available otherwise, 82% felt able to serve the community with what they have learnt, and 68% considered the course relevant to advance in their career.

86. At the level of the indicators of achievement, despite somewhat lacking in specificity, and the high level of ambition and long-term-orientation for a crisis response, considerable progress is observed. The elaboration of the project indicators was reported by informants as one of the challenges in the Surge’s design phase, given the uncertain pandemic context, the lack of clarity on the resources that would be available for each phase of the project, an understanding that the DA requirements for indicators had to reflect development goals (adequate for longer projects123), and time pressure to deliver as soon as possible. As a result, the management decision was to focus on what would be right for MSMEs’ support from each entity’s perspective (i.e., separate streams of work), beneficial for countries, and already available as standard indicators for the entities. Reviews of the initial indicators followed advances in the project and the evolution of the pandemic situation. From phase 2 to phase 3, some indicators were revised to become more ambitious, since there was more time and resources available. According to members of the project coordination team, there was awareness of the broad scope of these indicators, that some of them were not crisis-driven, and it would be difficult to achieve them within a year. Nevertheless, there is also the shared perspective that they are needed to track longer-term effects of the project. A mitigation monitoring strategy by project managers used proxies or partial reporting from specific delivered outputs when short-term impact could not be measured. This is reflected in the Surge project’s final report, concluded in November 2022. Adding to this

117 UNCTAD (2021). Competition and Market Access Policies in the Resurgence of MSMEs in Post-Covid-19 in Brazil. 118 Charoenrat, T., Harvie, C. (2021). Analysis of the impact of COVID-19 on micro, small and medium-sized enterprises (MSMEs) in Thailand from competition policy and market access perspectives. 119 Nsomba, G., Tshabalala, N., Vilakazi, T. (2021). Analysis of the impact of COVID-19 on micro, small and medium-sized enterprises in South Africa. 120 UNCTAD (2022). Harnessing the interaction between digital platforms and MSMEs: Recommended best practices for digital platforms (RDP). 121 UNCTAD (2022). Guidance for action: Supporting MSMEs’ recovery from the COVID-19 pandemic. Prepared for the trade competition commission of Thailand. 122 Kenya, St. Kitts, Botswana, Philippines, Indonesia, El Salvador, Azerbaijan, Trinidad and Tobago, Kuwait, Belize, Brazil, Barbados, Suriname, Eswatini, Burkina Faso, Peru, Malawi. Côte d'Ivoire, Bahrain, Colombia, Russia, Malaysia, Zambia, Ghana, Jamaica, India, Tanzania, Spain, Grenada, Switzerland, Ethiopia, San Marino, South Africa, Nigeria, Senegal, Montserrat, Egypt, Saint Lucia, Zimbabwe, Madagascar, Liberia. 123 It is noteworthy that the DA guidance on the expected outcomes for PRODOCs of joint COVID-19 response projects states that “The outcomes (OCs) describe the changes that are expected to occur as a result of the completion of outputs. The OCs should be achievable within the project’s timeframe and budget and should be specific enough to be measured by the associated indicators of achievement.” Nevertheless, implementers seem to have been driven by an understanding that the PRODOC approval was conditional to a longer-term perspective on outcomes – an understanding that reflected on their indicators too.

50

evidence, this independent evaluation conducted additional desk review with the support of interviewees who shared the results of the latest outputs delivered, and a survey with relevant stakeholders. This evaluation corroborated comments on the project’s final report in relation to finding mismatches between indicators, project phases and some deliverables, as implementing agencies seem to have shifted activities around, repeated the same activities in different outputs or created new ones since the PRODOC. Other activities in the evidence pool were associated with more than one output and are reported here in the output where their content makes more sense. Also, this independent evaluation pooled together evidence from different implementing entities to make an expert judgement of the progress achieved per indicator, not being restricted to the implementing entity associated with specific indicators. This promoted a better global perspective of the results achieved. Importantly, since most quantitative indicators lack a baseline, the baseline used was the number of countries/participants engaged in the activities under that indicator. At a later stage, more evidence on sustainability and impact indicators will be reported in the UNCTAD Division on Investment and Enterprise’s Annual Research and Impact Report. Table 8 summarizes the findings per indicator at the time of this independent evaluation.124 Out of the 26 indicators of achievement, this independent evaluation located evidence of good progress for 11 of them. Some evidence of progress, from some of the implementing entities involved, but not all, or from a limited number of the beneficiary countries/participants engaged in activities under a specific indicator, was found for other 11 indicators. One indicator showed limited progress and activities related to it are continuing in another project. This independent evaluation could not locate evidence for other three indicators. Overall, this evaluation identified levels of progress for 84.6% of the performance indicators. Indicators under outcome 1A are the ones with more progress reported. Outcome 5 is the one with the most uneven performance in terms of evidence of progress identified by this independent evaluation.

Table 8: Level of achievement of the Surge project indicators. Expected Outcomes Indicators

(Important: each indicator was planned to reflect the work of one implementing entity and

was not designed to cover all participating countries)*

SMART* * criteria covered

Level of progress identified

Source of evidence

OC 1A: To improve national capacities on formulating and implementing enabling polices on green, resilient and inclusive entrepreneurship MSME promotion in post COVID- 19 resurgence

IA 1.1. At least 75% of the countries that participated in the project, have adopted and/or implemented a revised/improved policies aimed at building a resilient and competitive MSME sector in post COVID-19 resurgence

MR Significant progress.

DA 2023W Final report, data from UNCTAD, ESCAP and ESCWA

IA 1.2. At least 75% of policymakers that participated in the interventions of this component indicated their enhanced capacity on entrepreneurship/MSMEs policies design and implementation in the context of post COVID-19 recovery

MAR Significant progress.

DA 2023W Final report, data from UNCTAD, ESCAP, ESCWA, survey

IA 1.3 At least 75% of policymakers and other stakeholders of the ESCWA network indicated their improved access to information on best practices on government support measures for post COVID- 19 recovery

SMAR Significant progress.

DA 2023W Final report, data from ESCWA, survey

IA 1.4. At least 75% of policymakers, MSMEs and other key stakeholders indicated their improved access to the ESCWA knowledge hub on issues on the MSME post-COVID-19 resurgence

SMAR Significant progress.

DA 2023W Final report, data from ESCWA

IA 1.5. At least 75% of users of training materials developed under this component indicated their usefulness for their improved capacities in policy- making for enabling MSME environment

MAR Significant progress.

DA 2023W Final report, data from UNCTAD and ESCWA

IA 1.6. Positive feedback of users of publications under this component (assessment reports and other publications)

AR Some progress.

DA 2023W Final report, data from UNCTAD and ESCWA, survey

124 Importantly, the baseline for each indicator was the activity or activities associated with it, rather than the project beneficiaries as a whole.

51

OC 1B: To improve resilience and competitiveness of MSMEs in post-COVID-19 resurgence

IA 1.7. % of Empretec125 trainees expanding or starting a business venture, disaggregated by country and gender, including by people with low literacy

MAR Some progress.

DA 2023W Final report, data from UNCTAD and ECE

IA 1.8. % of Empretec-supported MSMEs able to increase sales in one year, disaggregated by country and gender

MART Some progress. Gender disaggregated data not available

DA 2023W Final report, data from UNCTAD and ECE

IA 1.9. Number of new jobs created by MSMEs which participated in the Empretec programme, disaggregated by country and gender

MAR Some progress. Gender disaggregated data not available

DA 2023W Final report, data from UNCTAD and ECE, interviews

IA.1.10. At least 75% of participants to the entrepreneurship training courses under this component indicated usefulness of the activities for increasing their entrepreneurship and business skills in the related areas by country and gender

MAR Significant progress. Lacking data by gender for some of the training courses.

DA 2023W Final report, data from UNCTAD and ECE, survey

OC2: To facilitate MSME registration and formalization

IA 2.1. Increased number of new businesses registering, disaggregated by country and gender of business owner

R Some progress.

DA 2023W Final report, data from UNCTAD

IA 2.2. Decreased administrative costs to start a business, disaggregated by country

R Some progress.

DA 2023W Final report, data from UNCTAD and interviews

IA 2.3. At least 75% of participants of the workshops on policy guidelines for MSME formalization stated their increased capacity to facilitate MSMEs formalization

MAR Significant progress.

DA 2023W Final report, data from DESA, survey

OC 3: To improve MSMEs access to finance

IA 3.1. Number of participating MSMEs with improved financial literacy and ability to prepare financial statements, disaggregated by country, and gender

MAR Some progress.

DA 2023W Final report, data from UNCTAD and ESCAP, survey

IA 3.2. At least 75% of MSME participants of online training courses state their improved financial literacy in accounting and reporting, including on the SDG reporting, and improved capacity to manage financial resources, by country and gender

MAR Some progress. Gender disaggregated data not available

DA 2023W Final report, data from UNCTAD and ESCAP, survey

IA 3.3. At least 75% of policymakers that participated in the workshop state their increased capacity to facilitate financial inclusion and MSMES access to finance

MAR Significant progress.

DA 2023W Final report, data from UNCTAD and ESCAP

IA 3.4. Positive feedback of users of the publication prepared under this component

AR Significant progress.

DA 2023W Final report, data from UNCTAD, survey

IA 4.1. Number and type of new/improved adopted measures to increase MSMEs access to technology

MR Data not available

-

125 Empretec is a flagship capacity-building programme of UNCTAD for the promotion of entrepreneurship and micro, small and medium sized enterprises (MSMEs) to facilitate sustainable development and inclusive growth.

52

OC4: To increase MSMEs access to Innovation and technology

IA 4.2 Digital community of practice on use of technology and innovation to build resilience to shocks is created with at least 100 members

MAR Limited progress.126

Data from ECA, interviews

IA 4.3. Positive feedback from users of online training materials and assessment report on their usefulness for increased access to innovation and technology

AR Significant progress.

DA 2023W Final report, data from ECA, survey

IA 4.4. At least 75% of participants of training activities under this component indicated usefulness for their increased access to innovation and technology, by country and gender

MAR Significant progress. Lacking data by gender on usefulness for training activities.

DA 2023W Final report, data from UNCTAD, survey

OC5: To enhance MSMEs access to markets

IA 5.1 Number and type of new/improved measures endorsed by policymakers on consumer protection and competition disaggregated by country

MR Data not available127

DA 2023W Final report, data from ECE

IA 5.2 Number and type of adopted new/improved measures on agricultural quality and food loss disaggregated by country

MR Data not available

-

IA 5.3. Increased number of MSMEs in regions targeted by interventions with increased access to markets, including export and integration into value chains, disaggregated by country and gender

R Limited progress. Gender disaggregated data not available

Anecdotal data from UNCTAD

IA 5.4. At least 75% of policymakers that participated in the workshops indicated their increased capacity to improve MSMEs access to markets, including by integration into the value chains

MAR Significant progress.

DA 2023W Final report, data from ECE and ESCAP, survey

IA 5.5. Positive feedback on usefulness of publications under this component (studies, guidelines, videos, recommendation) by users of these publications

AR Some progress.

DA 2023W Final report, data from UNCTAD and ECE, survey

Source: Evaluation team analysis of available evidence. *Given that each indicator refers to the work planned by a specific implementing entity, this independent evaluation was bound by the coverage of activities of the corresponding entity. Nevertheless, whenever possible, evidence from other implementing entities on the same content of the indicator was considered as evidence for that indicator. **Specific, Measurable, Achievable, Relevant, and Time-Bound.

87. The EPF and the cluster-based approach formed an effective framework to organise outputs delivered by different implementing entities under specific outcomes in the Surge Project, and, also, to support the inter-relatedness between outputs whose content cut across different outcomes. Nevertheless, questions remain on the extent to which this approach is suitable for a crisis response (see para. 89). The EPF and the cluster-based approach were introduced in phase 2 of the Surge project as a strategy to provide a global narrative and weave opportunities for collaboration, mostly evidenced by bilateral partnerships between UNCTAD and respective Regional Commissions, and by collaborations between different UNCTAD divisions (e.g., registration and trade). According to members of the project coordination team, UNCTAD already had the EPF as an agreed menu of best practices to support enterprise development, supported by latest resolutions of the UNGA128. Therefore, as the project moved from phase 1 to phases 2 and 3, the EPF components and the cluster-based approach became the design template for the logframe and structured activities around the five outcomes described previously. Activities delivered by different Regional

126 Update received from ECA in feedback to this evaluation report indicates that this work is continuing under the

UNDA13th Tranche project “Innovative approaches for MSME competitiveness to promote trade and inclusive

industrialization in Southern Africa in the Post-Covid context”. 127 There is evidence of national case studies and regional studies collecting measures taken by governments, but these measures do not result from interventions implemented by the project. 128 UNGA resolutions /RES/71/221 and A/RES/73/225.

53

Commissions and UNCTAD’s divisions, then, became conceptually connected, providing the UN with a clear picture of how country-level deliverables fit the global framework. As stated by a member of the PCT, “The original idea was to put together the areas of expertise of Regional Commissions and divisions within UNCTAD under the pillars of the EPF, but each pillar is a different type of product.” It is acknowledged that only UNCTAD has the capacity to deliver a full EPF project at a global level, as this is its flagship intervention model acknowledged in resolutions of the UNGA. Regional Commissions do not have this global mandate on entrepreneurship policy, so the project benefited from their mandates and expertise on MSME development129. Nevertheless, the implementation of the project by the Regional Commissions was constrained by their work programme for the year – previously agreed with governments –, limited staffing resources and online delivery. Figure 14 reflects how the EPF structured the delivery of the project’s outputs by different implementing entities.

Figure 14: Outputs per project outcome and implementing entity.

Source: Final report.

88. An example of delivery that cuts across the EPF pillars is ECE’s series of guidelines and best practices (located under outcome 1.B) that follow a template that covers topics across the spectrum of the EPF: policy, legal and regulations (outcome 1.A), business facilitation and business registration (outcome 2), access to data, information and knowledge, entrepreneurship skills facilitation, access to finance (outcome 3), access to technology (outcome 4), and market access and logistics and supply chains (outcome 5). Other examples indicate the potential for replicability provided by this framework, such as the national entrepreneurship strategies (outcome 1.A), the e-registration platform (outcome 2), and the case studies on competition and access to markets (outcome 5).

89. Interview data with members of the PCT indicates that the Surge’s implementation was consistent with the way UNCTAD implements the EPF, by assessing what exists at country level, making practical considerations on what can be done, and responding to countries’ demands. A risk of this EPF-centred approach in a global crisis response situation is not building enough synergy with partners and facing implementation difficulties imposed by competing local or regional priorities and uneven competencies on MSMEs. Interview findings corroborate this, with informants referring to challenges in balancing regional priorities and competencies with the delivery of outputs and some focal points in the Regional Commissions reporting a lack of knowledge on the role of the EPF in structuring the project. In these cases, project focal points reported the delivery of what was agreed with UNCTAD on specific outputs and outcomes without a coherent conceptual perspective. Some of them felt that decisions on the project were top-down to create a global response, and delivering under the given circumstances was challenging. Informants from different groups of stakeholders shared the perspective that, for a crisis response, most EPF outputs would be low to medium impact, since they follow a long-term development perspective (e.g., the development of national

129 The Subregional office for Southern Africa, for instance, has a mandate to work on MSME development as contained in the outcome statements of its Intergovernmental Committee of Senior Officials and experts Meetings.

0

10

20

30

40

Outcome 1A

Outcome 1B

Outcome 2 Outcome 3

Outcome 4 Outcome 5

Number of outputs per project outcome

UNCTAD DESA UNECA ESCAP UNECE ESCWA ECLAC

54

entrepreneurship strategies). So, in future crises, it would be an advantage to know from the start what EPF and MSME development-related outputs are fit for immediate results and how to implement them accordingly.

How did the response contribute to the participating country Governments’ responses to COVID-19, especially in the area of MSME resurgence?

90. The Surge Project contributed to the participating country governments’ responses to the COVID-19 pandemic crisis by improving policymakers’ capacity to design and implement enabling policies to MSME resiliency and post-COVID-19 resurgence through studies, technical assistance, training, digital tools, and interventions at the regional level. Survey results from this independent evaluation indicated that 71% of respondents agree or strongly agree that the project contributed to formulate and implement enabling polices on green, resilient, and inclusive entrepreneurship for MSME promotion in post COVID-19 resurgence (Figure 15). Given the small response rate, these findings cannot be generalisable to all project participants and represent the perceptions of those who responded to the question.

Figure 15: Survey responses on the project contributions to formulate and implement enabling policies to MSMEs (n=41 respondents).

Source: Independent evaluation survey, 2023.

91. This was achieved through higher level outputs, such as the Entrepreneurship National Strategies resulting from technical assistance of UNCTAD to the governments of Seychelles, South Africa and Uganda (outcome 1.A) and country-specific case studies with tailored recommendations and follow-up workshops for knowledge dissemination in the Asia and Pacific region (outcome 1.B, see Box 1 below) and Latin America, Southeast Asia and Africa (on the role of competition and consumer policies in Brazil, Thailand and South Africa, outcome 5). The production of assessments on the impacts of COVID-19 on MSMEs at the regional level (Southern Africa in outcome 4, multiple studies in Latin America in outcome 5), followed by policy advocacy supporting inter-institutional partnerships between different areas of government to align policies in efficient and effective ways and learning from exchanges with other countries represent a great contribution to institutional strengthening (e.g., Europe, Latin America). Informants referred to previously ‘unthinkable’ dialogues, collaborations, and policy alignment between different ministries, with policies for the MSMEs becoming part of the bigger inter-institutional government agenda. In Latin America, interview data referred to how SME policy capacity was initially poorly coordinated with other productive development policies. During the pandemic, however, the same institutions adopted a different working methodology by coordinating with other ministries, such as health, economy, and other productive ministries. The intention was to make the most of the money and avoid dispersed actions. The modalities of policy implementation were a) localized, with targets per sector, or certain geographical locations, b) made flexible and adaptable on a case-by-case basis, according to set targets and sectors most affected, and c) with support from local governments. This was confirmed by government officials in El Salvador and Peru. In Kenya, the survey results supported government action in facilitating access to finance to MSMEs through, for instance, the creation of a targeted fund to increase the access of MSMEs to digital platforms. Now, the new government is focused on MSMEs and DESA is supporting the design of a strategic plan aligned with that. In Zambia, the Ministry of Small and Medium Enterprises improved the participation of women in business through various cooperatives.

The project contributed to formulate and implement enabling polices on green, resilient and inclusive

entrepreneurship for MSME promotion in post COVID-19 resurgence

0% 10% 20% 30% 40% 50% 60% 70% 80%

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

55

Learning from other countries in webinars and regional dialogues is reported as an additional contribution to building and strengthening government capacities to respond to the crisis.

92. In relation to providing innovative tools to government, the development and implementation of specific tools, such as the e-registration platforms (outcome 2) in El Salvador, Benin, Cameroon, and Mali improved the delivery of public services to MSMEs through this digital technology. Real-time data on the number of businesses, categorization by type of business, locations, main business activity, gender, age, etc., from the e-government platforms, is reported to be used in the design of better entrepreneurship policies (outcome 4). The e-registration platform increased the number of MSMEs formalized by about 90% in El Salvador130 and Benin131, and 40% in Mali132, supporting mostly women and youth. Benin became the fastest country in the world to register a business simultaneously with 5 different public agencies (in less than 2 hours). These positive results led to requests from these countries to expand the functionalities of the platform, e.g., by providing analytical financial statements, modifications in the business registry, grant applications to access financial resources (outcome 3), and access to social security benefits for employers and employees. The Prime Minister in Cameroon is signing a new Decree on entrepreneurship making online business registration mandatory.

93. Another type of contribution, regarding capacity-building, refers to the development of the online training course on accounting and reporting on the SDGs (outcome 3), with a specific guidance in French, Russian, Arabic, and Chinese and training workshops for MSMEs in English, Spanish, French, Russian, Arabic and Chinese. This approach expanded the outreach of these courses to over 600 participants in 39 countries, indirectly contributing to countries’ advances on the sustainable development agenda. Having these relevant materials available in more than the three official UN working languages represents an additional contribution to governments, since it may expand opportunities for knowledge uptake through other initiatives in the country.

94. It is noteworthy that contributions to governments often take more time than the project duration, since deeper changes require rounds of consultation and chains of approvals. Hence, challenges to make transformational contributions to governments are often beyond the project’s managerial control, such as government’s capacities, institutional changes in governments due to shifts in power or political priorities (e.g., Georgia, Moldova, The Gambia, Brazil).

Box 1: ECE’s guidelines and best practices – from a general approach to supporting country-specific responses. In phase 1, ECE developed two general guidelines and best practices for MSMEs. One of them was on circular economy and sustainable resource management and critical raw material supply chain solutions133 and the other on delivering energy-efficient products and in providing renewable energy equipment134. They refer to the UNFC and UNRMS as a global framework that can help MSMEs to build innovative business models and gain from the new opportunities created by the pandemic crisis. Under outcome 1.B, this expanded to cover a wide set of studies and interventions aimed at supporting governments to develop an enabling environment for MSMEs (outcome 1.A) in the areas of circular economy and critical raw materials, and energy efficiency and renewable energy. Overall, these country-specific guidelines replicate the same structure of the original documents, allowing for country-specific analysis and recommendations, while providing information comparable between countries and sub-regions within the ECE region. They cover opportunities for entrepreneurs, business development managers, technical experts in existing and potential MSMEs, and financiers on the following topics: business facilitation and business registration (outcome 2), policy, legal and regulations (outcome 1.A), access to data, information and knowledge, entrepreneurship skills facilitation (outcome 1.B), access to finance (outcome 3), access to technology (including digitalization, outcome 4), market access, and logistics and supply chains (outcome 5). Recommendations to governments include providing immediate financial support to MSMEs in the event of a crisis (e.g., temporary tax waivers, temporary tax breaks, national financial programs to support MSMEs, offer payment delays, wage subsidies, line of credit and guarantee free loans to MSME), supporting MSMEs in networking and information gathering, and adopting policies to avoid workforce layoffs (e.g., offer employee development

130 In El Salvador, 12,000 new businesses formalized (40% women-led). 131 In Benin, 52,000 businesses formalized between 2019 and 2021, mostly by young entrepreneurs. 132 In Mali, business creations increased from 6,087 in 2019 to 14,796 MSMEs in 2021. 133 UNECE (2020). Guidelines and Best Practices for MSMEs to assure resiliency and progress towards a circular economy in sustainable resource management and critical raw material supply chain solutions. August 2020. 134 UNECE (2020). Guidelines and best practices for micro-, small and medium enterprises in delivering energy-efficient products and in providing renewable energy equipment.

56

programs, such as in digitalization, wage subsidies to cover temporal downsizing and financial support to laid-off workforce). Following the OECD strategic directions for SME development, these recommendations include the development and promotion of 1) an institutional framework and operational environment (e.g., coordination mechanisms for SME policy, collect relevant SME statistics and disseminate the results, improve business closure and insolvency procedures, use targeted public procurement for MSMEs, and a specialized clean energy financial institution to enable MSMEs as a driving force to clean and green economic recovery); 2) access to finance (e.g., public grants, especially for MSMEs working on low-carbon technologies, supply-side financial skills of banks, demand-side financial education for entrepreneurs, credit guarantee scheme, other non-bank financing for SMEs, with a clear governmental guidance); 3) skills and entrepreneurial culture (e.g., training needs assessments, implementation of vocation training policies, access to non-formal training, women’s entrepreneurship); 4) internationalization (e.g., export promotion activities and export-related skills, SMEs to adapt to DCFTA requirements, financial support to exporting SMEs, and SME integration into global value chains); and 5) innovation and R&D (e.g., legal framework for innovation, collaboration between industry and academia, and financial support to SMEs for innovation). Country-specific guidelines on delivering energy-efficient products and in providing renewable energy equipment were produced for Georgia and North Macedonia in phase 2, and expanded to Armenia Albania, Kyrgyzstan, and Republic of Moldova in phase 3. Likewise, customized guidelines on circular economy in sustainable resource management and critical raw material supply chain solutions were produced for Tajikistan and Ukraine in phase 2 and expanded to Bosnia and Herzegovina, Kyrgyzstan, Kazakhstan, and Serbia, in phase 3. Once the guidelines for a country were done, there were regular contacts with the government’s agency responsible for that piece, for dissemination and organization of the online training. These were about half-a-day training sessions, sometimes with presentations from the WB, or UNDP. There were a couple of events by the end of the project delivered face- to-face. Also in phase 3, an updated version of the guidelines and best practices for MSMEs in delivering energy-efficient products and renewable energy was delivered. This update responded to changes in the work environment of MSMEs in this sector in the ECE region, where countries laid out economic recovery through ‘green’ approaches. A follow-up on the original guidelines’ recommendations indicated that “Most of the countries in the ECE region have adopted various economic and operational tools for recovery from the COVID-19 crisis, helping MSMEs in the energy efficiency and renewable energy equipment sector to boost their growth and to bring the clean energy transition across the region. Intervention measures like low-interest financing, innovation grants and funds, operational relief funds, provision of subsidized/common manufacturing units and workplaces, etc. are being issued for supporting MSMEs during the COVID-19 crisis.” The assisted countries can now request technical assistance from the regular programme on technical cooperation to implement the recommendations in these guidelines.

95. The absence of strong policymakers’ networks on policies for MSMEs and of mainstreaming gender- and minority-inclusive approaches hindered the effectiveness of the Surge project in supporting governments’ responses to assist MSMEs recover from the COVID-19 crisis. The two initiatives on building policymakers’ networks, one by ESCAP and another by ECA, showed high relevance and appreciation by country stakeholders interviewed. In the case of ESCAP, after three meetings and a set of associated outputs, such as input studies and follow-up meeting reports, interest on the topic of MSMEs faded away and this network seems to be inactive now. In relation to ECA, the plan was to deliver a ‘Digital community of practice’ (Techni Africa portal) on technology and innovation for SMEs in Southern Africa. Progress was made in developing and validating the digital platform (TechniAfrica) that will host the community of practice, but it had not been operationalized by the closing of the Surge project.135 Another tool with potential to support strategic networks of policymakers is the DEPAR portal. Although it has the digital structure and input materials in place (e.g., the ecosystem maps), there seems to be a lack of institutional effort to build and maintain an active network, as a community of practice. Networks of policymakers could sustain mutual and regional learning on policies to support MSMEs in different sectors, including in cross-border trade.

96. The project could have improved its support to government capacities in cross-border trade by involving government officials, i.e., immigration officers, customs and police with crucial roles on CBT, in the training courses, as trainees, or having a dedicated training session for them. Interviewees referred to their lack of knowledge on CBT and business skills and negative attitudes toward cross-border traders as remaining barriers to facilitating cross-border trade, especially for women. This independent evaluation also found that

135 Update on the operationalization and launch of this platform was provided by ECA in feedback to this evaluation report. The actual operationalization and launch of the digital platform, titled “TechniAfrica”, to be hosted by the SADC Business Council, will be implemented under the UNDA13th tranche project “Innovative approaches for MSME competitiveness to promote trade and inclusive industrialization in Southern Africa in the Post-Covid context”.

57

some sectoral interventions on access to markets were gender-blind by design and they benefited women because a large proportion of workers in those sectors are female (e.g., cocoa and coffee in Peru). Informants referred to a lack of government interest in looking at gender issues amid a pandemic crisis, so implementing agencies, in those cases, focused on their priorities.

What innovative approaches or tools, if any, did the response use, and what were the outcomes and lessons learned from their application?

97. One of the key institutional innovations in the Surge project was the use of adaptive management through an increased consultative process, and a phased approach. The COVID-19 crisis was an opportunity for the DA programme to innovate on how it promotes sustainable development. Its orientation remains geared to the long run rather than to crisis responses, but the efforts to make the Surge project and the other COVID-19 response projects work created momentum to stimulate more joint projects, according to interview informants. They refer to the advantages of learning what other regions are doing and the possibilities to connect through digital technologies, reducing the costs of inviting someone from Asia to an event in Latin America, for instance. Informants also acknowledge the constraints to implementing such collaborations, such as distinct programmes of work in different entities, translation costs, time zone challenges, etc., but feel that the project promoted the interest and motivation for more synergies. The emerging benefits of, and new expertise, on joint projects through frequent consultation with DA focal points and relevant stakeholders (e.g., entities’ staff working on MSMEs) made this modality a good practice to be considered when planning regular DA projects that could benefit from joint implementation. The streamlining of guidelines136 to support the phased approach associated with the Surge project is also an innovative practice. The phased approach was qualified by several UN staff in the implementing entities as ‘unique’ in DA history and seen as one of the main innovative approaches at the institutional level.

98. The Surge Project developed innovative approaches and tools to respond to country needs, such as online delivery of trainings and knowledge-sharing events, the introduction of MSMEs into policy discussions in response to the pandemic crisis, and e-government services. Some of these innovative approaches and tools are being incorporated into the daily work of stakeholders. The most highlighted innovation by relevant stakeholders was the conversion of activities into the online format. Some advantages of this format were the massive extended access to training, inclusive during lockdowns (e.g., e-learning EPF TOT courses delivered, outcome 1.A, Empretec TOT courses, outcome 1.B, courses on role of technology and innovation and green technologies for MSMEs, outcome 4, course on competition policy for MSME resurgence, outcome 5), the opening of opportunities for exchanges between implementing entities (e.g., joint events and participation in each other’s events, all outcomes) and between policymakers (e.g., regional webinars, global conferences, all outcomes), and to bring together multiple stakeholders for wider discussions (e.g., webinars on the health economy in Africa, Asia and Latin America, outcome 1.A). At the content level, an innovative approach praised by different stakeholders was the focus on MSMEs in the context of competition policies (Latin America) and the inclusion of MSMEs in the existing circular economy and resources management tools (Europe) to answer to a global pandemic crisis. This approach had not been thought about and it was transformative to see it associated with the rapid digitalization of services, such as delivery services, and in policy guidelines on circular economy (outcomes 1.B and 5). This brought MSMEs to the mainstream debate on digitalization and competition policies and into ECE’s work on energy efficiency. Innovative online tools that generated rapid results were the e-government and e-registration tools (outcome 2), since they kept public services working during lockdowns and increased the interaction between MSMEs and public services in a digital one-stop shop that can be accessed by computer or mobile phone and saves on paper for accounting books. An additional gain is improving the digital literacy of users.

99. Respondents to the survey conducted by this independent evaluation listed other innovative or unique approaches and tools of the Surge project that they thought the UN should consider replicating or upscaling, with 57 contributions from 48 respondents. Here is a summary of these responses, categorized according to main themes:

136 The timeline for concept note and PRODOC development was shortened, and the concept note guidelines were

shorter than those for regular tranche projects (as the concept note was only subject to approval by the DA Steering

Committee, and not the General Assembly). The PRODOC template still included all the elements of the regular

tranche prodoc, and there was an additional Phase 3 budget proposal.

58

● Leaving no one behind (15 comments): reaching out to resource-poor areas in developing countries and seeking cooperation to do so and following up with them; business that clearly accommodates those with disabilities; supporting the local women and youth-led initiatives to increase accessibility of services by women and girls in hard-to-reach communities (e.g., rural areas); promoting and upscaling global entrepreneurship with e-commerce, especially for marginalized and vulnerable groups; considering the triple impact (economic, social and environmental) of women-led businesses; profiling women-led MSMEs was insightful and helped to develop legal amendments supportive to women employability.

“I live in a rural and poorest province in my country. I was impressed by the reach of the project because while my country (the capital city) is hosting many UN regional offices, UN programmes are unheard of in these parts, though I suspect they are visible elsewhere in the country and region.”

● Capacity-building for MSMEs, entrepreneurs and communities (12 comments): capacitating communities to engage in entrepreneurship; financial literacy training; entrepreneurial training (including on appropriate technology application and innovation); diversification of business opportunity innovations and mentoring of entrepreneurs.

● Scope of the project and mode of delivery (9 comments): online activities (i.e., courses, webinars and information dissemination); large-scale multifaceted project allowing for rapid intervention; the combination of independent study, YouTube videos, exercises, moderated online participation and tests facilitated greater engagement with the material, learning from the facilitator, and peer learning; room for project managers to try out new ideas, to innovate; undertaking a needs analysis and developing programs based on the needs of the MSMEs.

● Access to finance (5 comments): a simplified micro-lending business method, such as funding local small businesses with a day-to-day transaction of lending to collect daily loan offers with affordable interest rates; innovative digital finance solutions and regulatory frameworks to support both financial inclusion and growth of SMEs, especially those owned and led by women (new perspective for the private sector); increasing non-refundable investment support for SMEs in developing and underdeveloped countries; supporting MSEs to access grants; development of investment attraction mechanisms for the energy system.

● Institutional capacity-building and national capacities for policymaking (5 comments): opportunity or skills-sharing from neighbouring countries and building business relationships and Empretec relationships; face-to-face courses for policymakers to support SMEs; improving cooperation between countries; hybrid policy dialogues including the private sector; improving private sector governance to make it an engine of growth.

● Access to markets (4 comments): digitalization in a globalized world; reducing border barriers; the role of competition policy in the economic recovery of MSMEs (e.g., MSMEs continue to face challenges related to their interaction with bigger counterparts in the agricultural sector and current competition laws do not present effective solutions); the work dedicated to the analysis of structural barriers to trade helped to identify measures necessary for facilitation of exports in Africa.

● Guidance for crisis response (4 comments): recommendations to respond economically to a crisis; emphasis on sustainable and inclusive development; studies might contain innovative and/or unique conclusions and recommendations (should upscale and replicate); the whole approach was innovative, enabling one-stop shop for mechanisms and best practices towards post-COVID-19 resurgence of the MSME sector.

● Access to technology and innovation (2 comments): unique in tackling the novelty of COVID-19 for future resilience (upon lessons learned); the project's efforts to leverage technology and digital solutions for MSMEs are forward-thinking.

● Better policies and government strategies (1 comment): improving EE/RES (energy efficient/renewable energy) secondary legislation.

100. Challenges to the institutionalization of some of these innovations include the digital gap and the lack of technological infrastructure and literacy. Two examples illustrate these challenges. First, the pilot tests of the online version of the Empretec training indicated that, even if online training had worked well in training of

59

trainers’ courses, this is not the case for entrepreneurs. Empretec is a lengthy training programme that includes the observation of behaviour and the performance of team tasks, and the online format does not favour these characteristics of the program. Moreover, the course’s online games and activities would not be supported by the bandwidth and the computers the entrepreneurs have access to. Second, the implementation of the e- registration platform in El Salvador required many intermediary – presential and paper-based steps – to include female entrepreneurs of low literacy and technological skills. Implementers developed a paper version of the platform, where entrepreneurs could write down their financial information until they developed the financial and technological skills needed to use the platform. They needed a 6-month follow-up with visits by the implementers and, during training, they would require their help and the help of younger entrepreneurs to, for instance, create an e-mail account and a password and access it afterwards. Another challenge, at the implementing entities’ level, is access to digital platforms for large conferences and meetings. ECE, for instance, depended on UNDP to set up Zoom meetings with interpretation or had to hire interpreters, since the tools available to them would not offer this service.

5.4 Sustainability

What measures were adopted to ensure that outcomes of the response would continue after the project ended?

101. From the perspective of the implementing entities, the Surge project sowed the seeds for joint projects that are being planned or may emerge in the future. Lessons learned from the responses to the COVID-19 crisis seem to be part of a process of internal reflection by the DA-PMT to support better the design and evaluation of joint projects. The lessons learned from the 5 COVID-19 response projects will be reviewed and discussed at a meeting of the DA Network, as soon as all of these project evaluations are completed. Meanwhile, the management response to the final evaluation of the DA T10 Programme on Statistics and Data137, which report138 also took into consideration the impacts of the COVID-19 pandemic crisis, addresses actions to be taken in the course of 2023 and 2024 to improve and develop guidelines on planning, monitoring, and evaluation of joint projects, especially those with budgets above USD 1 million. In June 2023, DA-PMT expressed its intent through interviews to do more joint projects with a long-term view and responding to the evolving world. Since funds are non-earmarked, they can respond to the mandate of UN entities, including by operationalizing the HQ’s analytical work by cutting silos. Joint projects currently in the design phase (16th tranche) refer to the triple crisis – food, water, energy – and the food crisis response for Ukraine. The former has a global scope, covering urban resilience, energy security, financing etc., with a regional perspective (e.g., the climate crisis plays out differently in Europe and in Africa). DA-FPs interviewed acknowledge the uptake of learning from the COVID-19 response in the DA call for crisis-response projects. They refer to faster procedures, with an improved system of calls for proposals supporting the development of concept notes, project documents, and improved templates that are simpler and more concise. Reported improvements include clearer and more specific feedback of the DA-PMT to proposals, e.g., details on indicators, countries, logframe, including suggestions for aggregated activities. At the regional level, informants referred to how partnerships between Regional Commissions in implementing the Surge project have promoted learning about what others are doing and raised interest in seeking further partnerships. Some of the key factors that might limit or facilitate such joint initiatives, under regular project planning conditions, are the availability of resources, the Regional Commissions’ mandates, and their priorities in a moment in time. Future evaluations of joint projects that are planned under such regular conditions (i.e., not called for to a swift response to a major unpredictable global crisis) might benefit from considering evidence on these and other factors to demonstrate the added value of joint projects under more predictable global and regional contexts.

102. There is evidence of the sustainability of e-government tools, training activities and regional and national interventions, with measures related to expanding the functionalities of digital tools, training courses and the formalization of agreements between partner institutions. Across regions, e-registration platforms are being increasingly used by entrepreneurs, mostly youth, with their potential being acknowledged by MSMEs, governments and other relevant stakeholders, such as banks. The result is new requests from different countries to expand the functionalities of these digital platforms and the higher probability that they will remain active in the future. In Cameroon, for instance, the government is signing a decree to make e-registration

137 https://www.un.org/development/desa/da/wp- content/uploads/sites/52/2023/05/MR_to_Final_Evaluation_Report_1617A.pdf 138 https://www.un.org/development/desa/da/wp-content/uploads/sites/52/2023/01/DAT10-Programme-on- Statistics-and-Data-Final-Eval-Report.pdf

60

mandatory. Surge’s managers referred to the e-government platforms as a tool that can be available in crisis response to keep government offices operational. However, there is awareness that these platforms may not respond to all types of crisis.

103. In Southern Africa, the Surge project strengthened relationships between the ECA’s Sub-regional Office for Southern Africa and the SADC Business Council, with joint meetings on MSMEs being held to this day139. Recommendations from the side events held at the SADC Industrialisation Week 2021 and funded under the Surge project were incorporated into the key priority areas for stakeholders, including member states, in the Lilongwe Declaration, issued at the 5th Annual SADC Industrialisation Week (November 2021), under the section on SME and local development, gender, and youth.

104. The project raised the opportunity to pilot an UNCTAD/Empretec Farming as a Business training with small-holder vegetable farmers in Greater Accra, Ghana. However, despite the pilot’s success in empowering farmers who embraced the improved practices with measured increased yield and income, the sustainability of this pilot is not ensured, since its small scale may prove challenging in sustaining access to markets and pro-poor initiatives. In Nigeria, the Entrepreneurship Training Workshop has been recommended by former participants from the government, bringing in more government agencies and state governments to the program, thus enhancing its sustainability.

105. In Latin America, sustainability is rooted in strengthened links between government officials and their stakeholders, such as MSMEs, business associations, and training centers. Based on the courses of the Surge project, ECLAC has been supporting subregional and national initiatives for training MSMEs, using the tools generated to help and promote greater incorporation and formalization of MSMEs in the region, with special emphasis on those led by vulnerable groups such as women and youth. This follow-up work involves different divisions at ECLAC, such as international trade, social development and gender. Also, as a follow-up to the online generic courses on cross-border trade, ECLAC received sub-regional and country requests for tailor- made courses. This generated a customized course for Central America, organized in collaboration with the Regional Center for the Promotion of MSMEs (Cenpromype), on “the "Development of strategic capacities on public policies for electronic commerce" (2022140). This was followed by the planning of a Portuguese version of the course for Brazil.

106. In Thailand, after the end of the Surge project, the SME authority (OSMEP) and the Competition authority (OTCC) signed an agreement in August 2023 that incorporates SMEs into competition policies. This is evidence of the implementation of recommendations from the national case study discussed in the ‘Formal consultation between UNCTAD and Thai institutions: OTCC, NESDC, OSMEP, ISMED and SME Development Bank under the UN COVID19 Project: SME resurgence’ in which representatives of these two institutions were present.

107. The beneficiaries’ perspective on the potential impact and sustainability of results at the MSME level of the Surge project indicates potential long-lasting effects on resilience and competitiveness in post-COVID- 19 resurgence, through high-level achievements in each project outcome. MSMEs and government officials report on implementing activities learned during capacity-building, advantages of the new registration facilities, improved management practices, access to knowledge, empowerment of women and youth entrepreneurs, preparedness to respond to crises through innovation, access to finance and markets, and improved capacities of policymakers. Across the board, 73% of 106 survey141 respondents agree or strongly agree that the project contributed to improving the resilience and competitiveness of MSMEs in post- COVID- 19 resurgence (Figure 16). Given the small response rate, these findings cannot be generalisable to all project participants and represent the perceptions of those who responded to the question.

Figure 16: Contribution of the project to improve the resilience and competitiveness of MSMEs in post-. COVID-19 resurgence in a sustainable way (n=106 respondents). Source: Independent evaluation survey, 2023.

139 The latest one was a 3-day regional meeting, held in June 2023. ECA partners with SADC Business Council on technology and innovation for MSMEs in Southern Africa | United Nations Economic Commission for Africa (uneca.org) 140 136 participants mainly from Belize, Costa Rica, Dominican Republic, El Salvador, Guatemala, Honduras, and Panamá. 141 Survey conducted by this independent evaluation in July-August 2023, responded by responded by government, MSMEs, and other private sector-related stakeholders (e.g., business associations, commercial registry offices).

61

108. Most of these respondents also agree or strongly agree that the project impacted on better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups (64%) (Figure 17). Given the small response rate, these findings cannot be generalisable to all project participants and represent the perceptions of those who responded to the question.

Figure 17: Contribution of the project to better outcomes for women and youth entrepreneurs and other vulnerable groups in a sustainable way (n=105 respondents).

Source: Independent evaluation survey, 2023.

109. Survey results confirm the predominance of positive assessments of the potential impact of the project in each outcome. Because of the low number of responses in outcome 2 (between 2 and 3 respondents), outcome 3 (9 respondents), outcome 4 (11 respondents) and outcome 5 (between 8 and 9 respondents) to the questions on the potential impact of the Surge project, these results are considered as qualitative information that reflects the assessments of those who responded and do not represent a robust finding in quantitative terms.

110. Figure 18 presents the survey results for the impact of outcome 1.A, where 71% of respondents agree or strongly agree that the project contributed to the formulation of better policies for MSMEs.

Figure 18: Contribution of the project to formulate and implement enabling policies for MSME post-COVID- 19 resurgence in a sustainable way (n=41 respondents).

0% 10% 20% 30% 40% 50% 60% 70% 80%

The project contributed to improve the resilience and competitiveness of MSMEs in post COVID-19 resurgence

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

0% 10% 20% 30% 40% 50% 60% 70%

The project contributed to better outcomes for women and youth entrepreneurs and other vulnerable and

marginalized groups

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

62

Source: Independent evaluation survey, 2023.

111. Figure 19 shows moderate impact of the project on creation of new jobs, increases in sales, and creation of new or expansion of existing business ventures, with between 42% and 57% of the survey respondents agreeing or strongly agreeing with the survey statements (outcome 1.B).

Figure 19: Contribution of the project to improve the resilience and competitiveness of MSMEs in post-COVID- 19 resurgence in a sustainable way (n=33 respondents).

Source: Independent evaluation survey, 2023.

112. Qualitative survey responses regarding the potential impact and long-lasting effects of the project for beneficiaries were mostly about gains to MSMEs’ resilience. Out of 47 comments, 25 referred to impacts for MSMEs. They cover multiple ways in which the project supported MSME’s survival and resilience. The main service of the Surge project was capacity-building for entrepreneurs, such as in relation to registration, internal management practices, good guidelines towards circular economy, knowledge sharing about critical issues (e.g., market dynamics and export opportunities and barriers), empowerment of women (incl. women with disabilities) and youth to do business, access to support mechanisms, and contribution to community development (incl. on green technology), and preparedness to respond to crises through innovation and reaching out to consumers. Regarding MSMEs’ operation, comments refer to increased access to finance and support programs, economic improvement through income generation activities, methods to improve access to markets and supply chains through innovation, facilitation of business operation through e-commerce and digitalization, and contribution to increase the number of MSMEs. The 16 comments on the results of the project that were beneficial to governments covered policy advice on national MSME policies (e.g., e- commerce, law enforcement, sustainable development, gender-responsive support, MSME formalization,

The project contributed to formulate and implement enabling polices on green, resilient and inclusive

entrepreneurship for MSME promotion in post COVID-19 resurgence

0% 10% 20% 30% 40% 50% 60% 70% 80%

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

0% 10% 20% 30% 40% 50% 60%

contributed to expanding my business venture or to start a new business

supported my business increasing sales

contributed to the creation of new jobs

The project...

Do not know Disagree/Strongly disagree Somewhat disagree Somewhat agree Agree/Strongly agree

63

new support schemes for MSMEs), e-registration, stimulus to public-private partnerships, awareness of the leveraging power of ICTs for MSMEs, awareness of the role of rural areas for development, and grounded work through project’s partnerships with local institutions.

113. Another source of evidence for sustained results was the survey responses on the ways in which beneficiaries use the knowledge or skills acquired through the project. Three main categories of knowledge/skills use emerged out of 71 comments:

● Use of knowledge or skills to improve MSME policy (22 comments): project beneficiaries reported that they had been raising MSMEs’ issues in new projects to respond to the COVID-19 crisis (e.g., introduction of entrepreneurial training, business counselling and access to credit), improving policies for youth employment and community development, incorporating MSMEs’ challenges in accessing markets and finance into work in competition law, mainstreaming sustainability principles in MSMEs’ development initiatives, supervising partnerships between MSMEs and larger companies, onboarding MSMEs to the e-commerce platform, easily assessing women’s problems in farms, establishing priority policies for women-owned, female-intensive businesses and social enterprises, using analytical tools (E-view, SPSS, GIS) to identify policy trends and priorities for MSMEs, sharing best practices within the organization and with other partners (e.g., the critical role of cooperatives in formalization). An unexpected impact was on increased exchanges between policymakers and the UN through presentations of the work they have done, and another was on changing cultural relationships with the environment:

The ocean economy is not very well explored in my area. The ethnic groups have always avoided water out of cultural and spiritual reverence. My development programmes never included the ocean economy until after this project. I have started an awareness initiative that presents the ocean as a possible and lucrative source of livelihood. I believe the initiative is making a breakthrough because locals (though still very few) are beginning to lodge applications for fishing licenses to the authorities.

● Use of knowledge or skills to strengthen MSME resilience (24 comments): project beneficiaries

reported that they have been applying their new knowledge in supporting and mentoring MSMEs in topics such as financial literacy, sustainability and ecological concerns, product exportation, and diversification of business opportunities. These consulting services have been assisting family enterprises too. MSMEs reported that they have been applying the new knowledge in their business growth plans and accounting systems, in designing and upscaling projects within the circular economy and the energy sector, creating an association to buy larger volumes from suppliers, applying entrepreneurship competencies to avoid fraud, diversifying production with facial masks for COVID-19, improving production by reducing pollution, implementing biosecurity protocols, and using digital technologies to reach out to prospective clients, do business marketing, expand collaboration with partners to participate in tenders and expand the business activities. Two unexpected impacts were a beneficiary who started an NGO to focus on climate change, and another who installed wi-fi internet in his village using solar panels to ensure that they could continue working remotely.

● Use of knowledge to take training forward (25 comments): beneficiaries reported that they are taking training forward either by taking further training (e.g., on green technologies, computer training) or by training others (e.g., teaching at vocational courses, designing new courses for MSMEs about internationalization and digitalization, and sustainable development, developing new training material for national counterparts, business development services’ offers). They had also been using what they learned to explain to work colleagues how to operate more effectively and efficiently, to do female entrepreneurship advocacy to other women entrepreneurs, and to protect their families from COVID- 19.

114. Challenges for beneficiaries to use their new knowledge or skills refer, mostly, to lack of financial resources, follow-up mentoring, and a favourable business environment. Fifty-three survey respondents indicated their difficulties in making use of the knowledge or skills acquired through the Surge project. The main difficulties were around unfavourable business environment for MSMEs in the country or weak business ecosystems, lack of local resources (policies, technologies, access to remote regions), financial constraints

64

(including barriers to access financial resources by entrepreneurs and governments), turnover of government officials, low political interest and commitment from senior management, limited technical skills and resources, lack of country data for effective policy analysis, lack of education for sustainable development, lack of entrepreneurial mindset in the community and among small business owners, lack of skilled workers, lack of post-training follow-up and mentoring, how to transfer knowledge to complex country situations, challenges to coordination and synergies between relevant agencies, and internet costs.

115. Beneficiaries’ suggestions for ways in which the UN could support MSMEs in their countries covered continuing to invest in capacity-building activities, facilitating access to finance, supporting inter-institutional coordination inside the country’s government bodies, and increasing interventions at the local level. Survey respondents suggested numerous ways in which the UN could support MSMEs in their countries (72 comments). They can be grouped into the following main categories: continue developing capacities of all actors (i.e., governments, MSMEs, other national partners, such as chambers of commerce and business development services) through training, mentoring and webinars, strengthen or contribute to facilitating access to finance for the MSMEs (including seed money, grants, access to credit, etc.), support improving the coordination across ministries of MSMEs-related policies, and increase interventions at local level (i.e., supporting NGOs and MSMEs outside of the main cities, supporting the organization of cooperatives, launching communication campaigns for information dissemination), conducting more regional and country-specific studies (e.g., policy papers, sectoral approaches), and provide tools to support internationalization of MSMES (e.g., network program). There is great emphasis, both in terms of number of comments as well as in relevance for inclusive and sustainable development, on the inclusion of women, youth, persons with disabilities and rural entrepreneurs across these suggestions.

5.5 Gender, Human Rights, and Leave No One Behind

116. This section explores the extent to which gender equality, human rights and leaving no one behind perspectives were considered in the design and implementation of the project.

To what extent were perspectives on gender equality, protection of human rights and reaching underserved groups integrated into design and implementation of the project? What results can be identified from these actions?

117. The Surge Project´s design was guided by two key UN documents that provided clear direction for the integration of gender, human rights, and LNOB: The UN Secretary-General’s Shared Responsibility, Global Solidarity report and the UN framework for the immediate socio-economic response to COVID-19. The Global Solidarity report 142 provided overall guidance by recognizing that the most vulnerable were the hardest hit by the pandemic, stating the UN’s commitment to help people and societies, especially the most vulnerable, and emphasizing the need for full respect of human rights, ensuring no one is left behind. Aiding in implementation of the Global Solidarity’s guidance, the Framework143 outlined detailed responses to the pandemic with specific deliverables and activities related to gender dimensions, human rights and Leave No One Behind (LNOB). Particularly, the relevant responses including the assessments were expected to be gender- responsive and involve a human rights-based approach to data collection with disaggregated data such as age, sex, migratory status, health status, socio-economic status, place of residence and other factors. The analysis of the human rights and gender impacts would then inform the design of policies that address these risks considering gender aspects and disability-inclusive responses. The Framework also provided a set of indicators to monitor and assess the human rights implications of the COVID-19 crisis, including socio- economic impacts and LNOB aspects. In addition, the Guidelines for the Preparation of Project Document for the Development Account144 required the applicants to outline how the project would contribute to gender equality and the enhancement of human rights, with particular emphasis on “leaving no one behind”, taking into consideration how the specific needs of groups such as youth, persons with disabilities, older people, refugees, migrants, the poor, and others would be addressed.

142 Shared Responsibility, Global Solidarity: Responding to the socio-economic impacts of COVID-19. March 2020. 143 A UN Framework for the immediate socio-economic response to COVID-19. April 2020. 144 https://www.un.org/development/desa/da/wp-content/uploads/sites/52/2022/07/T15-Project-Document- Guidelines-vf.docx

65

118. In line with the guiding UN documents, the Surge Project aimed at supporting the MSMEs that were considered the most vulnerable to COVID-19 within the private sector, highlighted the gender, HRBA and LNOB perspectives and fairly covered the gender aspects. Youth and other vulnerable groups were also covered, though to a lesser extent.145 Given the larger number of vulnerable groups working in the informal MSMEs- particularly women and youth - the project was developed to contribute to inclusive growth during the economic resurgence after the pandemic146. As highlighted in the project document, most informal MSMEs are led by the working poor, women, youth and other marginalized and vulnerable groups who need to be integrated into an inclusive economic resurgence after COVID-19 and who are at most risk of falling into poverty and being left further behind. The initial project document included a brief section on the assessment of vulnerable groups such as the women traders involved in cross-border trade, and initiatives benefiting the vulnerable groups, especially women and youth. The second phase proposed a coherent approach towards MSMEs, with the purpose of reaching out to the most affected target groups, including women and informal workers. A specific section on mainstreaming gender equality and human rights aspects including social protection was developed to outline the project approach, and intended to ensure a gender perspective, LNOB aspects and HRBA would be integrated into the activities of different clusters across preparedness, response, and recovery stages. The project document147 further provided a brief assessment of the gender issues and made reference to youth and vulnerable groups under each cluster and stated that the project interventions would address issues in an inclusive manner leaving no one behind. The 3rd phase project document also referred to the project approach of reaching out to the most affected target groups, including women and informal workers148. Specific activities integrating gender and youth were also covered including capacity- building workshops for national government officials and informal MSME entrepreneurs, especially youth and women, an entrepreneurship training workshop to assist entrepreneurs from vulnerable backgrounds and to deliver support to MSMEs in the region, placing its efforts on supporting the poorest, marginalized and women-led micro and SMEs. The result frameworks included specific outputs mainly benefiting women entrepreneurs such as training initiatives for cross-border traders (almost all female traders) and outcome- level indicators covering gender-disaggregated data as well as COVID-19 impact assessments. However, the project document covering the initial phase only mentions persons with disabilities in relation to the project’s links to the SDG targets 8.5 and does not specifically outline disability-inclusive responses. Furthermore, some of the outcome indicators include gender-disaggregated data but do not propose effective data collection methods to capture other vulnerable groups and vulnerabilities or gender dynamics beyond the limited quantitative data.

119. In addition to the key guidelines provided by the UN Secretariat, it was unclear to what extent internal procedures and programming guidance for each UN partner on gender mainstreaming, gender equality or LNOB played a role in the integration of all aspects in the design and implementation of the Surge project. Although the overall project was designed with a strong alignment to the UN guiding documents on HRBA and gender, the integration of these cross-cutting components in the implementation within each UN partner’s activities was less consistent. As an informant from one of the implementing UN entities stated, “gender mainstreaming and reducing inequality are part of their [the staff’s] DNA in all they do.” On the other hand, another claimed that due to many partners involved and the urgency of the situation, internal clearance processes regarding gender aspects for DA projects were not necessarily followed for the Surge project. Also, it was implied by yet another informant that with additional resources (i.e. human, financial, and time) then gender responsiveness, HRBA, and LNOB could have been better integrated into the implementation of the project components.

120. There was limited evidence available of systematic sharing of experiences, capacity, or lessons learned related to the integration of the cross-cutting themes, which might have enhanced leveraging synergies among the UN partner organizations or with other relevant agencies, such as UN Women. One example of a good practice was in the Republic of Moldova where UNECE worked closely with the UN Country team and UN Women contributed to the development of a gender-sensitive roadmap for the government based on a study on MSMEs conducted by the Surge project. One of the survey respondents further

145 UN. COVID-19 Response. July 2020. Global Initiative towards post-Covid-19 MSME sector: MSME Surge Project. Phase II Project Proposal. 146 UNCTAD. 2020. Concept note: Global Initiative towards post-Covid-19 MSME sector Phase I. 147 UN. COVID-19 Response. July 2020. Global Initiative towards post-Covid-19 MSME sector: MSME Surge Project. Phase II Project Proposal. 148 UN. COVID-19 Response. February 2021. Global Initiative towards post-Covid-19 MSME sector: MSME Surge Project. Phase III Project Proposal.

66

emphasized that the project was largely complementary to the work of a few agencies - such as UNDP, UNCTAD and UN Women - and helpful in the process of the CCA analysis and gender assessment. UN Women was also involved in supporting a regional conference on women in the Latin American region. Collaboration with Empretec enabled the development of a training programme for people with low literacy and the Farming-as-a-Business training, facilitating participation and empowerment of the vulnerable groups in the sector. Reflecting on the available documentation and evidence, the collaboration and sharing of experiences among project partners or other UN organizations regarding the integration of gender, HRBA and LNOB perspectives were limited to some cases as outlined above and not systematic across the project clusters.

121. The level of integration of these cross-cutting themes by the main counterparts depended on the counterpart’s understanding, willingness, and priorities. The UN partner organizations worked with the governments, including corresponding ministries and officials, as their main counterparts. One informant stated that as a DA initiative, their main counterparts were governments and they looked at how governments shifted their policies to support women in SMEs. Under cluster 5, one of the governments was not interested in women's studies, mentioning that they wanted everyone to benefit without discriminating against men or women-led enterprises. It was also challenging to receive inputs in places where there was no institutional structure dealing with gender issues or women’s empowerment such as in Cluster 5 or to ensure women’s participation, as it was reported that government counterparts were responsible for selecting participants for the Latin American and the Asia and the Pacific regions. The Bangladesh Start-up Ecosystem Assessment Report integrated gender aspects but the women participation at the follow-up panel was low. In Brazil, as reported by an informant, there was a presence of women in the webinars but no gender parity149. Even if there was a supportive government in Moldova where a roadmap for MSMEs covering gender aspects was developed, new priorities, the crisis in the region and limited funding were cited as reasons why there was very limited follow-up to the government roadmap or recommended actions in the project study supported by the Surge project.

122. In Gambia, however, the government considered youth and women as the main target beneficiaries, given that they made up the largest portion of the informal MSMEs sector in the country and looked at how to revitalize this sector and address their needs. As another example, in Malaysia, as a local counterpart, the National Association of Women Entrepreneurs of Malaysia (NAWEM) helped support women entrepreneurships and ensure women participation through engaging in the webinars. Furthermore, the Cross-border Trade Associations, together with the governments, were involved in selecting the participants, who were almost all women as the activities were targeting women as main stakeholders, for the training programs organized as part of the UNCTAD component on Women and Cross-border Trade, including in Malawi and Zambia. One informant suggested that a key lesson learned for the success of the overall cross- border trade and gender initiative was to collaborate closely with the government authorities and ensure their buy-in and support for the activities.

123. Several needs and impact assessments integrated gender and human rights impact of the pandemic among MSMEs to varying degrees. Under different clusters, several assessments of the impact of COVID-19 on MSMEs particularly focusing on gender aspects were conducted to inform design of project interventions including policy recommendations aiming at leaving no one behind. UN DESA conducted a study on the impact of COVID-19 among MSMEs in Kenya and their resilience mechanisms. The assessment included youth and women organizations, focused on the impact of the pandemic on women and youth-led entrepreneurs and provided specific recommendations for vulnerable groups like the elderly, widowed and orphans in Kenya. UN ESCAP Bangladesh Startup Ecosystem Assessment Report150 included a detailed gender analysis and highlighted the importance of integration of gender and inclusivity angles in the funding opportunities to support the ecosystem by bringing in women, people with disabilities, and people from underrepresented and marginalized groups. UN ECE rapid impact assessments on MSMEs were undertaken in the region with a view of informing gender-responsive trade policies. The assessment reports covered gender gaps, gender- disaggregated data, and strategic priorities to achieve women equality including gender-responsive trade policies. 151 UN ECA supported one region and 11 countries to assess the impacts of the recent crises on the MSMEs of its member states in Southern Africa. Almost all the reports cover gender and/or youth aspects

149 The participants list of the region does not have gender disaggregated data to confirm the informant´s statement. 150 Bangladesh startup ecosystem assessment report | ESCAP (unescap.org) 151 UNECE. The impact of COVID-19 on the trade and business development prospects of female-owned enterprises in the Republic in Armenia. 2021; and The impact of COVID-19 on the trade and business development prospects of female-owned enterprises in the Republic in Armenia. Available at: https://unece.org/trade/studies-regulatory-and- procedural-barriers-trade

67

while the study conducted in Eswatini only indicated that the gender details in terms of ownership were not provided by the state. Furthermore, ECLAC reviewed policies to mitigate the impact of the COVID-19 pandemic on SMEs in nine Latin American countries152 and identified government measures with special emphasis on employment opportunities for women, people with disabilities and youth. The global report of the UNCTAD on COVID-19 Pandemic Impact on Micro, Small and Medium Sized Enterprises: Market Access Challenges and Competition Policy identified gender inequalities, provided disaggregated data for gender, age, minorities, persons with disabilities, and recommendations for entrepreneurs and MSMEs from vulnerable backgrounds particularly affected by the digital divide. The national studies on analysis of the impact of COVID-19 on MSMEs in South Africa and Thailand covered gender issues and gender aspects and proposed recommendations for women, youth and vulnerable groups. The national study on competition and market access policies in the resurgence of MSMEs in post-pandemic in Brazil, however, has no reference to gender, human rights or LNOB aspects.

124. The majority of assessments were gender responsive and primarily focused on gender aspects and on the impact of the pandemic on women-led MSMEs. While several assessments included youth aspects, only a few studies and data analyses covered people with disabilities. When asked, two informants expressed an awareness that other vulnerable and marginalized groups were more rarely covered, though they did not explain why. Despite this limitation, the studies were well received and helped identify the needs of those vulnerable groups. When the survey respondents were asked if the project activities and the content reflected the perspectives of women, youth, people with disabilities or other vulnerable groups, the majority (68%) responded positively. The work dedicated to profiling women-led MSMEs was found insightful to develop legal amendments supportive of women employability, according to one survey respondent. Another respondent mentioned that the research on women’s entrepreneurship was considered helpful for policymakers and ministerial staff in Member States to improve their understanding of how support given to women in business pays off.

125. The degree of integration of gender, human rights and LNOB aspects and implementation of assessment recommendations varied across clusters. In a number of cases, documentation was lacking about how those assessments or policy documents were followed up and to what extent the issues pertaining to vulnerable groups were addressed. Even if the assessments were conducted to identify needs and actions were proposed to address those needs of the vulnerable, there were cases where the evidence showed implementation of the actions was lacking or limited. The Project readiness report on the development of a digital platform on technology and innovation by SMEs in Southern Africa required that users and partners consider women, youth and environmental issues. However, the output report of the digital platform did not cover engagement with women, persons with disabilities or other vulnerable groups or aspects. While the Bangladesh Startup Ecosystem Assessment Report153 included a detailed gender analysis, one of the informants stated that “there was a section on gender, that´s all.” There was no systematic follow-up on how the project-funded studies were utilized. Another informant stated that gender mainstreaming is often on paper and not in reality.

126. On the other hand, in Moldova, the recommendations based on the gender-responsive assessment were translated into a roadmap, in collaboration with the government and UNCT. The government stakeholders considered the study as a big input. However, as one informant described, only some of the recommendations were able to be followed up, such as cross-border transit physical capacity and e- commerce funded by USAID, due to the crisis in the region and limited funding opportunities, among other challenges. In Kenya, the rapid impact assessment findings on women and youth-led entrepreneurs informed the planning of another initiative integrating gender and youth aspects with funding from a project. The project team worked closely with the government and linked their funding streams to increase the overall impact. As informed, none of the proposed activities were stand-alone, but rather aligned with the results chain – cross- cutting vertical and horizontal. Entrepreneurship policy review informed the new MSMEs strategy in Uganda. For the first time, with the support from the Surge project and building on the existing partnership with UNCTAD, Uganda included migrants and refugees in the high-level strategic plan, in addition to women and youth as vulnerable groups, according to an informant. The strategy serves as a framework to mobilize resources to realize different pieces. Another informant described that recently the government launched a strategy to help refugee communities.

152 Argentina, Brazil, Chile, Colombia, Costa Rica, Ecuador, Mexico, Panama, and Uruguay 153 Bangladesh startup ecosystem assessment report | ESCAP (unescap.org)

68

127. Building on the “Informal Cross-border Trade for the Empowerment of Women, Economic Development, and Regional Integration in Southern and Eastern Africa” project of UNCTAD’s Trade, Gender and Development Programme, the capacity-building activities were designed based on the existing gender responsive programme which was then tailored to address emerging needs of women traders during the pandemic in Botswana, Kenya, Malawi, the United Republic of Tanzania, and Zambia. Given the urgency and time limitation, an informant said this component was adapted and implemented very quickly by including COVID-19-related considerations. As highlighted by another informant, it was relatively easy because of the existing relationship with the stakeholders. The training content was revised to include new trade regulations and address needs of different vulnerable groups to enhance knowledge of their rights and obligations, regional trade rules, and on the formalization and registration of business. In partnership with Empretec, training contents were tailored both for participants with low literacy and high literacy levels, enabling engagement with the most vulnerable communities. Gender considerations specific to women traders including harassment were mainstreamed into the activities. Beyond the training activities, the initiative brought together the border officials and authorities dealing with immigration and customs to raise the issue of harassment against women traders. In addition to raising the gender issues, as highlighted above (para 96), the project could further enhance its support to government capacities in cross-border trade by involving government officials, including border officials, in the training courses, as trainees, or having a dedicated training session for them. The majority of the participants who responded to the workshop surveys found the workshops useful and relevant for their businesses. The policymakers and other stakeholders who attended the regional policy dialogue on women and cross-border trade considered the workshops successful at providing a forum to discuss the challenges faced by women informal and small-scale cross-border traders, and formulate practical solutions to improve their situation and enhance the contribution of cross-border trade to economic development and regional cooperation (Box 2).

Box 2: UNCTAD Cross-border Trade and Gender Initiative.

128. Another project initiative primarily focusing on gender aspects was the ESCWA´s Women Empowerment for Technology and Entrepreneurship (AWETE)154 programme which was launched through the DEPAR platform to address the national challenges hindering women empowerment in technology and

154 https://www.unescwa.org/news/boosting-women%E2%80%99s-empowerment-technology-and-entrepreneurship https://depar.unescwa.org/regional/awete

This initiative is a good example of integrating gender responsiveness in the Surge project interventions in extremely vulnerable communities facing additional challenges due to the impacts of the pandemic. Building on the pre-existing programming, the Trade and Gender initiative was adapted quickly to respond to urgent and emerging needs of the cross-border traders, primarily women.

The cross-border trade and gender component of the Surge project replicated the training activities for informal and small-scale cross-border traders of the previous UNCTAD initiative “Informal Cross-border Trade for the Empowerment of Women, Economic Development, and Regional Integration in Southern and Eastern Africa¨ which was implemented from 2016 to 2019. The training workshops were based on the tailored Empretec programme by adapting an existing methodology to meet emerging needs of women traders during the pandemic. The expected results of this initiative included increased awareness of trade rules and procedures, improved knowledge of their rights and obligations, enhanced use of official border posts and trade through formal routes, ability to adapt the businesses and developed strategies, and awareness of COVID-19 measures. Under this initiative:

✓ Almost 300 cross-border traders participated in the workshops, almost all were women.

✓ 9 in-person workshops (6 days each) with two components organized: training on cross-border trade rules and development of entrepreneurial skills.

✓ Botswana, Kenya, Malawi, the United Republic of Tanzania, and Zambia covered.

✓ Project partners included relevant ministries, trade authorities and Cross-border Trade Associations of the respective countries.

✓ Over 90% of the participants found the workshops useful and relevant.

✓ 95% of the participants of the regional policy dialogue considered the workshops successful.

✓ Five traders´ guides ¨Women in informal cross-border trade: A small-scale trader's guide to trade rules and procedures¨ tailored for Botswana, Kenya, Malawi, Zambia and Tanzania.

69

entrepreneurship across the Arab region. AWETE provides a community space for female entrepreneurs, innovators, and professionals to share knowledge and build new partnerships. Under this initiative, the project developed women empowerment ecosystem maps for 22 Arab counties155 and organized a series of five roundtable discussions in the region, bringing key experts and stakeholders advocating for women´s rights.

129. The majority of the survey respondents had the perception that the project activities were accessible for women, youth, people with disabilities, or other vulnerable groups, although the document review identified limited data in project reporting and other relevant sources referring both to cases with varying degree of gender parity and others with no data on gender or other aspects. The ability to assess comprehensively the participation of vulnerable groups is limited to available documentation that mostly covers gender and no other vulnerabilities. In some cases, the data indicated that the events successfully facilitated the engagement of women, ensuring gender parity. The online Empretec TOTs organized in French, English and Spanish for low-literate people reached out to around 100 people, 49% women. Whereas the workshops/courses/webinars on circular economy reached out to 600 participants, only one-third of them women. In other cases, the information on gender or other aspects is not available to make a comprehensive assessment covering all project interventions. However, the majority of survey respondents (70%) believed that the project activities were accessible for women, youth, people with disabilities, or vulnerable groups (Figure 20). The respondents also mentioned that the project included or supported women, youth, people with disabilities or other vulnerable groups through empowering vulnerable groups especially women and supporting their access to funds.

Figure 20: Perceived accessibility of project activities for women, youth, people with disabilities or other vulnerable groups (n=126 respondents).

Source: Independent evaluation survey, 2023.

130. Adapting to COVID-19 restrictions enabled the engagement of the vulnerable groups to some degree, particularly women entrepreneurs in the project activities while, in some cases, their participation was hindered due to the lack of access to technology, selection process of beneficiaries, location of events, or the pandemic impacts and restrictions that made it difficult to bring people together. Going virtual equalized those who were able to participate in project activities and built bridges across countries and regions. However, participation was limited to only those with physical and financial access to the necessary technology, and ensuring participation was challenging as there were too many online initiatives from a range of development partners. Given the pandemic restrictions, most of the interventions particularly in the early stages of the pandemic including workshops and training programs were organized online, and online portals enabled free access to everyone with access. As reported by one of the informants, NGOs could follow some of Empretec´s work online, particularly vulnerable groups and women on the ground. Empretec´s TOT workshops were

155 https://depar.unescwa.org/regional/awete/ecosystemmaps

33%

37%

21%

3% 2% 0%

4%

Project activities were accessible for women, youth, people with disabilities, or other vulnerable groups

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

70

revised, and short videos were developed to better serve the vulnerable groups including rural entrepreneurs, farmers and low-literacy entrepreneurs156. One informant believed that having everything online helped people from diverse populations to link across groups and locations in the country. The final report of the project also highlighted that the skills development was facilitated thanks to the online workshops increasing delivery efficiency and accessibility with specific attention to vulnerable groups and people with low literacy levels157.  In addition, the online regional policy dialogues on the role of competition policy in supporting MSME’s economic recovery in the post-COVID-19 crisis were new, in the sense that they were online and open to all stakeholders from governments to MSMEs covering several countries at once. Although the online platforms provided unique opportunities and, in some cases, the only way to reach out to the vulnerable communities, they hindered the engagement of those marginalized groups with no financial and technological access.

131. Additionally, cases were also found of implementation modalities limiting participation of some vulnerable groups. For example, selections of cross-border trade workshop participants, almost all women traders, was the responsibility of the governments in collaboration with the Cross-border Trade Associations. In the Latin American region, it was reported that there were challenges to ensuring the participation of women or other vulnerable groups since it was the governments that conducted the selection of participants. In addition to the selection processes, it was reported that criteria in a few training programmes limited the participation of the most vulnerable. . When translation was provided in another aspect of the Surge project, it was indicated that the translation was difficult to understand, which limited the effectiveness of reaching out to the most vulnerable. In most cases, there was no reporting on participants’ self-identifying with a range of vulnerable groups, such as people with disabilities, making it difficult to assess the extent of engagement in the Surge project by various vulnerable groups. It was indicated by an informant that they had no way to measure how many and with which vulnerable group the participants identified. The locations of some of the events, such as holding them only in the capital city, were also considered as inhibiting participation from diverse groups and regions.

132. A few impact assessments point towards positive outcomes particularly for women. Overall, 64% of the survey respondents felt that the project contributed to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups (Figure 21). The survey respondents revealed that the relevant areas on which the project has contributed to the resurgence of MSMEs, policy or economic improvements, or advancing sustainable development included improved inclusion of vulnerable groups with a special reference to women entrepreneurs, funding opportunities for women, addressing the needs and supporting women-led MSMEs. Capitalizing on the knowledge or skills acquired through the project, some survey respondents reported that they facilitated priority policies for women-owned and women-responsive businesses, development of female entrepreneurships, and access to credit for women entrepreneurs and women capacity-building.

Figure 21: Perceived contribution of the project to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups (n=105 respondents).

156 Under the Surge project, Empretec offered in-person, hybrid as well as online training activities to respond to the different needs and COVID-19 restrictions of various contexts. 157 UNCTAD. September 2022. Final Report: Global Initiative towards post-Covid-19 resurgence of the MSME sector.

71

Source: Independent evaluation survey, 2023.

133. The UNCTAD component on Women and Cross-border Trade delivered solid results in terms of enhancing cross-border traders’ capacity, mostly women. The impact assessment on the cross-border trade in the pre- and post-pandemic environment covering 2019-2021158 indicated that the training workshops that were attended by almost all women helped women entrepreneurs become more effective cross-border traders. The impact assessment further outlines how the initiative helped enhance the knowledge and abilities of the cross-border traders to benefit from greater business resilience (Please see the effectiveness section of this report for assessment findings). The initiative also contributed to the formalization of the businesses of the cross-border traders. As reported by an informant, female traders were informal but now most of the training participants have registered their businesses.

134. The impact assessment on the Empretec workshops (ETWs) which assessed the economic impact of the ETWs on the participant entrepreneurs in selected project countries indicated positive results for women entrepreneurs, only for those areas where gender disaggregated data was provided159. Based on the findings, the number of women in business after the ETW increased by 15% in Benin, 7% in Ghana and 9% in Nigeria. 160 The F/M TEA ratio (Female and male, Total Early Stage) also demonstrated positive outcomes in Benin (15% higher161), Cameroon (13% higher), Gambia (57% higher) and Zimbabwe (20% higher).162

The project was also effective in facilitating women and youth-led MSME registration and formalization. UNCTAD helped facilitate e-registration and formalization of MSMEs in El Salvador, Benin, Cameroon and Mali through an e-registration portal. In Benin, the portal increased business registration by 91%, with 84% increase in women-led MSMEs and 181% increase in youth-led MSMEs. A similar trend was observed in Mali where business registration increased by 40% including 49% increase in women-led MSMEs, and 110% in youth-led MSMEs.

135. In contrast to survey respondents’ perceptions, the available data on inclusion of vulnerable groups and vulnerabilities is limited and hinders the evaluation’s ability to assess the degree to which gender, HR and LNOB aspects were integrated into the Surge project. Of the data that is available, it is mostly for the gender-

158 UNCTAD (2022). Cross-border Trade in the Pre- and Post-Pandemic Environment Evidence from Malawi, the United Republic of Tanzania and Zambia. Geneva. 159 The assessment provided limited gender disaggregated data and did not cover any other cross-cutting dimensions. 160 UNCTAD. MSME Surge Project. Empretec: Impact Assessment Survey Report. 2023. 161 In Benin, for instance, the ratio 0,8/1 referring to 8 MSME businesses opened by women to every 10 MSME businesses started by men – at Empretec the ratio is 0,92:1 (15% larger). 162 The F/M TEA (Total Early Stage) (Female / Male TEA ratio, applying only to early-stage businesses) is an indicator of how Entrepreneurship may be used as a tool for equity and women empowerment, especially in traditional male dominated societies as usually verifiable in Africa.

32%

32%

28%

2%

3% 0%

3%

The Surge project contributed to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

72

disaggregated information for the project beneficiaries with no or limited information on age, persons with disabilities or other characteristics. As reported by one informant, the initiative focused on female youth but there was no record on how many female youth entrepreneurs were reached. In some cases, the gender- disaggregated data was only available for those who responded to the event´s survey and not for all the participants, making it difficult to assess the gender parity163. The data collection tools were mostly not designed to collect information necessary to assess the cross-cutting dimensions. For example, one of the workshop evaluation forms used under cluster 1 did not have any questions to identify issues related to gender, age, disabilities, and other vulnerabilities of specific groups. This is also observed across clusters covering various project initiatives.

136. Furthermore, the project results framework mainly captured quantitative gender-disaggregated data, but did not capture the degree of the project´s contributions to different vulnerable groups and vulnerabilities. There was also limited follow-up to assess the impact of the training or other initiatives from gender and human rights perspectives. As one informant observed, follow-up monitoring should have been included to assess the impact of the training programs and nobody was doing it.

137. One of the exceptions was the Impact Assessment on the Empretec Workshops (ETWs) covering 6 African countries between 2020 and 2022, namely Benin, Cameroon, Ghana, Nigeria, The Gambia and Zimbabwe. The assessment on ETWs did not capture all the cross-cutting aspects comprehensively but provided gender-disaggregated data for the number of women in business after ETWs. Another assessment was conducted for the capacity-building activities organized by the UNCTAD Trade and Women initiative in Malawi, the United Republic of Tanzania and Zambia aimed at small-scale and informal cross-border traders, mainly women. The impact assessment covered the capacity-building activities carried out from 2019-2021 at selected border posts, including previous analytical work carried out by UNCTAD´s Trade, Gender and Development Programme since 2016 under a 10th tranche DA project164. The compilation of success stories of women entrepreneurs who received Empretec training - such as the story of how four women in Malaysia built success during COVID-19165- also helped provide anecdotal evidence on the project’s contributions to women empowerment and inclusive growth.

163 The number of participants of the UNCTAD Webinar Series on SDG Reporting by companies, including MSME—The adaption of “Guidance on core indicators for entity reporting on contribution towards implementation of the Sustainable Development Goals (GCI)” in China was 150 while the gender-disaggregated data is only available for 26 survey respondents. 164 The Development Account project “Informal Cross-border Trade for the Empowerment of Women, Economic Development, and Regional Integration in Southern and Eastern Africa”, implemented during 2016-2019. 165 https://unctad.org/news/how-four-women-malaysia-built-success-during-covid-19

73

6. Conclusions

138. Based on an analysis of the findings, the evaluation formulates the following conclusions.

Conclusions

Relevance

The project responded to the needs of Governments and MSMEs. Interventions contributed to and were informed by needs and impact assessments. Recipients of project interventions were often involved in or contributed to the design and delivery of project activities and outputs. On various occasions, project outputs were tailored to the needs of target users and beneficiaries, being countries or vulnerable groups. The relevance of the interventions was somewhat mitigated by the mandates and capacities of the implementing UN entities. The latter are equipped for supporting medium- and long- term policy changes rather than immediate crisis responses. Other challenges included the restrictive Covid-19 measures and the short time frame for implementation of the project. Nonetheless, on the whole, the implementing UN entities exercised adaptive management to ensure high relevance of their interventions. The phased approach, in particular, provided the opportunity to introduce new activities not foreseen at an earlier stage.

Coherence

The project was anchored in the mandates and comparative advantages of the implementing UN entities. Selected interventions followed previous work and specific requests from member States and were often coordinated with or complementary to existing activities. At conception, the target of the project was to address specific constraints faced by MSMEs. It was designed around the Entrepreneurship Policy Framework to show the complementarities across interventions that each implementing UN entity would deliver in response to regional priorities and capacities. Some collaborations between implementing UN entities were pursued and complementarities established, but on a limited level. A few synergies in the form of joint outputs were integrated in the 3rd phase of the project. By design, technical task forces created through the project were expected to bridge the implementing UN entities. However, this proved difficult to launch and sustain, owing to several constraints, including a highly ambitious objective given the global crisis and competing priorities within each agency. Nevertheless, the coordination and complementarities established by the project among the implementing entities contributed to expanded dissemination and outreach of outputs, avoided overlaps between them, and allowed significant knowledge exchanges aligned with and supportive of a “One UN” system. On the other hand, collaboration of the implementing UN entities with other UN organisations, including UNCTs, was limited. Despite this shortcoming, at national level, target recipients of project outputs found the interventions complementary to those of other UN agencies.

Efficiency

Project coordination was complex and demanding, involving seven UN entities and the target delivery of around 100 outputs, of which some were composed of many activities. Nevertheless, the coordination of the project was found to be efficient overall given the circumstances and resources available. The coordination of the design phase of the response was actively supported by the DA-PMT. Coordination of project implementation was led by UNCTAD in collaboration with a Steering Committee that met on a regular basis, most often bi-monthly. UNCTAD’s Budget and Project Finance Section (BPFS) produced the project’s financial monitoring table every month, which included the expenditure data of UNCTAD as well as the other implementing entities. A monitoring dashboard was created by UNCTAD to facilitate the tracking of UNCTAD’s project delivery. Data from some of the other implementing UN entities was added, when provided, at two reporting points during the lifetime of the project.

The project would have benefited from the allocation of more resources towards the coordination and monitoring of overall implementation. Across the implementing UN entities, the project was considered complex and hard to follow outside of the interventions under their direct control. Some staff perceived that there were too many participants in the coordination meetings, that the project lacked a Theory of Change, and that it was primarily a compilation of activities rather than a cohesive and mutually reinforcing bundle of interventions supporting in depth any given country. Some staff in the UN Regional Commissions questioned the efficiency cost of a global or inter-regional response versus regional responses. The project was implemented in three phases, which were supportive of adaptive management and perceived by staff as the most rational approach considering the circumstances. However, it was also pointed out that clearer visibility

74

from the onset on the funding available for future phases would have facilitated planning and the search for synergies.

Effectiveness

The Development Account programme, as a funding modality, was quick to respond and adapt to the COVID- 19 crisis. The prompt availability of resources and rapid orientation toward a global response contributed to the rapid launch of a wide range of interventions. However, questions remain as to its adequacy for addressing the immediate needs of a crisis in comparison with other UN agencies and mechanisms with a mandate for humanitarian response. The governance of this project, with DA-PMT’s oversight, the management structure with UNCTAD in the lead coordinating role, and each implementing entity leading the operational implementation at the regional level, ensured the global and regional scope of project delivery. At the operational level, implementing entities relied more on partnerships with local and regional institutions rather than coordination within the larger project management structure. The project governance and management mechanisms evolved in tandem with the COVID-19 crisis and the project’s emerging needs. The result was a high delivery rate but with limited inter-agency collaboration in the process. Yet, despite limited collaboration, this independent evaluation identified that the project was effective in producing identifiable results at the outcome level.

Overall, the project delivered 85% of the planned outputs. Phase 3, particularly, delivered the highest number of outputs but had the lowest outcome effectiveness rate, mostly because of budget cuts and some outputs still in progress at the time of this evaluation. There is evidence of the effective improvement of national capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship and MSME promotion (outcome 1.A) [such as the adoption of a revised entrepreneurship strategy by South Africa, Uganda and Seychelles]; improved resilience and competitiveness of MSMEs (outcome 1.B) [for example with 64.5% of participants opening a new business after attending Empretec-based training]; facilitated MSME registration and formalization through e-platforms (outcome 2) in El Salvador, Benin, Cameroon and Mali; improved access to finance, including upskilling in financial literacy (outcome 3) [for example with 97% of the MSMEs in Latin America that attended trainings reporting improved financial literacy in accounting and reporting and also improved capacity to manage financial resources]; increased MSME access to innovation and technology (outcome 4) [including through capacity development on green technologies for SMEs in Southern Africa]; and increased access to local, regional and international markets through digitalization and non-tariff measures (outcome 5) [for instance with case studies and on competition in Thailand, South Africa and Brazil, followed by webinars and the creation of an online course on SMEs and competition policy, primarily for government officials].

In relation to the project indicators, the assessment of their effectiveness was based on limited information, proxies, and expert judgement since they often lacked SMART criteria. It was possible to infer that 85% of them showed some level of progress, either through objective measures (e.g., sales increase) or proxies (e.g., post-training satisfaction assessments and survey responses). The high effectiveness results can be partly attributed to the conceptual framework provided by the EPF, as well as the cluster-based approach with each cluster addressing specific regional constraints and responding to demand from member States. In addition to clustering about 100 outputs from seven implementing entities into 5+1 outcomes, the EPF provided a coherent thread to relate outputs that cut across outcomes. Further analysis would be needed, however, to clearly identify which of those outputs are the most suitable or adaptable for a crisis response.

The project improved the capacity of policymakers in designing and implementing policies supportive of MSMEs, especially in terms of contributing to a country’s government responses, country-specific studies, technical assistance, training courses, and the development of digital tools and regional interventions. This improved capacity is reflected in beneficiaries’ reports of how they have been considering the needs of MSMEs, including those led by women and youth, in their daily work. These results could become more transformative and sustainable with more institutional support to networks of policymakers and communities of practice for mutual and regional learning on supportive policies for MSMEs, as well as by mainstreaming gender and Leaving No One Behind (LNOB) approaches in government officials' capacity-building.

Sustainability

The project developed approaches, tools and capacities that are being transferred at multiple levels. At the policy level, the addition of more functionalities to e-government tools, expanding training courses to more countries, and the establishment of agreements to implement the project recommendations are all strong

75

evidence of the sustainability of the project's achievements. At the behavioural level, beneficiaries are applying new knowledge and skills to their daily work, be it by including MSMEs' issues in policy making or by improving MSMEs' management, performance, outputs and, by extension, resilience. Challenges to this transfer of knowledge relate to the lack of financial resources, need for follow-up mentoring, and lack of a favourable business environment.

Gender, human rights, and disability

The overall project design was well aligned with the two key UN documents that provide clear direction for the integration of a human rights-based approach, which include addressing the aspect of gender equality and Leaving No One Behind. Although these aspects were well-articulated in the project documents, strong follow-through and documentation of their implementation was limited to a few project components. For those components that did include these aspects, gender was more commonly integrated and youth to a lesser degree. There was very little evidence of the outreach, participation, or impact of project activities for people with disabilities or other vulnerable groups. The UNCTAD component on Women and Cross-Border Trade targeting five countries in Africa was a good practice in how to design and implement this type of intervention with a strong reflection of the needs of some of the most vulnerable women across border areas.

76

7. Recommendations 132. Based on the evaluation findings and conclusions, the following recommendations could be considered by the implementing UN entities and the DA-PMT.

139. Recommendation 1: (i) UNCTAD should further leverage the experience gained through the project to map out how components of the Entrepreneurship Policy Framework relate to and can be best positioned to support MSMEs in their recovery from different types of crises and (ii) DESA and the Regional Commissions should add their analysis of how their work can contribute towards the objective. UNCTAD, DESA and the Regional Commissions could build on the project to map their areas of intervention in support of the MSME sector, as well as capacities and knowledge on the implementation of the EPF components, including in a crisis context, and opportunities for broadening the uptake of EPF components at the regional level based on national needs. UNCTAD, DESA and the Regional Commissions could further consider identifying areas of joint interventions that would trigger complementarities and synergies between the agencies. This could involve collaborating on the development of capacities of all national and sub-national actors, i.e. Governments, MSMEs, other partners (e.g. Chamber of Commerce, Business Incubators, etc.) in line with United Nations Sustainable Development Cooperation Frameworks (SDCF) in respective countries; strengthening or contributing to facilitate access to finance for the MSMEs (including seed money, grants, access to credit, etc.); improving the coordination of MSMEs related policies across ministries; increasing interventions at the local level, such as by supporting NGOs or MSMEs outside of the main cities. The application of a human rights-based approach, gender responsiveness and inclusion of other vulnerable groups (LNOB) should be ensured.

140. Recommendation 2: UNCTAD should continue building on the momentum generated by the project to continue fostering knowledge exchanges and promoting the Entrepreneurship Policy Framework. UNCTAD, DESA and the Regional Commissions should identify means to more meaningfully continue to share good practices and lessons learned on the demand-driven support they provide to the MSME sector, including on areas such as green/circular economy; innovation policies and ecosystems; MSME formalization and strengthening MSME capacities for the empowerment and leadership of women, youth and groups in vulnerable situations. UNCTAD and the Regional Commissions could also propose organizing regional events and/or a global conference to promote entrepreneurship policy and further advance the goals and impact of the Surge project. Furthermore, learnings from the experiences with the Surge about external partnerships should encourage UNCTAD to promote the EPF and entrepreneurship development to other UN agencies also engaged in this area (e.g. ILO, FAO, UN Women, etc.), to development banks, or to related initiatives such as the recent Global Accelerator on Jobs and Social Protection. UNCTAD could also consider joining and supporting events that promote the achievement of SDG 8.3 as an avenue to further promote the EPF.

141. Recommendation 3: The DA-PMT should develop a clear framework for assessing the costs and benefits of implementing a global or inter-regional project versus regional projects. As a global crisis can affect regions and countries differently, global or joint projects should be developed only when there are clear benefits of joint implementation. Thus, a global or inter-regional vs. regional response would not be a priori decision, but a result of a clear assessment. A specific guideline or framework should be developed for this. Some of the assessment criteria could include the need or demand from member States for an integrated response; the range of common versus entity-specific activities and added value of complementary interventions (i.e. in terms of geographical coverage, reach of the target population, capacity, and/or coverage of multiple reinforcing technical areas, or networks and partnerships); capability to execute joint interventions (e.g. in terms of time, resources, logistics, and flexibility to pivot interventions without bureaucratic procedures); coordination costs (which increase with the number of participating UN entities); project inception modalities and governance and knowledge management requirements to facilitate collaboration and knowledge sharing; scaling and sustainability plans; expected results of spreading resources versus concentrating on fewer countries; and so forth. The time taken to conduct such assessments will increase project coherence and effectiveness and facilitate the identification of the financial and human resources needed for project implementation. The network of DA Focal Points is a key existing asset for this assessment.

77

142. Recommendation 4: Implementing UN entities should ensure that they have a comprehensive Results Framework for the entire project as well as an adequate monitoring plan, with indicators that are designed to support the ongoing monitoring. The results framework should have one objective and ideally have one outcome per cluster/workstream. The objective should state the intended goal of the project, describe the overall achievement targeted by the project, involving a process of change aimed at meeting the needs of identified beneficiaries, and reflect the overall funding available to the project. Each objective should include reference to the project’s beneficiaries and its substantive focus. The objective should not attempt to explain the ways in which the project intends to achieve the objective (i.e. it should not include the word ‘through’ or describe the internal work of the UN using verbs such as ‘support’, ‘facilitate’ or ‘contribute’). The outcomes (OCs) should describe the changes that are expected to occur as a result of the completion of outputs. The OCs should be achievable within the project’s timeframe and budget, and should be specific enough to be measured by the associated indicators of achievement. The indicators of achievement (IAs) should provide measures for monitoring progress towards achieving the OCs and reporting on them after completion of the project. Every indicator needs to provide clearly defined baselines, units of measurement and targets, detailing the quantity, quality and timing of expected results. The monitoring, evaluation, accountability, and learning (MEAL) system should also be designed to capture HRBA, gender and LNOB aspects. In phased interventions or during project execution, any changes in the logframe if/when pivoting activities should be clearly explained to the wider team.

143. Recommendation 5: Implementing UN entities should ensure that sufficient resources are allocated to project coordination, technical collaboration, and partnership building. The absorption capacity of implementing entities can be challenged by crisis response projects which add to the planned programme of work. This is further compounded by projects that come with an extensive UN partnership and a global scope. Sufficient resources should be dedicated to global coordination and to building global partnerships with strategic stakeholders (e.g., UN organisations engaged in supporting the MSME sector; development banks). Capacities should also be directed to supporting technical collaboration and the staff implementing interventions, including towards synergy or liaison with the UNCTs. When designing the project, implementing UN entities should consider featuring coordination and partnership-building in the Theory of Change or logframe of the project. Tools to support continuous connections and knowledge exchange, and to ensure institutional memory should be part of the response package, such as a project website, SharePoint space for all team members, and a Yammer network or Teams channel. The integration of cross-cutting aspects (HRBA, gender responsiveness, LNOB) also requires expertise with sufficient and dedicated time and resources. Guidance could be development to project managers on how to do this.

78

Annexes

Annex 1: Project’s Theory of Change .....................................................................................................................................

Annex 2: Evaluation matrix.......................................................................................................................................................

Annex 3: Data collection instruments ...................................................................................................................................

Annex 4: List of documents reviewed ...................................................................................................................................

Annex 5: List of individuals interviewed ...............................................................................................................................

Annex 6: Evaluation surveys ....................................................................................................................................................

Annex 7: Evaluation Terms of Reference ..............................................................................................................................

79

Annex 1: Project’s Theory of Change

80

Annex 2: Evaluation matrix

Relevance

Key questions Suggested measures or evidence Suggested sources and methods

● To what extent was the project designed to target the new needs and priorities of participating countries as a result of COVID-19?

● Evidence of needs assessments (surveys, reports, minutes from consultations, workshop reports, etc.).

● Country contexts. ● Reference to the Surge project in country,

programmes, or COVID-focused UN evaluations. ● Reference and opinion of UN staff and partners. ● Opinion of staff from the implementing UN entities,

including Project Design Team, Project Steering Committee, and Task Forces.

● Opinion of external partners, including other UN organizations, Governments, other partners and stakeholders.

• Desk review: surveys, minutes from consultations, workshop reports, country assessments, sectoral analysis, SERPs.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

● To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g. COVID-19 Socio-Economic Response Plan)?

● Reference to SERPs in project progress reports and outputs.

● Reference to the Surge project in UN PRODOCS and in country, programmes, or UN/UNCT annual reports.

● Reference to the Surge project in country, programmes, or COVID-focused UN evaluations.

● Opinion of UN staff and external partners.

• Desk review: Progress reports, project outputs, SERPs.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

• Coherence

Key questions Suggested measures or evidence Suggested sources and methods

● To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

● Evidence of collaboration or joint outputs with other UN departments or programmes; evidence of other UN departments or programmes referring to or using MSMEs project’s outputs.

• Desk review: Strategies and workplans of participating UN

81

● Evidence of synergies between implementing UN entities and overlaps avoided; evidence of joint activities.

● Evidence of the project being mainstreamed in the workplans of other departments or programmes within implementing UN entities.

● Evidence of the project being reflected in the annual workplans and time commitments of staff from implementing UN entities.

● Opinion of staff from the implementing UN entities, including Project Design Team, Project Steering Committee, and Task Forces.

● Opinion of external partners, including other UN organizations, Governments, other partners and stakeholders.

● Reported instances of improvements in the coordination of the response to the COVID crisis by implementing UN entities.

● Evidence of adaptive management and adjustments in the course of project implementation.

entities, PRODOCs, progress reports, evaluations.

• Interviews: Staff from participating UN entities, UNCTs.

● To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non-Secretariat) to COVID- 19 in delivering socio-economic support to Member States?

● Number and types of other UN agencies contributing to project implementation.

● Evidence of partnerships with other UN agencies; evidence of collaboration or joint outputs with other UN departments or programmes; evidence of other UN departments or programmes using outputs from the MSMEs project.

● Evidence of the project being mainstreamed in the workplans or programmes of other UN agencies.

● Opinion of staff from other UN agencies, including UNRCOs and UNCTs.

● Opinion of external partners, including Governments and other stakeholders.

● Reported instances of improvements in the coordination of the response to the COVID crisis by other UN agencies.

● Evidence of adaptive management and adjustments in the course of project implementation.

• Desk review: Strategies and workplans of participating UN entities, PRODOCs, progress reports, evaluations.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

82

• Efficiency

Key questions Suggested measures or evidence Suggested sources and methods

● How well coordinated was the process for the response among the entities implementing the joint project?

● Evidence of project monitoring meetings; technical meetings of the project task Forces.

● Evidence of joint activities, synergies between participating UN entities, overlaps avoided; project mainstreaming in participating UN entities’ workplans.

● Opinion of UN staff, including Project Design Team, Project Steering Committee, Task Forces, UNRCOs and UNCTs.

● Opinion of external partners, including Governments and other partners and stakeholders.

● Reported instances of improvements in the coordination of the response to the COVID crisis by participating UN entities.

● Time taken to develop and deliver planned outputs; evidence of delays.

● Evidence of adaptive management and adjustments in the course of project implementation.

• Desk review: Meeting minutes, progress reports, workplans, PRODOCS.

• Interviews: Staff from participating UN entities (e.g. Project Design Team, Project Steering Committee, Task Forces), UNCTs, external partners.

• Case study: UNCT staff and partners.

● How did the three-phase budgeting and programming approaches impact the efficient delivery of the project?

● Reported impact according to project monitoring meetings; technical meetings of the project task Forces.

● Opinion of UN staff, including Project Design Team, Project Steering Committee, UNRCOs and UNCTs.

● Opinion of external partners, including Governments and other partners and stakeholders.

● Speed of implementation; time taken to develop and deliver planned outputs; evidence of delays.

● Evidence of adaptive management and adjustments in the course of project implementation.

• Desk review: Meeting minutes, progress reports, workplans, PRODOCS.

• Interviews: Staff from participating UN entities (e.g. Project Design Team, Project Steering Committee, Task Forces), UNCTs, external partners.

• Case study: UNCT staff and partners.

• Effectiveness

83

Key questions Suggested measures or evidence Suggested sources and methods

● To what extent did the programme (Development Account) and project governance and management structures and processes enable, or hinder, the effective implementation of the joint project and the achievement of its results?

● Evidence of project monitoring meetings; technical meetings of the project task Forces.

● Programmes and projects monitoring and evaluation reports.

● Opinion of SHS staff, partners, and stakeholders; ● Evaluators’ expert judgement drawing on all evidence

sources.

• Desk review: Meeting minutes, progress reports, workplans, PRODOCS.

• Interviews: Staff from participating UN entities (e.g. Project Design Team, Project Steering Committee, Task Forces), UNCTs, external partners.

● To what extent has the project contributed to the expected outcomes as enunciated in the project document?

● Evidence of project outputs and reference to project’s outputs in policies, SDG related reports, and other national publications on MSMEs and entrepreneurship (e.g., UN, private sector, CSOs/NGOs, etc.).

● Outcome indicators: All; level of achievement of planned outcomes.

● Programmes and projects monitoring and evaluation reports.

● Opinion of UN staff, partners, and stakeholders. ● Evaluators’ expert judgement drawing on all evidence

sources.

• Desk review: Project outputs, progress reports, assessment questionnaires, evaluations, Empretec centers data and reports, data collected by UNCTAD via its e- regulation and e-registration portal.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

● How did the response contribute to the participating country Governments’ responses to COVID-19, especially in the area of MSME resurgence?

● Evidence of uptake, use, and influence of project outputs.

● New approaches and policies adopted and capacity and resources to sustain these.

● Reported country level uptake and institutionalisation of new approaches introduced as a result of ILO COVID response.

● Opinion of UN staff, Governments, and other partners and stakeholders.

● Evaluators’ expert judgement drawing on all evidence sources.

• Desk review: Project outputs, progress reports, assessment questionnaires, evaluations.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

84

● What innovative approaches or tools, if any, did the response use, and what were the outcomes and lessons learned from their application?

● Use made and outputs of innovations such as online or blended modalities at country level, gamification and other interactive techniques.

● Engagement in short term measures outside of normal activities.

● Outcome indicators: IA 4.1., IA 4.2. ● Opinion of UN staff, Governments, and other partners

and stakeholders. ● Evaluators’ expert judgement drawing on all evidence

sources.

• Desk review: Project outputs, progress reports, assessment questionnaires, evaluations.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

• Sustainability

Key questions Suggested measures or evidence Suggested sources and methods

● What measures were adopted to ensure that outcomes of the response would continue after the project ended?

● Reported contribution made through the project towards impact in each of the outcome areas for intended beneficiaries and in shaping national policies

● Governments and other beneficiaries’ perceptions of impact/likely impact

● Governments and other beneficiaries’ perception of strengthened capacity.

● New approaches and policies adopted and capacity and resources to sustain these.

● Reported country level uptake and institutionalisation of new approaches introduced as a result of ILO COVID response.

● Evidence of new arrangements, partnerships and funding being put in place to support the scaling up of work implemented or given new prominence as a result of the pandemic.

• Desk review: Project outputs, progress reports, assessment questionnaires, evaluations.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Gender, human rights and disability

Key questions Suggested measures or evidence Suggested sources and methods

85

● To what extent were perspectives on gender equality, protection of human rights and reaching underserved groups integrated into design and implementation of the project? What results can be identified from these actions?

● Proportion of vulnerabilities disaggregated surveys, assessments.

● Evidence of human rights conventions and strategies (e.g. CEDAW, CRC, CESCR, CRPD, etc.) referred in progress monitoring reports.

● Evidence of project outputs mainstreaming HRBA principles and LNOB.

● Extent to which partnership agreements and project activities include specific measures advancing gender equality, inclusion, human rights.

● Evidence of vulnerable groups or their representative organisations involved in project implementation and monitoring.

● Outcome indicators: IA 1.5, IA 1.6, IA 1.7, IA 1.8, IA 2.1, OP 3.1, IA 3.2, IA 5.3; level of achievement of planned outcomes.

● Opinion of UN staff, Governments, and other partners and stakeholders.

● Evaluators’ expert judgement drawing on all evidence sources.

• Desk review: Project outputs, progress reports, assessment questionnaires, evaluations.

• Interviews: UN staff and partners.

• Survey: UNCTs, external partners and stakeholders.

• Case study: UNCT staff and partners.

86

Annex 3: Data collection instruments

Relevance

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

1. To what extent was the project designed to target the new needs and priorities of participating countries as a result of COVID- 19?

● To what extent has the project been articulated with countries’ priorities to respond to the COVID- 19 crisis?

● How did you identify the needs for the project activities or products you delivered in target countries?

● Did you specifically assess the needs of women and vulnerable groups? If positive, how?

● Is there any evidence of such needs (e.g. demands from Member States, surveys, minutes from consultations, workshop reports, market assessments, past evaluations)?

● To what extent has the project been articulated with countries’ priorities to respond to the COVID- 19 crisis?

● How were the needs of national beneficiaries identified?

● Did you specifically assess the needs of women and vulnerable groups? If positive, how?

● Who was consulted and what evidence is there (e.g. surveys, minutes from consultations, workshop reports)?

● Did the Surge Project respond to a national or sectoral agenda or priority?

● Were your needs assessed and did they inform project activities? If positive, how?

● To what extent did the training activities, knowledge products, or technical support delivered by the Surge project respond to your learning needs?

● To what extent were the training activities, knowledge products, or technical support delivered by the Surge project relevant to your work?

● To what extent did the training activities, knowledge products, or technical support delivered by the Surge project provide you the opportunity to share your knowledge and skills with other participants?

● Were you overall satisfied with the training activities, knowledge products, or technical support

87

delivered by the Surge project?

2. To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g. COVID-19 Socio- Economic Response Plan)?

● How did the Surge project’s products and activities align with the SERPs?

● To what extent was the project aligned with UN priorities to LNOB by reaching the most vulnerable and the protection of human rights?

● How did the Surge project’s products and activities delivered in your country respond to the SERP?

● To what extent was the project aligned with UN priorities to LNOB by reaching the most vulnerable and the protection of human rights?

● To what extent was the project aligned with UN priorities to LNOB by reaching the most vulnerable and the protection of human rights?

Would be primarily assessed through a desk review of a sample of SERPs.

Coherence

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

3. To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

● What were the other key activities that your department or other departments in the organization carried out to support MSMEs during the period 2020-2022? Which departments implemented those activities? How did you synergize these activities with the Surge project?

● Is there any evidence of joint activities or outputs? Is there any evidence of

● Did you cooperate with different departments from the project UN entities? If positive, did these UN entities synergize their inter- departmental collaboration while working with you?

● What were the good practices? What could have been done differently?

● Did you receive support (from different departments of the implementing agencies or) from several implementing entities?

● If positive, is there any evidence of complementary activities designed to maximize synergies and avoid overlaps? What were the good practices?

● What could have been done differently?

88

complementary activities designed to maximize synergies and avoid overlaps?

4. To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non- Secretariat) to COVID- 19 in delivering socio- economic support to Member States?

● Were there any other UN organisations outside of the core project partners that carried out activities to support MSMEs during the Covid crisis (2020- 2022)? Which ones and how did you synergize these activities with the Surge project?

● To what extent did the project support other efforts by UN entities to support Member States intending to mitigate socio-economic impacts of COVID-19?

● Is there any evidence of joint activities or outputs? Is there any evidence of complementary activities designed to maximize synergies and avoid overlaps? What were the good practices?

● What could have been done differently? Are there any UN partners with which complementarities could have been strengthened (e.g. ILO, UNDP)?

● To what extent did the project support other efforts by UN entities to support Member States intending to mitigate socio-economic impacts of COVID-19?

● Among the range of activities that your organization carried out in the country to support MSMEs during the period 2020-2022, did you synergize any of these interventions with the Surge project?

● Is there any evidence of joint activities or outputs? Is there any evidence of complementary activities designed to maximize synergies and avoid overlaps? What were the good practices?

● What could have been done differently?

● Did you receive support from other UN organisations? If positive, is there any evidence of complementary activities designed to maximize synergies and avoid overlaps with the project’s implementing entities? What were the good practices?

● What could have been done differently?

● In your opinion, how do you assess the level of synergies and complementarity of the project with the interventions of other UN organisations in the country? (Likert: 6 levels)

● In your opinion, were there any UN organisations with which the Surge project could have increased synergies or avoided overlaps at country level (if positive, please specify which UN organisations): (Open ended).

89

Efficiency

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

5. How well coordinated was the process for the response among the entities implementing the joint project?

● How did you coordinate project activities with the other entities? Were there any opportunities for any joint work contributing to reducing implementation costs or scale benefits?

● To what extent did the project benefit from resources (structure, personnel, partnerships) made available by ongoing projects?

● What were the good practices in terms of coordinating the Surge project?

● What were the challenges? What could have been done differently?

● Did the UN entities coordinate adequately project implementation?

● What were the good practices? What could have been done differently?

● Did you receive support from several implementing entities?

● If positive, is there any evidence of complementary activities designed to maximize synergies and avoid overlaps? What were the good practices?

● What could have been done differently?

6. How did the three- phase budgeting and programming approaches impact the efficient delivery of the project?

● Did the phased approach come with a sufficient level of predictability to ensure synergies with the work of your agency? Did the phased approach prevent the project from formulating a long-term vision? Did the phased approach facilitate the formulation of

● Were the activities of the UN entities sufficiently predictable to ensure proper synergies with the work of your agency at country level?

● Did the phased approach facilitate any adaptive management? What were the good practices?

● Were project activities sufficiently predictable to ensure proper synergies with your organisation’s agenda of work? Could you properly plan the collaboration and joint work with the UN entities?

● Did you have a clear vision about what the UN

90

interventions across a pathway from crisis response, to recovery, and development?

● Did the phased approach facilitate any adaptive management? What were the good practices?

● What could have been done differently? What lessons learned from each of the three phases supported the continuation and continuous improvement of the project?

● What could have been done differently?

entities intended to deliver and the expected effects of their interventions?

Effectiveness

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

7. To what extent did the programme (Development Account) and project governance and management structures and processes enable, or hinder, the effective implementation of the joint project and the achievement of its results?

● Was the programme modality (Development Account) adequate to respond to a crisis? What were the strengths and weaknesses of the programme modality (Development Account) in a crisis context?

● What were the challenges faced by the project’s governance and management structures and processes?

● How do you assess the project governance and management structures and processes?

● What worked well? Are there any good practices that could be systematized?

● What could have been improved/what would you propose doing differently next time?

● How do you assess the project governance and management structures and processes?

● What worked well? Are there any good practices that could be systematized?

● What could have been improved/what would you propose doing differently next time?

91

● What were the good practices and lessons learned from project implementation?

8. To what extent has the project contributed to the expected outcomes as enunciated in the project document?

● What would you highlight as the most significant outcomes of the project in the following areas (as relevant)? (i) Improving national capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship MSME promotion in post-COVID- 19 resurgence; (ii) Improving resilience and competitiveness of MSMEs in post-COVID-19 resurgence; (iii) Facilitating MSMEs registration and formalization; (iv) Improving MSMEs access to finance; (v) Increasing MSMEs access to innovation and technology; (vi) Enhancing MSMEs access to markets.

● What examples or evidence would demonstrate such outcomes?

● Who were the primary beneficiaries of the project?

● What would you highlight as the most significant outcomes of the project in the following areas (as relevant)? (i) Improving national capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship MSME promotion in post-COVID- 19 resurgence; (ii) Improving resilience and competitiveness of MSMEs in post-COVID-19 resurgence; (iii) Facilitating MSMEs registration and formalization; (iv) Improving MSMEs access to finance; (v) Increasing MSMEs access to innovation and technology; (vi) Enhancing MSMEs access to markets.

● What examples or evidence would demonstrate such outcomes?

● Who were the primary beneficiaries of the project?

● What would you highlight as the most significant outcomes of the project in the following areas (as relevant)? (i) Improving national capacities on formulating and implementing enabling policies on green, resilient and inclusive entrepreneurship MSME promotion in post-COVID- 19 resurgence; (ii) Improving resilience and competitiveness of MSMEs in post-COVID-19 resurgence; (iii) Facilitating MSMEs registration and formalization; (iv) Improving MSMEs access to finance; (v) Increasing MSMEs access to innovation and technology; (vi) Enhancing MSMEs access to markets.

● What examples or evidence would demonstrate such outcomes?

● Who were the primary beneficiaries of the project?

● In what ways did the training activities, knowledge products, or technical support delivered by the Surge project influence your perspectives?

● To what extent did the training activities, knowledge products, or technical support delivered by the Surge project enhance your skills and/or knowledge of the subject matter?

● To what extent did the training activities, knowledge products, or technical support delivered by the Surge project enlarge your professional network?

● Were you able to use/apply in your work the knowledge or skills acquired through the training activities, knowledge products, or technical support delivered by the Surge project?

● Were there measurable changes in your activities and performance when you got back to your workplace that you can attribute to the training

92

activities, knowledge products, or technical support delivered by the Surge project?

● To what extent have the changes in your performance and new level of knowledge or skills sustained over time?

9. How did the response contribute to the participating country Governments’ responses to COVID- 19, especially in the area of MSME resurgence?

● What examples would you highlight showing that the project contributed to any of the following achievements (as relevant): (i) MSMEs sustained and growing their businesses, including through exporting and integration in value chains; (ii) Businesses newly established, newly registered/formalized MSMEs; (iii) Jobs sustained and created; including with regard to women and youth entrepreneurs; (iv) Policies and measures developed and implemented by governments to facilitate the MSME resurgence in the immediate term and to enhance their shock resilience and competitiveness in a longer term.

● What were the unintended positive and

● What examples would you highlight showing that the project contributed to any of the following achievements (as relevant): (i) MSMEs sustained and growing their businesses, including through exporting and integration in value chains; (ii) Businesses newly established, newly registered/formalized MSMEs; (iii) Jobs sustained and created; including with regard to women and youth entrepreneurs; (iv) Policies and measures developed and implemented by governments to facilitate the MSME resurgence in the immediate term and to enhance their shock resilience and competitiveness in a longer term.

● What were the unintended positive and

● What examples would you highlight showing that the project contributed to any of the following achievements (as relevant): (i) MSMEs sustained and growing their businesses, including through exporting and integration in value chains; (ii) Businesses newly established, newly registered/formalized MSMEs; (iii) Jobs sustained and created; including with regard to women and youth entrepreneurs; (iv) Policies and measures developed and implemented by governments to facilitate the MSME resurgence in the immediate term and to enhance their shock resilience and competitiveness in a longer term.

● What were the unintended positive and

● To what extent have the knowledge and skills you acquired though the training activities, knowledge products, or technical support of the Surge project contributed to improving the performance or results of your organization?

● To what extent did the knowledge and skills you acquired though the training activities, knowledge products, or technical support of the Surge project contribute to your ability to advance sustainable development.

● In what ways have the training activities, knowledge products, or technical support delivered by the Surge project contributed to: (i) Improving national capacities on formulating and implementing enabling

93

negative effects of the project?

negative effects of the project?

negative effects of the project?

policies on green, resilient and inclusive entrepreneurship MSME promotion in post-COVID- 19 resurgence? (ii) Improving resilience and competitiveness of MSMEs in post- COVID 19 resurgence? (iii) Facilitating MSMEs registration and formalization? (iv) Improving MSMEs’ access to finance? (v) Increasing MSMEs’ access to innovation and technology? (vi) Enhancing MSMEs’ access to markets? (vii) Engaging and sustaining women and youth entrepreneurs and other vulnerable and marginalized groups?

● Please, share concrete

examples of the types of policy or economic improvements, contribution to advancing sustainable development, or other entrepreneurship impacts that resulted from the skills and knowledge you acquired though the training activities, knowledge products, or technical support

94

delivered by the Surge project

10. What innovative approaches or tools, if any, did the response use, and what were the outcomes and lessons learned from their application?

● In which areas was the Surge project innovative?

● What were the most promising practices that participating UN entities should consider institutionalizing or replicating?

● In which areas was the Surge project innovative?

● What were the most promising practices that participating UN entities should consider institutionalizing or replicating?

● Was there anything innovative or unique with the Surge project that participating UN entities should consider institutionalizing or replicating?

● Was there anything innovative or unique with the Surge project that participating UN entities should consider replicating or scaling? (open ended)

Sustainability

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

11. What measures were adopted to ensure that outcomes of the response would continue after the project ended?

● Has the project advanced partnerships amongst project participants, national institutions and the MSMEs in support of sustainable results?

● How did the project contribute to leveraging funding and financing of government and other resource partners (multilateral, bilateral, etc.)?

● What were the enabling factors that contributed to making the project transformative?

● Has the project advanced partnerships amongst project participants, national institutions and the MSMEs in support of sustainable results?

● How did the project contribute to leveraging funding and financing of government and other resource partners (multilateral, bilateral, etc.)?

● What were the enabling factors that contributed to making the project transformative?

● Has the project advanced partnerships amongst project participants, national institutions and the MSMEs in support of sustainable results?

● How did the project contribute to leverage funding and financing of government and other resource partners (multilateral, bilateral, etc.)?

● Do you find that UN entities managed adequately the need for immediate response and the search for longer- term effects?

● To what extent did the Surge project contribute to promoting better preparedness for future crisis? (Likert scale)

95

● What were the enabling factors that contributed to make the project transformative?

● To what extent did the project contribute to promote better preparedness for future crisis?

Gender, human rights, and disability

Key questions Interview questions for UN staff from partner

entities

Interview questions for implementing partners (UNCTs, Empretec, etc.)

Interview questions for target beneficiaries

(Governments, MSMEs, etc.)

Survey questions for target beneficiaries

(Governments, MSMEs, etc.)

Comments

12. To what extent were perspectives on gender equality, protection of human rights and reaching underserved groups integrated into the design and implementation of the project? What results can be identified from these actions?

● To what extent have women and other vulnerable and marginalized groups engaged, including outreach and selection process, types of leadership roles, decision-making, among others?

● To what extent have project activities been designed and implemented with particular attention to the needs and contexts of women and other vulnerable and marginalized groups?

● To what extent have Member States engaged and integrated human

● To what extent have women and other vulnerable and marginalized groups engaged, including outreach and selection process, types of leadership roles, decision-making, among others?

● To what extent have project activities been designed and implemented with particular attention to the needs and contexts of women and other vulnerable and marginalized groups?

● To what extent have national partners engaged and integrated

● To what extent have women and other vulnerable and marginalized groups engaged, including outreach and selection process, types of leadership roles, decision-making, among others?

● In what ways have the activities affected women and other vulnerable and marginalized groups in their lives?

● In what ways were women and other vulnerable and marginalized groups affected by COVID-19 restrictions and how was

● To what extent have women and other vulnerable and marginalized groups benefited from the training activities, knowledge products, or technical support delivered by the Surge project? (Likert: 6 levels)

● Any comments? (open ended)

● Disaggregated analysis of survey data

96

rights protections in their project activities?

human rights protections in their project activities?

that addressed in the project’s efforts?

● To what extent have national partners engaged and integrated human rights protections in their project activities?

97

Annex 4: List of documents reviewed

● Callo-Müller M. V. 2020. Micro, small and medium enterprises (MSMEs) and the digital economy. ESCAP. Bangkok.

● ECLAC. 2020. Sectors and businesses facing COVID-19: Emergency and reactivation, Special Report n.4. Santiago, Chile.

● ESCAP. 2021. Rethinking MSME Finance in Asia and the Pacific: A Post-Crisis Policy Agenda. Bangkok. ● ESCAP. 2021. The Role of Competition Policy in Strengthening the Business Environment for MSMEs in the ASEAN

Region. 11 February 2021. Bangkok. ● ESCAP. 2022. Bangladesh Startup Ecosystem Assessment Report. Bangkok. ● ESCAP. 2022. MSME Access to Finance: The Role of Digital Payments, MSME Financing Series No.7. Bangkok. ● ESCAP. 2022. Policy guidebook for MSME development in Asia and the Pacific, 2nd edition. Bangkok. ● ESCAP. 2022. Small and Medium-Sized Enterprises Lending Approaches: The Role of Banks in Asia. MSME

Financing Series No. 6. Bangkok. ● ILO. 2020. COVID-19 and the impact on agriculture and food security. Geneva. ● ILO. 2018. Women and Men in the Informal Economy: A Statistical Picture, Third Edition, Geneva. ● ILO. 2020. Contagion or starvation, the dilemma facing informal workers during the COVID-19 pandemic.

Geneva. ● ILO. 2021. ILO Monitor: COVID-19 and the world of work. Seventh edition. 25 January 2021. Geneva. ● ILO. 2021. ILO Monitor: COVID-19 and the world of work. Seventh edition. 25 January 2021. Geneva. ● ILO. 2022. Independent High-Level Evaluation of ILO’s COVID-19 response 2020-22. Geneva. ● IMF. 2020. World Economic Outlook Update: A Crisis Like No Other, An Uncertain Recovery. Washington. ● IMF. 2021. World Economic Outlook Update. January 2021. Washington. ● OECD. 2020. Global Outlook on Financing for Sustainable Development 2021. Paris. ● UN OCHA. 2020. Global Humanitarian Response Plan for COVID-19. Geneva. ● UN Women. 2020. Guidance Note for Action: Supporting SMEs to Ensure the Economic COVID-19 Recovery is

Gender-Responsive and Inclusive. UN Women Regional Office for Asia and the Pacific. Bangkok. ● UNCTAD. 2020. Concept note: Global Initiative towards post-Covid-19 MSME sector Phase I. April 2020.

Geneva. ● UNCTAD. 2020. COVID-19 Response. Global Initiative towards post-Covid-19 MSME sector: MSME Surge

Project. Phase II Project Proposal. July 2020. Geneva. ● UNCTAD. 2020. COVID-19: Firmer Action Needed to Better Protect Consumers. Geneva. ● UNCTAD. 2021. COVID-19 Response. Global Initiative towards post-Covid-19 MSME sector: MSME Surge

Project. Phase III Project Proposal. February 2021. Geneva. ● UNCTAD. 2021. Global Initiative towards post-Covid-19 resurgence of the MSME sector. MSME surge project -

Addendum Phase 3 Project Proposal. Geneva. ● UNCTAD. 2021. How COVID-19 affects MSME access to markets and competition: A review of key issues and

recommendations for future action. Geneva. ● UNCTAD. 2021. Impact of the COVID-19 pandemic on trade and development: Recovering, but unevenly -

Situation as at 31 March 2021. Geneva. ● UNCTAD. 2022. Cross-border Trade in the Pre- and Post-Pandemic Environment Evidence from Malawi, the

United Republic of Tanzania and Zambia. Geneva. ● UNCTAD. 2022. Entrepreneurship & innovation in the new health economy. Geneva. ● UNCTAD. 2022. Final Report: Global Initiative towards post-Covid-19 resurgence of the MSME sector.

September 2022. Geneva. ● UNCTAD. 2022. Guidance for action: Supporting MSMEs’ recovery from the COVID-19 pandemic. Prepared for

the trade competition commission of Thailand. Geneva. ● UNCTAD. 2022. The COVID-19 pandemic impact on micro, small and medium sized enterprises: Market access

challenges and competition policy. Geneva. ● UNCTAD. 2023. MSME Surge Project. Empretec: Impact Assessment Survey Report. Geneva. ● UNDESA. 2018. Micro-, Small and Medium-sized Enterprises (MSMEs) and their role in achieving the Sustainable

Development Goals. New York. ● UNDP. 2020. UNDP Briefing Note Gender COVID-19. New York. ● UNECA. 2022. The role of digitalisation in strengthening capacities of Micro, Small and Medium-Size Enterprises

(MSMEs) in Southern Africa to take advantage of the AfCFTA. ECA Sub-Regional Office for Southern Africa (SRO- SA) & ECA Digital Centre of Excellence. Addis Ababa.

● UNECE. 2020. Guidelines and best practices for micro-, small and medium enterprises in delivering energy- efficient products and in providing renewable energy equipment. Geneva.

98

● UNECE. 2020. Guidelines and Best Practices for MSMEs to assure resiliency and progress towards a circular economy in sustainable resource management and critical raw material supply chain solutions. August 2020. Geneva.

● UNECE. 2020. The Impact of COVID-19 on trade and structural transformation in Georgia. Geneva. ● UNEG. 2008. Code of Conduct for Evaluation in the UN system. New York. ● UNEG. 2020. Ethical Guidelines for Evaluation. New York. ● UNIDO. 2020. COVID-19, Implications and Response : Digital Transformation and Industrial Recovery. Vienna. ● United Nations Moldova. 2020. COVID-19 Socio-economic Response and Recovery Plan. June 2020. Chisinau. ● United Nations. 2017. Resolution adopted by the General Assembly on 21 December 2016. 71/221.

Entrepreneurship for sustainable development. A/RES/71/221. General Assembly. New York. ● United Nations. 2019. Resolution adopted by the General Assembly on 20 December 2018. 73/225.

Entrepreneurship for sustainable development. A/RES/73/225. General Assembly. New York. ● United Nations. 2020. A UN framework for the immediate socio-economic response to COVID-19. April 2020.

New York. ● United Nations. 2020. Resolution adopted by the General Assembly on 2 April 2020. A/RES/74/270. General

Assembly. New York. ● United Nations. 2020. Shared Responsibility, Global solidarity: Responding to the socio-economic impacts of

COVID-19. March 2020. New York.

99

Annex 5: List of individuals interviewed

Redacted for confidentiality purposes.

100

Annex 6: Evaluation surveys

The evaluation carried out six external surveys to inform the assessment of the relevance, coherence, and effectiveness of the project and its contribution to outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups. The surveys targeted participants to project activities and beneficiaries. The lists of contacts were provided by UNCTAD, DESA, ESCAP, ECLAC, UNECA, and UNECE. The surveys were composed, for some part, of questions that were common to all six questionnaires, and for other parts, of questions specific to each of the 5+1 project outcomes. The questionnaires were made available in English. They were translated in Spanish for outcomes 3 and 5 as target recipients were primarily in the Latin America and Caribbean region. The surveys were anonymous and remained open for 2 weeks, from Thursday 20 July to Friday 4 August. Two reminder messages were sent to increase the response rate. The surveys were launched to a combined list of 1454 persons, with 89 messages bouncing back. Altogether, the surveys compiled feedback from 133 respondents. All survey questions were optional. Questionnaires partially completed were kept in the batch of results when they contained information that was judged relevant, credible and meaningful. Statistics were calculated on the basis of the number of valid responses per question and not on the basis of the overall number of respondents to the surveys. The overall response rate to the email surveys is circa 9.7%. The surveys present the opinion of those who responded but not of the entire list of recipients of the questionnaires nor of all the beneficiaries of the project.

Outcome Email addresses Bounced back Valid email Valid responses Percentage

1A 574 38 536 52 9.70% 1B 258 24 234 40 17.09% 2 21 0 21 4 19.05% 3 219 4 215 11 5.12% 4 98 1 97 13 13.40% 5 284 22 262 13 4.96%

Total 1454 89 1365 133 9.74% Relevance of the project 1. To what extent do you agree with the following statements?

Strongly agree

Agree Somewhat agree

Somewhat disagree

Disagree Strongly disagree

Do not know

Total

The project activities responded to my priorities and were relevant to my work

54 58 15 1 2 1 2 133

The project complemented interventions by other international organizations working in my country/region

36 56 23 4 3 1 7 130

101

2. Did the project increase synergies or avoid overlaps with other agencies/entities working in this area?

Please explain.

● A lot of organizations were conducting projects regarding COVID, however this one was the only one providing actual information on practical ways to mitigate some challenges arising from the pandemic.

● As every and each project in Armenia there are overlaps

● Auemntaron las sinergias, al publicarse reformasa las leyes laborales y fiscles.

● Aumento mis criterios previos al proyecto

● Aumentou a sinergia com outras entidades à medida que deixou bem clara a importância das parcerias.

41%

44%

11%

1% 1%

1% 1%

The project activities responded to my priorities and were relevant to my work

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

28%

43%

18%

3% 2% 1%

5%

The project complemented interventions by other international organizations working in my country/region

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

102

● Have no detail information

● Here, it is more of overlaps with other agencies.

● I am not aware that there was good mutual communication between the job holders during the execution of the project.

● I believe the project will increase synergies and complement other initiatives in place

● I can say that any project makes an effort to enhance synergies and do away duplications if there is to optimize the resources and maximize the positive impact.

● I did not see avoiding of overlaps with other agencies working in this area especially at country level.

● I think the project definitely increased synergies with other domestic agencies / entities working in each specific area.

● I think this project increase synergies with other project

● IDEP; PNUD HUB REGIONAL DAKAR

● Increased synergies

● It created synergy as Seda provided a number of virtual trainings which is still continuing to date.

● It focused on areas that affected our common clients. However, there is need to make a follow up and implement the recommendations.

● It increase synergy because from my view point I think the manpower strength of this organisation will stand out if the y are innovative ,

● It increased synergies

● It increased synergies and avoided overlaps

● It increased synergies in the sense that it adequately complemented what had been on the ground by the activities of other agencies.

● It increases synergies

● It is still in progress.

● It really increase synergy fill in gaps in the others

● It was helpful for avoiding overlaps

● Like womens ministery

● more strategic alliances

● Neither yes or no because I have seen it or positive impact on me

● No

● No awareness

● No comment

● No it did not

● No.

● Nos proporcionó elementos para poder considerar el comportamiento en éste tipo de eventualidades temporales

● Not sure. Communication between agencies is not always the best.

● Not yet because the understanding among the companies and leaders is not concrete to work hand in hand however strengthen the relationship and strong collaboration among the companies is still under consideration

● Our country SME office

● Partnerships and cooperation within the different parties involved was evident. This includes Donors, Investors, Grant Managers, Incubators, Accelerators, Chambers of Commerce, Hubs, the UN and the Governments of the various countries involved.

● Permitió por sobre todo tomar conocimiento de las realidades regionales de las pymes, y sus dificultades u oportunidades para la mirada exportadora y las herramientas y brechas existentes

103

como barreras a superar y que en la mayoría de los casos es posible extender los casos de éxitos o superaciones de un país a la región

● Project increase synergies, gives hope especially with the financial support. It was really helpful. Covid -19 severely damaged the whole life emotionally, physiologically, financially. It was really good that this project was there during the Covid-19 difficult times.

● project increased synergies with and complemented internal activities in own company

● Project never visible in the communities

● Se dieron conexiones y nuevas sinergias que resultaron muy positivas

● Se evitó solapamientos, ya que se cuidó esta parte en la capacitación.

● si porque nos ayuda a tomar decisiones para formular proyectos para las Mypes en nuestro pais

● Strong synergies were evident, probably due to strong collaboration between the Agencies.

● The inter-institutional cooperation is important.

● The project activities can not overlap even if having similar set of objectives since it is a needed necessity for developing countries.

● The project avoids overlaps with other agencies.

● The project did create synergies and was generally applicable to many situations

● The project encouraged synergies with other agencies including the ILO in supporting and promoting formalization as well as the UNDP in supporting private sector development and SMEs resilience building.

● the project has increase synergies with other agencies

● The project has increased synergies rather than overlapping other activities in this area.

● The project increase the synergies of the efforts with other agencies and entities by focusing areas of intervention and rationalizing resources

● The project increased synergies

● The project increased synergies with between Government Agencies and the Private Sector whereby innovative ideas were explored and cutting edge solutions were developed.

● The project increased working relationships with other agencies. The project also covered some of the areas which Government might have resources to reach.

● The project looked at all the problems of the MSMEs and contributed to the summary of information in one place.

● The project was avoid overlaps with other agencies.

● The project was not only important source of information for the Moldova's Government, but also it was largely complementary to the work of few agencies, such as UNDP, UNCTAD, UN Women etc and was helpful in the process of CCA analysis, Gender assessment etc. Particularly, the project recommendations were presented during the Socio-Economic task force chaired by UNDP , the Economic Council under Prime-Minister and development partners coordination platform co-chaired by the UN and World Bank Group in Moldova. some of the findings were further adopted as activities under the UNCTAD and UNDP projects (notably regarding customs procedures and SME support).

● the project was used to make recommendations as part of a study on the MSME business environment in Madagascar

● The project was very important session

● This programme increased the synergies amongst the relevant ministries/institutions that works on MSMEs

● To build capacities to MSM"s

● To considerable extend did avoid overlap, what is important is to bring MSME center stage especially in developing economies and that unique role has been played by this attempt

● we had synergies and networking

● yes

104

● yes

● yes great synergies avoiding overlapping between UN RECs and DESA in NYC created new partnerships within and outside UN system

● yes it did

● Yes it did. Our collaboration with Regional Economic Commissions of the UN was very helpful, UNESWA and UNECLAC were already incorporating some aspects of competition work and SMEs and this project enabled us to collaborate more and share our expediencies like never before. We also closely collaborated with UNESCAP in their SMEs and also to organize the DA project closing event in Bangkok.

● yes it increased synergies with other agencies working in that area

● Yes it increases synergies

● Yes it was complimentary

● Yes right

● Yes the project enhanced synergies with other agencies through collaborations and partnerships to provide relevant support to MSMEs

● Yes the project increases the synergies of Empretec Centre Benin and chamber of commerce and Industry in Benin

● Yes,

● Yes, it did and help a lot

● Yes, it did increase synergies. Especially with NGOS who are impacting on skills acquisition, they also made impact but UNTACD surpassed them all

● Yes, it did. Information on the issues of access to markets and disruption of supply chains supported competition agencies in enforcing the law to support MSME sustainability.

● Yes, it increased synergies since several agencies were involved to implement the project.

● Yes, it was structured in a close coordination with other implementing agencies and key national counterparts

● Yes, MSME is the most hit by COVID-19 and need special focus

● Yes, proper planning of involved actors boosted synergies and avoided overlaps.

● Yes, since it was implemented in close collaboration with the UN Regional Economic Commissions and with the member States counterparts fully involved.

● Yes, the project increased synergies and the multi partner approach worked well.

● Yes, the project increased synergies. It created a platform where women who make up the majority MSMEs in developing countries are able to access technology at an affordable cost to enhance their businesses.

● Yes, the timing of the project was excellent, while businesses and other agencies were cautiously distanced due to Covid-19 lockdown, the project was empowering us as development practitioners to prepare for a come back to assist us in supporting our clients recover from Covid-19.

● Yes, it's created prioritisation, definitions and specificities toward gaps and overlaps.

● Yes. Maximize the use of resources in the area.

● Yes. Because the entrepreneurship is an issue that relates to all the agencies

● Yes. It led to knowing how one could use the current computer advancement in pushing business including customers participation

● Yes. The project complemented other studies conducted at national level for specific target group.

● Yes. The project was specific to the needs of women entrepreneurs

● Yes. In some ways.

● Yes… increased synergies and helped to strengthen actions.

105

Usefulness of the project 3. To what extent do you agree with the following statements?

Outcome 1A Strongly agree

Agree Somewhat agree

Somewhat disagree

Disagree Strongly disagree

Do not know

Total

The project provided access to information and best practices on government support measures for post COVID-19 recovery

35% 39% 18% 2% 4% 2% 0% 51

The project improved my knowledge on entrepreneurship/MSMEs policies design and implementation in the context of post COVID-19 recovery

39% 39% 12% 4% 6% 0% 0% 51

The project contributed to identifying new/improved policy measures for MSME promotion in post COVID-19 resurgence

43% 33% 14% 6% 4% 0% 0% 51

Outcome 1B Strongly agree

Agree Somewhat agree

Somewhat disagree

Disagree Strongly disagree

Do not know

Total

The project provided information useful for starting a new business or expanding a business venture

36% 41% 8% 3% 8% 0% 5% 39

The project improved my knowledge on entrepreneurship and business development

32% 45% 11% 3% 5% 0% 5% 38

The project contributed to identifying new/improved measures to increase business sales

42% 26% 18% 3% 5% 0% 5% 38

Outcome 2 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project provided useful information on MSMEs formalization/registration

36% 41% 8% 3% 8% 0% 5% 3

The project improved my knowledge of how to increase the number of businesses registering

32% 45% 11% 3% 5% 0% 5% 3

The project contributed to identifying new/improved measures to decrease the administrative costs of starting a business

42% 26% 18% 3% 5% 0% 5% 4

106

Outcome 3 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project provided useful information on financial inclusion and MSMEs access to finance

30% 50% 20% 0% 0% 0% 0% 10

The project improved my knowledge on accounting and reporting, including on the SDG reporting, and improved my capacity to manage financial resources

50% 20% 20% 10% 0% 0% 0% 10

The project contributed to identifying new/improved measures for financial inclusion and MSMEs access to finance

40% 40% 10% 10% 0% 0% 0% 10

Outcome 4 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project provided useful information on MSMEs access to innovation and technology

75% 25% 0% 0% 0% 0% 0% 12

The project improved my knowledge on how to increase MSMEs access to innovation and technology

75% 25% 0% 0% 0% 0% 0% 12

The project contributed to identifying new/improved measures to increase MSMEs access to technology

50% 33% 17% 0% 0% 0% 0% 12

Outcome 5 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project activities and publications provided useful information on MSMEs access to markets

38% 54% 8% 0% 0% 0% 0% 13

The project improved my knowledge on how to increase access to markets, including export and integration into value chains

54% 31% 15% 0% 0% 0% 0% 13

The project activities contributed to identifying new/improved measures for consumer protection and competition

46% 46% 8% 0% 0% 0% 0% 13

The project activities contributed to identifying new/improved measures on

33% 33% 25% 0% 0% 0% 8% 12

107

agricultural quality and food loss reduction

3-B. To what extent do you agree with the following statements?

Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project activities were accessible for women, youth, people with disabilities, or other vulnerable groups

33% 37% 21% 3% 2% 0% 4% 126

The project activities and content reflected the perspectives of women, youth, people with disabilities, or other vulnerable groups

33% 35% 26% 2% 1% 0% 2% 126

33%

37%

21%

3% 2% 0%

4%

The project activities were accessible for women, youth, people with disabilities, or other vulnerable groups

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

108

4. What (if anything) would you describe as innovative or unique from the project that the UN should consider

replicating or upscaling? Why?

● A simplified micro lending business method, such as funding a local small businesses with a day to day transaction of lend to collect daily loan offer with affordable interest rate.

● All.

● Ampliar programas de apoyo a zonas de vulnerabilidad a terceros países, o buscar cooperación es que llegue a los más necesitados e ir dándoles un acompañamiento

● As women are involved with this project, so UN should consider replicating.

● Business that clearly accommodate those with disabilities

● Capacitance communities to engage in entrepreneurship

● Considero que debe darle continuidad a las capacitaciones para que los usuarios hagamos mejor uso de la información financiera

● Continue supporting the local women led and youth led initiative to increase accessibility of services by women and girls in hard to reach communities.

● Direct training to entrepreneurs on appropriate technology application and innovation

● Diversification of business opportunity innovations and mentoring of Entrepreneurs

● During project designation, the target beneficiaries were not fully involved hence still some gaps which need more attention. some of the areas are…; Sustainability component is not there and exit strategy

● E-Commerce, promoting and upscaling global entrepreneurship especially for marginalized and vulnerable groups

● Everything is good

● excellent actions in the SDGs

● Finding, after training participants, small fund should be made available to start practicing what was learnt in the class

● Good governance in private sector to make engine of growth

● Government should already implement what has been proposed

● I don't know

33%

35%

26%

3% 1% 0%

2%

The project activities and content reflected the perspectives of women, youth, people with disabilities, or other vulnerable groups

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

109

● I live in a rural and the poorest province in my country. I was impressed by the reach of the project because while my country (the capital city) is hosting many UN regional offices, UN programmes are unheard of in these parts, though I suspect they are visible elsewhere in the country and region.

● Implementation of capacity-building training manpower , creativity to this various group,

● improving capacity-building

● Improving EE/RES secondary legislation for all countries

● Innovation simply means new methodology in doing things but on the aspect of activities of international organization in a particular country, the people that benefit almost everything are people at high, not people at lower, and whereas people at the lower class is most needed in the programme.

● innovations from women

● Innovative digital finance solutions and regulatory frameworks to support both financial inclusion and growth of SMEs, especially those owned and led by women. It is a new perspective for private sector.

● Innovative or unique from project that UN should consider they must teach also at local high school to give light to our future leaders

● it is an innovation project as it has increased women participation in business activities post-covid 19 era.

● It is necessary to give a valid and uniform assessment of the data (through the UNFC and UNRMS system), which is necessary for planning and understanding the issues in the preparation of strategic documents. Therefore, the application of the UNFC and UMRMS system for all resources, at the national level.

● la digitalizacion en el mundo globalizado

● La inclusión de jóvenes, para el fortalecimiento de sus habilidades y destrezas con una temporalidad más temprana.

● Large scale multifaceted project allowing for rapid intervention

● Las recomendaciones para tratar económicamente este tipo de eventualidades

● Let's the poor BREATHE

● Los emprendimientos liderados por mujeres, con criterios de triple impacto: Económicamente rentable, socialmente inclusivo y medioambientalmente amigable.

● More online activities

● N/A

● Need to upscale countrywide best practices to encourage or handhold MSME as an information brochure

● No comment

● Nothing at all, the project was very satisfying

● Nothing to say

● Opportunity or skills sharing from neighbouring countries. Forging business relationships and Empretec relationships.

● organize face-to-face courses for policymakers to support small and medium enterprises

● Our company benefited from Covid-19 by contracting testing & certification of medical Covid facial masks

● Platform or some sort of reimbursement for under privileged individuals who want to be part of this initiative

● policy dialogues hybrid dialogue inclusion of private sector

● Practically of the topics that were discussed

● Reducing border barriers, increasing non-refundable investment support for small and medium-sized enterprises in developing and underdeveloped countries, and improving cooperation between countries

110

● Should highly concentrate on youth and women empowerment especially on agricultural technology since the unemployment rate in the country is still high and is one of the sector which can help to reduce poverty yet still considering the best practices to reduce pollution of the environment

● Still figuring out on that

● Supporting small business for access to grants and Entrepreneurship training.

● Targeting people with disabilities and the vulnerable groups

● The best practices of project outcomes delivered in other countries should be supported and encouraged for adoption in other countries.

● The combination of independent study, YouTube videos, exercises, moderated online participation and tests facilitated greater engagement with the material, learning from the facilitator, and peer learning

● The cost of tools and others types for calculate

● The focus on MSMES and the practical approach undertaken allowed for impactful outcomes, which is not always the case of other technical cooperation projects.

● The global initiatives towards post covid 19 resurgence...its unique in tackling the novelty covid 19 and should be improved upon for future resilience and R n D by UN and lessons learn should be noted

● The number of times the trainings are done

● The online courses, webinars, and information dissemination.

● The opportunity for the usage of online tools for the dissemination of EMPRETEC programme to impact large participants

● The project, I interacted with was on formalization of MSMEs through the Cooperative business model and to small extent topics on Enterprise development were touched.

● The project's focus on capacity-building and skill development for MSMEs is vital for their sustainable growth, emphasis on sustainable and inclusive development, and the project's efforts to leverage technology and digital solutions for MSMEs are forward-thinking.

● The role competition policy in the economic recovery of MSMEs. Reason: MSMEs continue to face challenges related to their interaction with bigger counterparts. For instance, suppliers of agricultural produce to bigger multinational buyers. Traditional competition law rules do not present effective solutions. Consider issues of abuse of superior bargaining power and abuse of buyer power.

● The studies might contain innovative and/or unique conclusions and recommendations, so the UN should consider the best ones for replicating or upscaling.

● The training exercises to improve knowledge

● The uniqueness of this project, time span and evolution was specially in terms of allowing us as project managers to bring in new ideas and try them out. I have done projects before and also tried to implement new ideas, but this project was a clean slate and a lot of room for innovation. it was challenging but very enlightening. Such room to introduce ideas should be considered in projects as opposed to straight jackets. In the spirit of the new normal, projects should evolve and fit with the times.

● The whole approach was innovative, enabling one stop shop for mechanisms and best practices towards post-Covid-19 resurgence of the MSME sector.

● the work dedicated to the analysis of structural barriers to trade was very relevant and helped to identify measures necessary for facilitation of exports. Specifically, conducting flash studies to maintain evidence-based feedback from MSMEs on barriers to trade and access to external markets is crucial, especially in the context of current supply chain deterioration context in ECA region caused by the war in Ukraine. Furthermore, the work dedicated to profiling of women-led MSMEs was insightful and helped to develop legal amendments supportive to women employability.

● UN Projects

111

● UN should consider upscaling the Empretec behavioural approach to entrepreneurship skills development due to its high impact on motivation and confidence of participants and success of their business ventures.

● Undertaking a needs analysis and developing programs based on the needs of the MSMEs

● Upscaling new starts ups and contribute to identifying new/improved measures to increase businesses

● Upscaling the development of investment attraction mechanisms for energy system

● Use of online platforms. It helps people in MSME sector to even participate whilst near work.

● Women entrepreneurship can be upscaled to more people living in rural areas.

● yes

● YES ; SDGs is my occupation professional

Since completion of the project 5. Please share examples on how you were able to use the knowledge or skills acquired through the project in

your work.

● Access to information in one place was important to me.

● Acquired the best practices to the use and reduction of pollution while maintaining high level of Production

● An important project that I worked on, I highlighted key issues that are vital for the MSMEs whereby we provided entrepreneurial training, business counselling support and access to credit facility which helped the business to survive during and past the COVID pandemic.

● As a hoúsewife and a farmer, The acquired knowledge is helping me

● As an import-export retail business that I'd like to develop, I haven't yet applied the acquired knowledge toward my business.

● as part of my consultancy activities and with my students, including public administration officials in vocational training

● Asesorias a pequñas empresas y personas fisicas empresarias, par dar cvumplimiento a sus obligaciones fiscales y de información financiera para la obtenión de financiamienmtos. Cumplimiento en disposiciones de actividades conm enfoque a la sustentabilidad y cuidados ecoplogicos.

● Aun no he realizado un proyecto percé que haya sustentado las capacitaciones pero si comparto los conocimientos

● Better appreciation of challenges of MSMEs in accessing markets and finance which I incorporated into my analysis of competition law cases.

● By explaining deeply for the people at work how opportunity is being ma(d)e use of effectively and efficiently.

● coming up with easy women’s problems in farms

● COMPLETION AND CAPACITY KNOWLEDGE GREEN TECHNOLOGIES

● Conducting surveys and interviews with entrepreneurs, especially in rural areas, gave a deeper understanding of the existing problems of small businesses.

● De várias formas, uma delas seria a busca de parcerias com outras órgãos e entidades para assistir as micro e pequenas empresas no processo de exportação

● Desde la academia, socializo los temas tratados y como se puede adoptar soluciones de otras latitudes, previa adaptación a nuestro entorno o país. En el ámbito de las consultorías damos a conocer a clientes que en su gran mayoría no solamente son pymes sino también empresas familiares, respecto a los desafíos, puntos de nivelación necesarias y oportunidades para la

112

exportación de sus productos. Esto de de vital importancia habida cuanta que estamos en una region tri nacional, conocida como las tres fronteras. Ciudad del Este, Paraguay; Foz de Iguazú, Brasil y Puerto Iguazú Argentina.

● Design and implementation of new courses for MSME about internationalization and digitalization in my country

● Diversification of business opportunity innovations

● education for sustainable development

● En mi trabajo mejoro mis criterios de aplicación de la normativa

● En mis proyectos de crecimiento empresarial.

● Establish priority policies for women-owned and female-intensive businesses and social enterprises

● For future errands

● Giving charities to the needy people

● Goal setting was one of my best Pec, after the training l set meaningful , reasonable and achievable goals, . My friend invited me to join and play an online that will pay double in 30 days but I remembered being taught how to take calculated risk, l turn it down only for the scheme to fail after two weeks, my business money remained intact because l apply what l learn.

● Health and safety should be our own responsibility

● I am developed with accounting method

● I attended training & workshops

● I have attended the training and applied through my independent business development consultancy assignments by providing further trainings, information, and advice

● I have been able to design andupscale my projects within the circular economy space

● I have learned to utilize the E-view and SPSS analytical tool in identifying policy trends and priorities in the MSME sector in The Gambia

● I have not.

● I incorporated the skills into my organisation policies to advance youth meaningful employment and community development

● I just established an NGO which focuses on Climate change

● I learnt on how to reach out to prospective clients through the use of technology such as phone and internet to advertise my small business using whatApps.

● I managed to access GIS software and intend to use it in agribusiness interventions.

● I managed to understand the key problems that arise in the supply chain of critical mineral raw materials during crisis situations (pandemics, etc.), especially in conditions when there is no uniformity in their available data (in terms of quantities, availability, import-export, needs, etc.).

● I see solutions in any problems or situations. And it has improved my working abilities

● I was able to protect my self from covid and help my family gain from my skill too

● Implementar protocolos de bioseguridad en las asociaciones o empresas

● Important to use skill acquired especially for women entrepreneurs and employees how easily converging can enable to get them credit , skill up gradation and special needs yet being in competitive world.

● Improved my appreciation of synergies and partnerships in development.

● Increased the level of communication using internet. More active collaboration with partners to create consortium and participate in new tenders in area we didn't participate before. Expand area of activities.

● Information sharing om border formalities

● Innovation and best practices

● Installed wifi in my village home using solar to ensure I continued working in spite of remote location and lack of electric grid

113

● Introducing net metering for PV Autoproducers

● It enabled me to go for computer training

● Like Business Development Service (BDS) Centre, all knowledge acquired through the project will continuously impact the delivery in terms of training for the capacity-building of MSME in Benin

● Looking for innovation to solve emerging society issues is a tool for success

● Material generated through the project was of sufficient interest to Member States that it resulted in multiple invitations to present the work at various forums, and this enhanced links between policymakers and the UN.

● Mothers in headhouse

● My contribution has been in Energy Sector ( SME)

● N/A

● No capital to invest on the knowledge

● None

● online course

● Only in small entities that need prepare financial statements to share to Banks.

● Our company benefited from testing and certification of Covid-19 related facial masks

● Por mi actividad profesional, revisamos información de varias actividades económicas y las divulgaciones de los efectos del covid no pueden ser generales, porque a unas actividades económicas la pandemia hizo crecer sus operaciones comerciales

● Programme development and management - applied the knowledge and skills gained in initiatives crafted for MSME development for nationwide implementation Mainstreaming sustainability principle - sustainability principles were embedded in several MSME development initiatives of the office, ensuring that environmental, social, and economic considerations are integrated into our frameworks.

● Propagation

● Report findings were publicly disseminated amongst Development Partners (via different modalities and platforms) and were subsequently incorporated into their project design. The key findings were included in the CCA while certain policy recommendations utilized to provide inputs for EU annual report.

● Roll-out new training material developed during the project and disseminated through ad-hoc online sessions to national counterparts

● Several included mechanisms were subsequently utilized on certain level in my work environment and daily activities, for example, available state support for the MSMEs.

● Shared as a best practice to other partners that we are working with and rallied the critical role of Cooperatives in formalization

● sharing my knowledge with women entrepreneurs to uplift their businesses..

● Support decision-makers in the country in the elaboration of initiatives, and measures for the development of female entrepreneurship.

● The analytical study generated policy recommendations, business operations, communication, and financing options that might be used in future work.

● The examples of businesses, how they adjusted to the situation gave me new ways of thinking how to improve during challenging times.

● The knowledge gain was highly considered helpful in the areas health emergencies and livelihood survival greatly & the should shared through the programme help migat

● The knowledge has been of great help in sourcing, grouping and keeping up with marketing. And secondly, it has greatly improved my view on record keeping.

● The ocean economy is not very well explored in my area. The ethnic groups have always avoided water out of cultural and spiritual reverence. My development programmes never included the ocean economy until after this project. I have started an awareness initiative that presents the ocean as a

114

possible and lucrative source of livelihood. I believe the initiative is making a breakthrough because locals (though still very few) are beginning to lodge application for fishing licenses to the authorities.

● The online training course was a good example to highlight . It was possible to gather participants in an area which has not been covered before., the link between competition and SME policies.

● The products developed correspond to useful tools when supporting MSMEs in specific areas, such as competition law and policy.

● The project provided references to us in supervising the partnership between MSME and large/medium companies.

● The study helped us refocus on the new needs of MSMEs

● Through training.

● To be able to conduct trainings online, has been my best rewarding experience.

● To teach students

● We are able to understand and tackle similar challenges in future as we are better informed. We are more resilient and adaptable than before.

● We have organized workshops in relation to the UNCTAD MSME project in Thailand both national and regional agencies.

● We organizing all of training and expos by online and conducting IT technology for our operations

● We used the skills learned in undertaking needs analysis to undertake a needs analysis for our capacity-building programs

● Women capacity-building is important to acquire skills through knowledge.

● Working with FAO and UNDP in developing National Horticulture and Agro Processing Strategies

● Yes onboarding some companies to ecommerce platform. This initiative was lead by my self through skilled gained in the training

6. What are the challenges, if any, in applying the knowledge or skills acquired through the project to your

work?

● Lack of support from the body at the end of the training. So the knowledge is not practicable in the wider market

● Some of the policy and technology that was discussed cannot be accessed locally

● Access to full process of the project

● Access to new suppliers was difficult, as they require higher quantities to be requested. Creation of association facilitated to solve the issue.

● Accessibility to the most under developed rural areas.

● ampliar el conocimiento y plasmarlo en proyectos factibles de acuerdo a la realidad de cada pais

● Application is always not easy at first but I pull through

● beyond an online evaluation like what is currently done here, set up an on-site follow-up programme after the training

● Budget constraints in implementing initiatives

● Business environment in my country with limitations for MSME

● Capacity-building, adequate financial support and mentoring

● Changing of focal points in government counterparts and partners

● Coming back to business after a long vacation is terable

● education for sustainable development

● Falta de conocimiento de terceros u a la vez creen que no sería necesario

● Few institutions/enterprises/decision-makers/experts contribute and facilitate sharing of good practices.

115

● Financial access

● finding buyers of the product

● For me about the job description in every profession

● For Thai MSMEs, it is required a number of knowledge and skills to confront the obstacles of doing business in the post Covid.

● Funding is the biggest challenge. I am unable to go as far as I wish to because even pitching a request for funding is time consuming with too many technical requirements.

● Get the community mindset on board

● Getting gadget to use especially on disabilities peoples

● Governments and professional colleagues are not interested.

● GREEN ECOMIE GREEN INDUSTRIAL PROCESS ...

● Healthy is our daily routine for every I our capacity-building

● If skill training will not be available.

● Information availability, financing models

● Insufficient guidance and strategic planning by senior management.

● It was a unique situation, people were in finding difficult to normal the new social behaviour as results of covid nigh

● It's still premature to outline any challenges.

● lack of funds to be able to reach out to all of the entrepreneurs.

● Lack of infrastructure & unskilled people merged to work with me slow down the job

● Limited country data availability to conduct analysis for effective policy decision-making process

● Limited resource envelope and lack of practical skills.

● Limited resource in undertaking effective surveys that will be used to guide a programme design

● Limited resources

● Limited resources and skills to implement strategies to the full capacity

● Logistics

● Los cambios bruscos que se tienen que efectuar para atender oportunamente este tipo de eventualidades de acuerdo con las necesidades de las empresas

● Los retos es cambiar la manera de hacer el trabajo aplicando los lineamientos de la niif para pymes

● Low competencies of SMMEs in adopting new technologies for attaining quick recovery from the effects of the Pandemic. Many SMMEs still look up to Government for support.

● Mainly the biggest challenge is the financial aspect of new startups.

● Master the tools

● N/A

● Need of repository of country-wise concessions or hand holding for MSMEs at one place

● No challenges

● No difficulties

● no problem

● Non

● None

● None so far.

● None.

● Not accessed

● not really

● Not yet

116

● O maior desafio seria a criação de um ambiente colaborativo para oa implementação de políticas públicas voltadas ao incentivo das exportações para micro e pequenas empresas

● One challenge was to promptly adjust the lab equipment and train staff for testing medical facial masks

● Opportunity seeking and taking initiative, l have seen an opportunity l would have taken the initiative but financial challenge caused a set back.

● Our governments intervention about policies

● project didn’t finish

● Que sea útil en la toma de decisiones.

● Resources to reach more traders on how they can do business the time of COVID -19.

● Societies of womens

● Some business shuttered when the COVID hit the world.

● Subsidies process

● Technical and financial capacity limitations

● Technical facilities

● The biggest challenge was persuading respondents to provide factual data and answer the questionnaire.

● The challenge is we raised high expectations from our member states to do activities together and with no funds for the continuation of the work, it is frustrating both ways.

● The challenge was to classify critical raw materials in a uniform and recognizable way through the realization of the project and make an assessment regarding their availability and needs for the health sector, which was realized most often in conditions of insufficient available data.

● The challenges are coordination and synergies amongst relevant agencies/entities.

● The cost of internet charges is currently high in my home country. high internet intermittent or rather bad internet signal.

● The main challenge concerns the establishment of strong partnership for the funding to support the delivery of EMPRETEC programme in developing countries

● The only challenge derives from the very specific focus of the work programme I coordinate, which doesn’t necessarily allow for extensively addressing general and broad MSMEs challenges.

● The only challenge is funds.

● The policy recommendations were not costed that creates difficulty in promoting their implementation amongst UN agencies or other development partners.

● Their uselessness

● Total y plenamente posible desde el ámbito académico estoy proponiendo temas que hacen a la necesidad de la potenciación de las pymes, desde sus digitalización, formalización y actualización en temas claves para fomentar la exportación. Y desde el ámbito de la consultoría y desde la cámara de empresarios de Ciudad del Este y Alto Paraná estamos promoviendo un Diplomado en Comercio Exterior dirigido a empresarios pymes y empresas familiares.

● Training Ministries, Agencies and Regulatory bodies

● Trasmitir adecuadamente los conceptos de sustentabilidad.

● We have been able to apply the knowledge.

7. Please share examples, if any, of how the project included or supported women, youth, people with disabilities or other vulnerable groups.

● Accounting and budges

117

● All projects that will be implemented has to include Gender and Development (GAD) and must be inclusive.

● All socially and economically advantaged groupings such as the women have encouraged to form cooperatives and access funds constituency development funds to alleviation and improve their welfare.

● By spreading the information to people in need of it.

● CIRCULAR ECONOMIE OF RECYCLE WASTE SOLID

● Community project on understanding the need for non pharmaceutical adherence practice.., proper information about the viral nature, the strains ,transmission of covid and also fight disinformation due to lack of information.

● Como complemento a la mirada exportadora y desarrollo digital de las pymes, también impulsamos y socializamos los criterios de sostenibilidad con triple impacto: económico, social y ambiental, como política de las empresas privadas y dentro del mismo se enfatiza la oportunidad inclusiva para mujeres, jóvenes, y personas con discapacidad, u otros grupos vulnerables.

● conscientization in education for sustainable development (SDG5 , SDG10)

● Differently able were able to seek required skills and seek for sustainable employment.

● Diversification of business opportunity innovations

● Door to door activities, service was brough close to people and hence elder and disable women and girls and men were able to access it

● Empowerment

● Enhanced business models and resilience

● gender equality in panel discussions inclusion of gender dimension in report

● Have no detailed information

● Humanity and responsibility

● I don't know because I can see any positive update on us

● Iam vice chairperson and cofounder of Autism Rwanda so here I tried to educate women's and men's in this organization how to use devices for people with disabilities

● I'm looking forward to get disabled volunteers and include the in creating a clean society

● In Benin the selection of the beneficiaries includes creterias which has eased the inclusion of women, youth and other vulnerable groups

● In rural surveys and surveys, more than 50% of the building materials trade is run by women

● It increased the level of knowledge

● It was important to invite women-in-bussness in our activities . A PhD student used our output to finalize a thesis of women in finance, in Moldova.

● knowledge and technical skills

● La invitación fue generalizada, sin condicionar condiciones.

● N/A

● NA

● New tools to support to MSME owned by women

● No aplica

● No los hubo.

● No tengo conocimiento cuantas mujeres incluyo

● None

● Not in my cooperative sector

● not really

● One of key targets of the project was to ensure at least 30% of women participation.

● Our testing lab for testing and certification of medical facial masks included female staff

118

● Over 50 per cent of participants in activities supported by this project are women

● Participation

● Personally as a woman, l was really empowered, l saw myself as a redefined entrepreneur, l had become more efficient in my work

● Por la pandemia y la falta de movilización libre, propicio innovar estos medios de divulgación que facilitó la divulgación de esté tipo de información

● Priority will be given to support first and the level of support will be higher than that of a regular business

● Project participants got starter packs and were able to uplift their livelihoods.

● Project supported women, youth and vulnerable families by promoting EE/RES

● Proyectos privados con PERU LNG en Peru se viene ejecutando productos productivos y con nuevas propuestas para mejorar la comercializacion y articulacion

● Research on women's entrepreneurship enabled policymakers and ministerial staff in Member States to have a better understanding of how support given to women in business pays off.

● Still doing researches on that

● The innovative aspects of doing things was the best part of the training, with Data your market will sell.

● the necessary trainings given to them are useful to them

● The project conducted various capacity and skills training activities were beneficiaries mainly targeted women, youth and vulnerable groups.

● The project had a gender component.

● The project included an analysis of women's participation in "Small and Medium Enterprises" projects, which were represented both in the field of critical raw materials and the supply chain during Covid-19, and which are expected in the post-Covid -19 period. This analysis was evaluated very positively.

● The project included and looked at those target groups and can be a starting point for some more detailed activities

● the project produced analytical piece on the impact of Covid-19 on trade and business development prospects of women-led companies which fed into subsequent policy action adopted by the Government in relation to childcare as a part of women empowerment and employability.

● The project was supported for the women and youth through capacity-building training

● The project would also cover on areas of " COVID-19 Seed recovery for women and Youth"

● The said group had been able to get access to entrepreneurship training and access to credit facility.

● The survey sampled enterprises from women, youth and PWDs

● There was a deliberate effort to include women and youth among the participants

● There were Covid Relief funds disbursed to women and youth MSMEs to cushion them during the crisis. In Kenya for example the group WomenWork in partnership with Kenya Chamber of Commerce and 4G capital ensured we got the funds directly to our phones through mobile money.

● There were specific trainings targeting women entrepreneurs of developing countries in East Africa, which understood that these MSMEs also needed to shift from informal trading to formal businesses.

● these people are highlighted in the recommendations made but the implementation is up to the government

● Through knowledge sharing seminars and workshops

● Training of women entrepreneurs in Malaysia/ Empretec training in the context of Cross-border trade activities/Training on Farming as business/E-Regulation platforms allowing for formalisation of informal sector.

● Upskilling of youth and women businesses

● Use of sign language

119

● We do have a success story from a woman from Zimbabwe who participated in the online course: see her story. link here. https://unctad.org/news/how-make-small-businesses-developing-countries- more-competitive

● we have not any special project

● While my farming project supports mostly women and youth, the new initiative is more popular among men.

● Women Empowerment

● Women, youth, people with disabilities are we support them

Results of the project 8. To what extent do you agree with the following statements?

Outcome 1A Strongly agree

Agree Somewhat

agree Somewhat

disagree Disagree

Strongly disagree

Do not know

Total

The project contributed to formulating and implement enabling policies on green, resilient and inclusive entrepreneurship for MSME promotion in post COVID-19 resurgence

32% 39% 15% 10% 2% 0% 2% 41

Outcome 1B Strongly agree

Agree Somewhat

agree Somewhat

disagree Disagree

Strongly disagree

Do not know

Total

The project activities contributed to expanding my business venture or to starting a new business

15% 42% 18% 0% 12% 0% 12% 33

The project supported my business by increasing sales

15% 27% 24% 3% 12% 3% 15% 33

The project activities contributed to the creation of new jobs

18% 39% 21% 3% 12% 0% 6% 33

Outcome 2 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project contributed to facilitating MSME registration and formalization

100% 0% 0% 0% 0% 0% 0% 3

The project activities contributed to decreasing the administrative costs of starting a business

0% 100% 0% 0% 0% 0% 0% 2

The project contributed to increasing the number of businesses registering

50% 0% 50% 0% 0% 0% 0% 2

120

Outcome 3 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project contributed to improving financial inclusion and MSMEs access to finance

11% 44% 33% 11% 0% 0% 0% 9

Outcome 4 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project activities contributed to increasing MSMEs access to innovation and technology

27% 45% 27% 0% 0% 0% 0% 11

Outcome 5 Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project contributed to new/improved measures on consumer protection and competition

11% 33% 56% 0% 0% 0% 0% 9

The project contributed towards new/improved measures on agricultural quality and food loss reduction

13% 25% 50% 0% 0% 0% 13% 8

The project contributed to increase MSMEs access to markets, including export and integration into value chains

13% 63% 25% 0% 0% 0% 0% 8

8-B. To what extent do you agree with the following statements?

Strongly agree Agree Somewhat

agree Somewhat

disagree Disagree Strongly disagree

Do not know Total

The project contributed to improving the resilience and competitiveness of MSMEs in post-COVID-19 resurgence

38% 35% 16% 4% 3% 2% 3% 106

The project contributed to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups

32% 32% 28% 2% 3% 0% 3% 105

121

9. Please share any examples of how the project has contributed to the resurgence of MSMEs, policy or

economic improvements, or advancing sustainable development in your country.

● A través del sistema de registro, importante para conocer cómo se desarrollan económicamente las

empresas.

● Access to finance and creation of programs so that MSMEs pivoted to continue with their operations.

● After that , Most policies at work has aspects protection and awareness

● As always in Armenia nothing ever helps.

● By applying the knowledge acquired

37%

35%

16%

4% 3% 2%

3%

The project contributed to improve the resilience and competitiveness of MSMEs in post COVID-19 resurgence

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

32%

32%

28%

2%

3% 0%

3%

The project contributed to better outcomes for women and youth entrepreneurs and other vulnerable and marginalized groups

Strongly agree

Agree

Somewhat agree

Somewhat disagree

Disagree

Strongly disagree

Do not know

122

● By developing good guidelines for MSMEs to assure resilience and progress towards a circular economy in sustainable resources management and critical raw material supply chain solutions.

● By touching the concern people.

● City of Harare developed a MSMEs policy which now recognize the importance of informal sector and has included use of technology as one of the building blocks.

● Con éste tipo de proyectos apoyados por la ONU, desarrollados por especialistas son de mucha ayuda para los que quieran y estén interesados para aplicarlos en beneficio de las actividades económicas de mi pais

● conscientization in education sustainable development in companies

● Diversification of business opportunity innovations especially into Renewable energy

● Economic improvements through Income generating activities

● El proyecto desde mi percepción, lo que ha logrado es aportar herramientas de singular importancia para el fortalecimiento de las empresas que han sobrevivido a la pandemia, a entender mejor los dolores del mercado, y las oportunidades y barreras para la exportación.

● Empowerment

● En mi trabajo no tengo acceso para poder dar un ejemplo

● GREEN JOBS. GREEN TECHOLOGIES

● I don't know

● I joined the project as a freelance development practitioner, and was not commissioned by my government. I don't think any representative from my country joined the project. However, I do engage in multi stakeholder forums, workshops and conferences where I make a point of raising issues of SMME resilience for inclusive development.

● In my country, I see a lot of businesses are moving into trading online, thus increasing their market.

● influenced Thai SME policy and national strategic plan

● it contributed with easier access to supporting mechanisms, as well as tailored guidelines by country for the MSMEs in order to overcome all challenges from the new environment caused by the pandemic.

● It's really improved the small through new methods of engagement using available technology and innovations to drive market ...also in the areas of supply chain innovation to deliver goods and services

● logistic service is more developed

● Maybe for those who are already in business

● mejorar los ingresos economicos de las familias, contar con capital, mejorar los costos de produccion

● More recently in my country Kenya, various funding opportunities are now available to MSMEs through the convenience of mobile phone. This includes the Women Enterprise Fund, the Hustler Fund, and Group loans. Grant Managers such as the KCIC Group have ensured sustainable development in our country by promoting and funding sustainable projects throughout the country.

● MSME is going to be back bone for developing economies. Focus on policies to encourage them especially guide them to explore eCommerce advantages

● MSMEs started using e-commerce and this lead the development of digitalization and consequently facilitate business operations

● Muchos mipymes se reinventarse y a la vez entendieron la importancia de que hay que estar preparados ante cualquier eventualidad, no sobrevive el más sabio u cauteloso, sino quien tenga una idea innovadora , la desarrolle y sepa como llegar al consumidor

● My appreciation of MSME challenges in markets contributed to effective enforcement. We were able to progress complaints faster and also require large buyers to review oppressive contracts to support sustainability of their MSME suppliers.

● N/A

123

● na

● New skills were mastered in the conditions of the pandemic, and certain types of risks of natural disasters and pandemics began to be considered in a valid way, which also influenced the introduction of new jobs for developing and solving this problem.

● No comment

● Not reached affected communities

● Not yet

● Only in cases the entity has the obligation to prepare financial statements to acces to loan in a local bank.

● Our government poor credit methods

● our project was a good example for resurgence MSME, after that, we will prepare for the future the sustainable strategy for vulnerable groups.

● Project allowed for distribution of fiscal incentives through e-Regulation platform El Salvador. EPF strategies developed for beneficiary countries and recommendations on implementations included measures specifically oriented towards MSME rsurgence

● Promoting olive biomass pomace for heating and hot water energy demand

● Relevant

● Revamping the Waste management system through collaboration with government in the sanitation of the environment in Calabar, Nigeria.

● Se logro la reorentacion operativa de PYME al establecer politicas decontratación depersonal

● Several online events were organized to share success stories of Empretec participants during COVID 19 restrictions which raised awareness of others on business opportunities during the pandemic.

● sharing knowledge

● so far there is no significant contribution however sensitization to the communities and to companies that have great impact on the green technology were the targets for training how they can contribute towards the climate emission

● Some traders they have knowledge on how to control resources for business and looking ways on how to find start-up Capital

● Still doing research on that

● successful project to put up

● The country shifted from somewhat backward thinking and started to focus on ideas that will positively impact the society more especially in the rural areas

● The focus of the project was to support MSMEs to overcome the constraints enhanced by the pandemic, so enhancing resilience in a sustainable manner was a constant goal.

● The Ministry of Agriculture is coordinating National strategies meant to empower farmers towards sustainable production and sustainable Value Chain Development. Women, Youth and People with disability are being supported to ensure NO ONE IS LEFT BEHIND

● The outcomes of the conducted studies helped to develop policy recommendations provided to the government in support of economic improvements and advancing sustainable development of the country.

● The partnership involved the Microsoft Small Enterprise Authority of Kenya and hence got practical feedback from the study

● The project enabled better access to information and contributed to the increase in the number of MSMEs

● The project had a positive impact on MSMEs, there were a lot of job creations reported.

● The project has trained entrepreneurs to be more efficient and confident in their work thereby contributing to economic development

● The project jobs The project activities contributed to the creation of new jobs Strongly agree The project activities contributed to the creation of new jobs Agree The project activities contributed to

124

the creation of new jobs Somewhat agree The project activities contributed to the creation of new jobs Somewhat disagree The project activities contributed to the creation of new jobs Disagree The project activities contributed to the creation of new jobs Strongly disagree The project activities contributed to the creation of new jobs also the project contributed to improve the resilience and competitiveness of MSMEs in post COVID-19 resurgence here in Rwanda

● The project revealed challenges faced by women-led MSMEs which subsequently were complemented by development of gender-based assessment jointly with the WBG. Furthermore, challenges faced by women in terms of access to ECD facilities (which became more acute during the pandemic lockdown) were addressed by the GoM policy on regulating the ECD facilities in private sector that contribute to women's economic empowerment and employability through regulation of establishment of creches and kindergartens under private companies employing young women with children, as well as facilitating expansion of private and public ECD facilities as one of the measures supportive of women labour participation.

● The project strengthens youth and women's employment opportunities, therefore, improving economic and community development.

● The project supported a Policy Implementation Forum: Supporting Micro Small and Medium Size Enterprises (MSMEs) in the Post COVID-19 Pandemic Era - Promoting MSME Formalization This event was jointly organised by DSDG/DESA and the Ministry of Trade, Industry, Regional Integration and Employment (MoTIE) of The Gambia and the UNDP. It brought together high-level policymakers and development partners to review challenges and identify solutions supporting the growth of the MSME sector in The Gambia in the post-COVID-19 pandemic era, taking into account opportunities offered by the African Continental Free Trade Agreement (AfCFTA).

● The results were widely distributed to National stakeholders, some concrete actions were implemented by ODIMM Moldova by launching new support schemes for MSME..

● The SDG’s are simply seen as fancy paperwork that yields funds, without any concrete plans on how to implement them…. Nigeria

● The training opened the eyes of the participants to the potential of MSMEs especially through leveraging ICTs

● there is a lot of development in my country as many businesses were in the verge of closing up during covid but thanks to the project, they survived.

● Through this project the government of the Republic of Zambia under the ministry of small and medium enterprises has greatly improved women participation in business activities through various coorporatives

● to support women with disabilities, students are mobilizing with companies and individuals to collect small equipment such as a sewing machine, knitting needles and balls of wool, raffia etc so that these women can start producing and selling fashion or decorative clothing and accessories

● we establish comprehensive business policies that prioritize women-owned businesses, female- intensive businesses and social enterprises

● Womens inclusive in polca, and governement

Looking forward 10. Are there other ways in which you think the UN could support the MSMEs sector in your country?

● I have a startup business in agricultural exports.

● Physical training and accelerator programme would be good

● 1. conducting relevant trainings on the implementation of MSME sector in the country. 2. development and sending of press releases on the report to government agencies.

● Access to finance for MSME, increase to financing resource

125

● Access to finance that may serve as post-training support for MSMEs

● be closer to local reality beyond best practices because there is no one best way but all depends

● Building the capability of BSOs, especially where the function of trade has devolved to regions, provinces and even lower forums. The Federal bodies in Pakistan are no longer representative of the MSMEs, especially no support for sectoral specialization.

● By establishing a zero-rated network programme that connects entrepreneurs with their immediate market/community, linked to other up to the international community

● By Funding Start up organizations and continue to provide classes for quality results.

● By provide some seed money

● By providing various training on how to manage businesses

● By sending technological tools

● By sharing knowledge and capacity development

● Collaborate with national governments to promote the implementation of best practices, in particular, to disseminate best practices in the development of the MSME sector.

● Conducting specific trainings in the field of financing and access to the market

● Considero que si dándole seguimiento con mas capacitaciones para ampliar esos criterios

● Continue supporting and mentoring MSMEs

● Design and develop policies for businesses in specific industries

● Developing BDS services/Facilitating business through e-tools/allowing for smooth implementation of new sustainability reporting standards introduced by ISSB.

● Direct engagement with private sector and capacity-building of private in promoting good governance

● Ejemplificando mas la información tomando como base la actividad económica para que sea comparable la información y poder medir el impacto en nuestro pais

● Enlightenment and also empowerment

● Grassroots propagation

● Ground -top approach which will break and limits the barriers of state bureaucracy and other means of engaging the people ..who will be directly affected

● I don't know.

● I hope to continue the indicative

● implementation of pilot projects with training and financial support for rural businesses

● In addition to training, the project could invite MSMEs to submit proposals for financial support so that there is a more practical element to the training

● In collaboration with UNCT to develop an agile policy paper that would highlight short- and long term measures necessary to stimulate economic growth (and improvement of livelihoods) amidst regional war-related crises and trade disruptions.

● In Moldova, a majority of micro, small, and medium enterprises (MSMEs) owned and led by women operate without access to resources and benefits. Assistance could be provided to the ministries and, agencies and to the Secretariat of the Prime Minister on the development of policies and initiatives in support of entrepreneurship, especially for women, youth, and the elderly, of digital finance solutions, transition to sustainable trade and a circular economy.

● Increase support to improve the business environment as well as to reduce the cost of doing business, including: A. Access to finance/capital/credit B. Support the establishment of the Single Window Business Registration (e-services) for countrywide coverage C. Improve the quality of infrastructure for product development and trade D. Support the development and improvement of business environment-related infrastructures etc.

● Information Dissemination

● more financing for the conscientization in the education for sustainable development

126

● More funding opportunities are required to meet the demand especially with the economic crises being witnessed. Do not tire in doing good.

● More targeted activities or studies, specified to certain issues/challenges on MSMEs will be helpful.

● MSMEs need continuous training to enhance their knowledge and skills and to face new challenges: there should be annual courses on a wide range of issues for their update.

● n/a

● na

● New webinars or courses about the key issues for MSME

● Not specific to UN, but the MSMEs in my country are one sector that needs support in many areas. For example, in my view, they need support on energy planning and management - eg more awareness to energy audits, awareness of the possibilities to improve, utilisation of RES, how the energy influence the price of their service/product etc.

● Project Funding for the ongoing UNDP Supplier Development Programme in Botswana. More MSMEs to be capacitated to be part of the Government and Private sector Supply Chain.

● Provide direct capacity-building support to MSME entrepreneurs, with priorities given to women, youth and groups in vulnerable situations; focusing more on the effective implementation of MSME supporting policies in line with demands of MSME entrepreneurs, instead of supporting the formulation of policies themselves

● Provide support in developing MSME friendly policies, complement government resources through financial and technical support

● Publicizing the work of our entrepreneurs internationally

● purchasing women innovations

● Si

● Si por supuesto. Es una figura de autoridad y relevancia, por lo que genera interés en participar.

● Si, compartiendo información de PYMES que requieran asesorias, en caso de contar con alguna estadistica relacionada.

● si, con apoyo de ONG, instituciones privadas y otros

● Sim.

● soft loans and more accessible training publicity

● Support in establishing technology and innovation hubs, centers, and incubations for youth, women and disabled persons

● The UN would support the women and youth on Start-up capital, cross border traders lost thier capitals during the COVID-19 because of movement restriction and there was no business at all.

● There is a little support

● Through capacity-building

● Through capacity-building and mentoring projects.

● Through direct training of personnel on concrete examples, but including personnel in government sectors where, in accordance with procedures, the relevant issues are dealt with and where there are "fully trained and qualified professional workforce", in order to improve the effectiveness and efficiency of their work and fully realize the principles of sustainable development in the shortest period.

● Through organised registered cooperatives

● To open more international trading opportunities (business linkages)

● To provide grants and access to credit facility. To provide vocational training and value chain training.

● To support the underserved people MSMEs and marginalized communities' economic growth, the UN should collaborate with grassroots NGOs that promote employment and community development. The local NGOs are closer to the people and understand their challenges.

● Totalmente, a más de los programas que ya tienen desarrollado para aplicar, considero que la vía de llamados a proyectos de co creación, con amplia participación de los actores de cada región del

127

pais, es de fundamental importancia. Pues solo con el involucramiento participativo de los actores de cada región geográfica es posible generar confianza, luego adherencia al proyecto y finalmente sentirse orgullosos de los logros del trabajo en equipo, participativo, que no solo busca el resurgimiento de las pymes, sino que además siembre la cultura de sostenibilidad en línea con los ODS, y la cultura de la legalidad mitigando los casos de corrupción e impunidad, a través de las buenas prácticas empresariales y personales como ciudadanos. Me suscribo para emprender y caminar este sendero de la mano de ustedes. Considero que el llamado a presentar proyectos de co creación es el camino correcto e infalible.

● UN can do more on business development services, including as a follow and complementary to behavioural methodology of the Empretec programme. More efforts could be done to bring together and coordinate MSME related policies and activities of different agencies at a national level.

● UN should develop core team to discuss with developing economies countries the best practices across glove for MS ME and help them to have online real time repository of MSMEs, their issues and resolution mechanisms. UN can support this activity.

● work more with chambers of commerce

● yeah UN should allow local national and INGO to acquire small funding instead and support accept taking risk organization if the country wants move together localization agenda.

● Yes

● Yes

● Yes This is because the COVID-19 affected a lot of MSMEs especially we at the northern part of Ghana

● Yes by presenting international benchmarks for EE/RES through workshops and supporting countries for secondary legislation for EE/RES

● Yes keep training members of MSMES

● yes there are many 1.funding 2.couching after trainings will be useful. 3.capacity-building 4. study tours to learn from other countries.

● Yes through the trainings and expertise availability for the better and proper enforcement and participation of the policies

● Yes through training in entrepreneurship.

● Yes,

● Yes, because most of us were train without finding so we plead that next time small Grant be given for a start up

● Yes, in the universities

● Yes, Kenya. A review to establish how public policy and competition policies support or create challenges to MSME competitiveness and sustainability.

● Yes, most beneficial of this coordinators don't lodge the beneficiary account. I am on opinion that individual account should be credited direct. Because I didn't benefit from the programme too

● Yes, pick up from the recommendations of the project and and start engagements with stakeholders that promote and develop the MSE sector such as the Micro and Small Enterprise Authority in Kenya

● Yes, targeted resources for capacity-building and training on how such models as cooperatives can be suitable vehicles for formalization.

● Yes. Huge amount of options. Starting with eliminating useless jobs that we have in local UN. Some projects has admin costs that never have given any result.

● Yes. It's necessary to give stability to the incubators. And may be that UN can promote and support that initiative face the government

● Yes. Using technologies requires not only capacity. Resources are needed to purchase the necessary gadgets. On top of this, piloting a project in the country can increase replication potential if results are positive. Learnings and practice can help shape policy at national level. If UN can fund a pilot project where learnings are generated, that is ideal in Zimbabwe.

128

Final questions 11. In what type of organization do you work?

Type of organisation Total

Government 28

Micro, Small or Medium Enterprise (MSME) 17

Other private sector, Business or industry association, Commercial Registry Office 20

Other (please specify) 43

Other (please specify)

● Academe

● Academe

● Academic

● Association

● CAD Internazionale ● Centro de Estudios Tecnología e Investigación: Es una consultora privada pero vinculada a temas

de investigación con la Universidad Católica

● Consulting Company

● CONTADOR PUBLICO INDEPENDIENTE

● Cooperative Development

● Cooperatives

● EMPRETEC CENTRE

● Farmer ● Former civil servant of the Ministry and now retired and independent consultant in the Mining

sector

● Former Head of Branch at UNCTAD responsible for this project until 1 May 2021

● H

● Have worked in sector now advisory role

● I am a Business Advisor

● Independent business development consultant

● INGO

● International NGO working in Sustainable Development

● International Organisation

● International organisation

● International Organization

● International Organization

● International organization

● ITC

● NGO

● NGO /Expert

● None

● Nongovernmental Organization

● Public University

● Research institution

● SOCIOLOGIST in OR at FRANCE

129

● Think tank

● UN

● Un

● UN

● UN

● UN agencies

● UNDP

● United Nations

● United Nations entities

● University 12. What country do you represent?

Country Total

Albania 2

Armenia 3

Bangladesh 1

Bhutan 1

Botswana 1

Brazil 2

Burkina Faso 1

Cameroon 1

Colombia 1

Dominican Republic 1

El Salvador 2

Ethiopia 2

France 1

Gambia 3

Germany 1

Ghana 1

Guatemala 2

Honduras 1

India 2

Indonesia 1

Italy 1

Kenya 7

Kyrgyzstan 1

Lesotho 3

Macedonia 2

Madagascar 2

Malawi 1

Mexico 2

Moldova 3

Mongolia 1

130

Namibia 1

Nigeria 10

Pakistan 1

Paraguay 1

Peru 2

Philippines 5

Rwanda 2

Senegal 1

Serbia 2

Somalia 1

South Africa 3

South Sudan 1

Swaziland 1

Sweden 1

Tajikistan 1

Thailand 3

Togo 1

Uruguay 1

USA 2

Venezuela 1

Vietnam 1

Zambia 3

Zimbabwe 3

Total 101 13. What is your gender?

Gender Total

Female 42

Male 62

Other/Prefer not to say 1

Total 105 14. Do you identify as part of any of the following groups?

Type of vulnerable group Total

Youth 30

Indigenous 17

LGBTQ+ 0

Person with disabilities 2

Survivor of violence (domestic, gender-based, other) 2

Other vulnerable group (please specify) 24

131

Other vulnerable group (please specify)

● Above youth 1

● Academic 1

● Adilts 1

● Adulto mayor 1

● Adulto maytor 1

● Cross Border Traders 1

● Estado con alto índice de marginalidad económica y tecnológica. Oaxaca, México. 1

● Executive 1

● Grassroots women 1

● N/A 1

● NA 1

● No 4

● Non of the above 1

● None 2

● Pashtun Ethnic Minority 1

● People living with facial palsy 1

● Previously disadvantaged individual 1

● SIMPLE CITIZEN 1

● Single Mother 1

● Smallholder farmer 1 15. Are there any final comments that you would like to share about the project to help inform this

evaluation?

● A well curated and well executed project. We hope to have more opportunities like this.

● Agradecer al proyecto por habernos incluido

● Any

● Continue the good work.

● Does it matter? Have you ever considered anything said? Nope? What a surprise.

● en Uruguay para acceder a financiamientos se requiere información contable de acuerdo a NIC. La iniciativa es muy buena para que el microempresario cuantifique resultados u ordene sus finanzas internamente , pero a nivel país debe regirse por régimen reglamentado gracias por la generosa oportunidad que me brindaron y el excelente trabajo desarrollado

● Great programme it was

● I am hosting regular talks and training workshops and would be delighted to have a speaker from your office, and hopefully even a collaboration

● I enjoyed managing the project.

● I really need a financial support to support my MSMEs in the northern part of Ghana. Majority of their businesses have collapsed and it is making cost of living very difficult.

● I think everything is good

● In my opinion, in the implementation of UN projects, the majority of experts who could be engaged or active are not too interested in directly participating (lack of general knowledge, language, personal - direct engagement, somewhat weaker departmental communication in the state and private sector, etc.), which ultimately (in my opinion) affects the level of quality and the final design of the project.

● Is a good information for me

132

● It would be helpful for us if we are able to make partnership with UN Women or any UN agency.

● Keeping in touch with MSMEs

● Let's the poor BREATHE

● Many thanks and keep up the good work....while improving lives

● Many thanks for supporting for this work

● Me encantó la experiencia.

● Me ha gustado la capacitación, tal vez en otras similares se podría trabajar también con espacios de ILab, aplicando Productos Mínimos Viables, a través de interacciones de los participantes de diferentes países. Otra sugerencia es que puedan dar espacios para fortalecer los temas aprendidos en los 3 cursos con becas de CEPAL, generando llamados a proyectos de co creación en donde los participantes de los cursos puedan conseguir mayor permeabilidad respecto a los temas aprendidos, y así generar la sinergia necesaria con recursos y presencia de marca de ustedes. Todo lo aprendido puede complementarse con el uso de herramientas AGILE, y aplicando tecnologías de bajo costo y alto impacto para permear en forma sinérgica al campo o regiones de toda la riqueza aprendida en los 3 cursos.

● more successes

● More training The evaluation should not take a longtime to come evaluators to avoid the risk of forgetting the content

● N/A

● NA

● No

● None

● None

● Not really

● Not sure

● Personalmente agradezco por tomarme en cuenta para esta escuesta

● possibility of collaboration

● Share the project

● Thank you for the opportunity to participate in the training, and for the follow up

● Thanks for considering sharing the survey to get my feedback

● Thanks for the opportunity

● Thanks for the survey.

● Thanks for this program

● That all

● The project and upcoming successors should be of long-term with possible long-term financing to support infrastructure development, Capital funding support and long-term Capacity-building activities.

● the project helped to reveal real problems for small businesses and develop recommendations for overcoming them

● The project was a great opportunity to promote and support the MSME sector and Empretec network during COVID 19. Wish there were more projects like this one.

● The project was pro-poor and appropriate.

● The project would also cover on areas of sustainability, institutional support for continuety of the project, supporting material and equipment.

● The projection should initiate inclusive capacity-building's courses / sessions within regions and/or grassroot communities.

● The UN should incorporate NGOs into the project for fruitful outcomes.

133

● There are lots of information to share with you but it is confidential, that is one on one.

● This is a wonderful initiative, please continue with it as it sparks the slumbering creativity to some of us. Also, it shaping the communities to be better

● This project should deal with the individual groups not there heads by so doing you are dealing with this group of people directly

● Those trainings should be conducted in-person or hybrid inorder to make them more interactive, focused and effective

● training of smses

● Unicamente agradecer el apoyo que brindan

134

Annex 7: Evaluation Terms of Reference

Evaluation of the United Nations Development Account 12th tranche “Global Initiative towards post-Covid-19 resurgence of the MSME sector” (2023W)

TERMS OF REFERENCE

A. BACKGROUND A1. ABOUT THE DEVELOPMENT ACCOUNT

The Development Account (DA) is a mechanism to fund capacity development projects of the 10 economic and social entities of the United Nations Secretariat, namely: the Department of Economic and Social Affairs (DESA), the Economic Commission for Africa (ECA), the Economic Commission for Europe (ECE), the Economic and Social Commission for Asia and the Pacific (ESCAP), the Economic and Social Commission for Western Asia (ESCWA), the Economic Commission for Latin America and the Caribbean (ECLAC), the United Nations Conference on Trade and Development (UNCTAD), the United Nations Environment Project (UNEP), the United Nations Human Settlements Project (UN-Habitat) and the United Nations Office on Drugs and Crime (UNODC).

The DA provides capacity development support to developing countries in their implementation of the 2030 Agenda for Sustainable Development, as well as recommendations and decisions made in intergovernmental processes and relevant governing bodies. The DA-funded projects build on the mandates, individual technical capacities and comparative advantages of the respective implementing entities, while providing those mostly non-resident entities with the ability to operationalize their knowledge and know-how to deliver capacity development support at regional, sub-regional and country levels.

The Under-Secretary-General (USG) for Economic and Social Affairs is designated as the Project Manager of the Development Account with responsibility for overall coordination, programming, monitoring and evaluation, as well as for reporting to the intergovernmental bodies. The Project Manager is supported by the DA Steering Committee, who advises him/her on strategic policy and project-support matters.166 The Project Manager is also supported by the DA Project Management Team (DA-PMT) located within the Capacity Development Programme Management Office (CDPMO) of DESA, which assists with all aspects of the management of the DA, in particular with regard to programming, monitoring, evaluation and reporting. DA-PMT also liaises with the DA Focal Points in the implementing entities, who are most often the head of the entity’s unit responsible for project planning, project management, capacity development or technical cooperation, on all aspects of the management of DA-funded projects.

In response to the COVID-19 crisis, the Development Account has funded five short-term joint projects to help developing countries alleviate the socio-economic impact of the pandemic, including the project on Global initiative towards post-COVID-19 resurgence of the MSME sector (2023W).

A2. ABOUT THE PROJECT

166 The DA Steering Committee is composed of five members with one member representing each of the following implementing entities and key stakeholders: 1. DESA; 2. the regional commissions; 3. UNCTAD; 4. UNEP, UN-Habitat and UNODC (on a rotational basis); and 5. the Programme Planning and Budget Division (PPBD) of the Office of Programme Planning, Finance and Budget of the Department of Management Strategy, Policy and Compliance.

135

The COVID-19 crisis is plunging the global economy into a deep recession and micro, small and medium enterprises – which play a major role in emerging economies – are amongst the hardest hit. Trapped in economic stagnation due to large-scale lockdowns, millions of MSMEs have become the most vulnerable to COVID-19 within the private sector. Compared with large firms, small businesses have fewer resources and lower capacities to cope with the abrupt economic shocks economies are currently facing. With more than two-thirds of the global population employed by MSMEs, the unprecedented outbreak of the pandemic has vividly shown how tightly their activities are woven into the economic and social fabric of the world, as well as their critical role in social and economic resurgence.

The objective of the project is to develop and implement capacity-building tools for governments and micro, small and medium enterprises (MSMEs) to facilitate the resurgence and strengthen the resilience of MSMEs in developing countries and economies in transition. These capacity-building tools will seek to mitigate the economic and social impact of the global COVID-19 crisis and to facilitate the contribution of MSMEs to the SDGs implementation.

The project was designed based on the request for assistance for MSMEs from more than 50 Member States, including countries in Latin America and the Caribbean, Asia and the Pacific, Africa, Europe and the Arab regions, as well as intergovernmental demands and resolutions on COVID-19.

The project is jointly implemented by UNCTAD, DESA, ECA, ECE, ECLAC, ESCAP and ESCWA, and builds upon the comparative advantages of the participating agencies to provide immediate advice, capacity-building and support to governments and MSMEs during the ongoing global pandemic. The project is structured in five clusters that address the most critical areas of the MSME recovery. Broadly, the roles and lead entities for each of the clusters and workstreams are as presented in the following table:

Table 1. Project clusters and leads

Project cluster/workstream Lead agency Overall coordination UNCTAD Project cluster/workstream 1 Entrepreneurship and business skills promotion UNCTAD

Project cluster/workstream 2 Business facilitation/formalization

UNCTAD/DESA

Project cluster/workstream 3 Access to finance/financial literacy ESCAP

Project cluster/workstream 4 Access to technology and innovation UNECA

Project cluster/workstream 5 Access to markets UNECE

The beneficiary countries cover different geographical regions, as shown in Annex 2. The expected outcomes, indicators of achievement, and outputs are presented in the project results framework (Annex 3). The project was developed and implemented under three phases. A new set of outputs was designed or added at each of the three phases of the project.

Under the three-phase approach, the project budget was approved by phase. In 2021, when the phase 3 budget was discussed, the Development Account faced a funding gap. To bridge the gap, in November of the same year, the five joint projects were requested to reduce their proposed phase 3 budget by 1 million USD, which led to the curtailment of certain planned activities. For this project, the budget was reduced by $310,000.

Overall, a total of $4,490,500 was allocated under this project. Concretely, UNCTAD received $2,671,000, ECLAC received $134,000, ESCAP received $240,000, ECA received $467,000, ECE received $448,500, ESCWA received $370,000 and DESA received $160,000.

136

The project started its implementation in May 2020 and was scheduled to conclude on 31 March 2022, but received approval in February 2022 for an extension until 30 June 2022.

B. EVALUATION OBJECTIVES AND SCOPE

B1. EVALUATION PURPOSE, OBJECTIVES AND SCOPE The present evaluation will constitute a terminal evaluation of the Project. Terminal evaluations are mandatory for all DA-funded projects with a value above $1 million. The evaluation will be largely guided by the UN Development Account Project Evaluation Guidelines, issued in October 2019 and the evaluation policies of the implementing entities, in particular, UNCTAD, which leads the evaluation.

The main purpose of the evaluation will be to support accountability for results, and to enable learning.

This terminal evaluation of the project has the following specific objectives:

- Assess the results and establish the link between achievements and activities of the intervention;

- Assess the response delivery and external coordination167, including the extent of gender, human rights and disability mainstreaming; and

- Identify good practices and lessons learned from the project that could feed into and enhance the implementation of related interventions.

The primary intended users of the assessment are the management of the implementing entities. The evaluation will also provide accountability to project beneficiaries and member States. Furthermore, the evaluation will form a key input to the programme-level evaluation of the DA’s response to COVID-19 to be initiated by the CDPMO/DESA. The programme-level evaluation will entail: a synthesis of the terminal evaluations of five COVID-19 joint DA projects, including this project; a review of relevant 10th and 11th tranche DA projects; and a programme-level assessment. The primary audiences of the programme-level evaluation will include the DA Steering Committee, the DA-Programme Management Team (DA-PMT), and the management of the implementing entities. The results of the programme-level evaluation will also be presented to the General Assembly, through the biennial progress report on the implementation of the DA.

The evaluation will cover the duration of the project from May 2020 to 30 June 2022, covering all phases, clusters and activities.

B2. EVALUATION CRITERIA AND QUESTIONS The evaluation will assess the Project’s performance against the main criteria of relevance, efficiency, effectiveness, coherence, sustainability, gender, human rights and disability. In particular, the evaluation is expected to address a number of questions under the following criteria168:

Table 2: Evaluation criteria and tentative questions

167 The OIOS COVID-19 response evaluation protocol identifies the following three cross-cutting focus areas: 1) response delivery; 2) external coordination (or “Delivering as one”); and 3) business continuity. “Response delivery” is further defined as consisting of delivery of: 1) the existing mandate needed to implement previously mandated activities in the new environment created by the pandemic; and 2) the COVID-19-specific response (health and non-health) needed to address the pandemic specifically. See OIOS (October 2020), “COVID-19 Response Evaluation Protocol”, para 3-4. 168 The evaluation questions were developed as part of the “Proposed approach, scope and questions to the Evaluation of the United Nations Development Account’s Response to COVID-19”, which was jointly developed by the DA-PMT and select implementing entities in the spring of 2020. The document is designed to guide both the terminal evaluations of the five COVID-19 joint projects and the programme-level evaluation of the DA’s response to COVID-19, and is expected to be updated later in 2022 to reflect the confirmed approaches and timelines for the terminal evaluations of the five projects.

137

Relevance 1. To what extent was the project designed to target the new needs and priorities of participating countries as a result of COVID-19?

Relevance 2. To what extent was the project aligned with the COVID-19 socio-economic responses of the participating countries (e.g. COVID-19 Socio-Economic Response Plan)?

Efficiency 3. How well coordinated was the response among the entities implementing the joint project?

Efficiency 4. How did the three-phase budgeting and programming approaches impact the efficient delivery of the project?

Effectiveness 5. To what extent did the programme (Development Account) and project governance and management structures and processes enabled, or hindered, the effective implementation of the joint project and the achievement of its results?

Effectiveness 6. To what extent has the project contributed to the expected outcomes as enunciated in the project document?

Effectiveness 7. How did the response contribute to the participating country Governments’ responses to COVID-19, especially in the area of MSME resurgence?

Effectiveness 8. What innovative approach or tool, if any, did the response use, and what were the outcomes and lessons learned from its application?

Sustainability 9. What measures were adopted to ensure that the outcomes of the response would continue after the project ended?

Coherence 10. To what extent was the project complementary to, and coordinated with, other work undertaken by the implementing entities?

Coherence 11. To what extent has the project been coordinated with, and complementary to, the response of other UN entities (Secretariat and non-Secretariat) to COVID-19 in delivering socio-economic support to Member States?

Gender, human rights and disability

12. To what extent were gender, human rights and disability perspectives integrated into the design and implementation of the project? What results can be identified from these actions?

C. EVALUATION APPROACH AND METHODOLOGY The evaluation will be a transparent and participatory process involving the Project’s implementing entities and key stakeholders. It will be conducted based on gender and human rights principles and adhere to the United Nations Evaluation Group (UNEG) Norms and Standards for Evaluation.

The evaluation will apply a mixed-method design, including a combination of quantitative and qualitative analysis to inform findings.It is anticipated that travel of the evaluation team may take place in support of elaborating case study/ies, as well as to meet key project stakeholders in Geneva (UNCTAD and ECE). The selection of potential case study/ies and travel requirements will be developed as part of the inception report.

Following a preliminary documentation review and a limited number of inception meetings with the core project team, the Evaluation Team will develop an inception report for the evaluation, which will include the finalized overall scope and focus of the evaluation, evaluation questions and methodology, including

138

information on data sources and collection, sampling, key indicators, stakeholder mapping, selection of case study/ies, survey design, and the evaluation timeline.

The tentative methodology for the evaluation is presented in Table 4.

Table 3: Tentative methodology for the assessment

a) A desk review of Project documents, including documents/data related to:

o Project-level planning, implementation and results achievement, including but not limited to:

▪ Concept note, Phase 2 project proposal, and Phase 3 budget and outputs

▪ Progress report for Phases 1 and 2 (both financial and substantive/narrative report)

▪ Final report (both financial and substantive/narrative report)

▪ Meeting minutes, including the minutes of the bi-weekly/monthly DA network meetings

▪ Monitoring reports

▪ Information on non-DA resources, financial and in-kind, brought in by the participating entities

▪ Information on resources, financial and in-kind, contributed by partners/donors (including

information requested under the “supplementary funding” section in the progress reports,

which is often incomplete)

▪ Beneficiary/user feedback collected, including, but not limited to, workshop survey results,

user feedback on publications, advisory services, guidelines, methodology documents, etc.

▪ Requests for assistance/services received

▪ List of activities completed and details about each activity, including but not limited to:

- Agenda, participant lists (name, title, division/unit, organization, country, gender,

email address), report and any outcomes document, for each workshop/meeting

- Description of each advisory service, beneficiaries (including contact details of the

contact persons) and any outputs/deliverables produced

- List and description of tool(s), research papers, policy briefs, studies published and

information on how each product was disseminated and/or used, list of

recipients/users of the product (e.g., dissemination lists)

▪ Documentation related to broader projects or sub-projects of the participating entities of

which the Project or its component(s) has constituted an integral part or which are linked to

and/or build upon/succeed the work undertaken as part of the Project

▪ Documents and literature related to the Project context

▪ Relevant web and social media metrics related to the outputs of the project;

o Project strategic documents, including but not limited to:

▪ General Assembly's Resolution on Global Solidarity to fight the coronavirus disease 2019

(COVID-19) (A/RES/74/270);

▪ Secretary General's report on "Shared responsibility, global solidarity: Responding to the socio-

economic impacts of COVID-19";

▪ UN Framework for the immediate socio-economic response to COVID-19;

▪ 2021 Programme budget and mandate of implementing entities;

▪ COVID-19 Socio-Economic Response Plan of participating countries.

b) Questionnaires/surveys (in appropriate languages in addition to English) to relevant stakeholders in countries participating in a sample of project activities;

c) Telephone, online or in-person interviews with key stakeholders, including but not limited to:

139

o Project Coordination Team and project focal points of implementing entities

o DA-PMT

o DA focal points in participating entities

o Sample of UN Resident Coordinators/Country Teams, as appropriate

o Sample of key global partners

o Sample of country-level stakeholders (mainly stakeholders from key beneficiary countries)

d) Case Study/ies, which may include for example a detailed examination of a particular intervention, or of project activities at a regional or national level.

In addition to assessing the mainstreaming of gender, human rights and disability perspectives in the design, implementation and monitoring of the Project (evaluation question 12), the evaluation will integrate these perspectives in the management of the evaluation, data collection and analysis, as well as the development of the evaluation report. Gender balance will be given full consideration in the composition of the Evaluation Reference Group, elaborated in Section D1 (Evaluation management), and the Evaluation Team. Data collected and analyzed in the course of the evaluation will be disaggregated by gender to the extent possible and whenever appropriate, and the evaluation findings, conclusions and recommendations to be presented in the evaluation report will reflect a gender analysis.

The evaluation will be carried out according to the UNEG ethical principles and standards.169 The evaluators should demonstrate behavioural independence, impartiality, credibility, honesty, integrity and accountability in conducting the evaluation/assessment to avoid biasing the findings. The evaluators must also address in the design and conduct of the evaluation procedures to safeguard the rights and confidentiality of information providers. The Evaluation Manager will be responsible for ensuring that the Evaluation Team conducts the work assignments without any undue interference from those who were responsible for the implementation of the Project.

D. ORGANIZATION OF THE EVALUATION

D1. EVALUATION MANAGEMENT The independent final project evaluation will be managed/coordinated by UNCTAD’s Independent Evaluation Unit, with the support of an Evaluation Advisory Committee (EAC) that comprises a representative each of the evaluation units of the partner entities (DESA, ECA, ECE, ECLAC, ESCAP, ESCWA) and the Evaluation Officer with the CDPMO/DESA. The EAC primarily serves a quality assurance function and facilitates support to the Evaluation Team as necessary.

An Evaluation Reference Group (ERG) consisting of a representative from each UN partner entity (e.g., the DA Focal Point for each entity) and the DA-PMT will review and contribute inputs to key steps in this evaluation such as the TOR and draft final report.

Both the EAC and the ERG commit to submitting substantive comments on a timely basis, and comments will be invited on a ‘non-objection’ basis (no response = agree) so that the process is not delayed for an unnecessarily long time.

An independent Evaluation Team will be convoked to undertake this assignment. The Evaluation Team (ET) is responsible for conducting the evaluation, applying the methodology as appropriate and for producing the evaluation report. All team members, including the Team Leader, will participate in briefing and debriefing meetings, discussions, and will contribute to the evaluation with written inputs for the draft and final report. A selected number of the evaluation team members will participate in the mission travel(s) if applicable. The ET and the Evaluation Manager will agree on the outline of the report, in consultation with the EAC early in the evaluation process. The ET will develop its own evaluation tools and framework, within

169 UNEG (2020), Ethical Guidelines for Evaluation; UNEG (2008), Code of Conduct for Evaluation in the UN system

140

the available timeframe and resources. The team is fully responsible for its report, which may not reflect the views of any of the implementing entities of the project. The evaluation report is subject to quality control by the Evaluation Advisory Committee and clearance by the Evaluation Manager, as set out above.

The Team Leader guides and coordinates the team member(s) in their specific work, discusses their findings, conclusions and recommendations and prepares the draft and the final report, consolidating the inputs from the team member(s) with his/her own. The members of the evaluation team should possess a mix of evaluation skills and technical or sectoral/thematic knowledge relevant to the evaluation. In putting together the team, adequate linguistic, geographic and gender representation will also be key considerations.

The Evaluation Team will be provided full access to all project reports, documentation, and stakeholder lists and contact information. The Project Coordination Team are required to submit to the evaluation manager project documentation, including data and information residing with the other participating entities, in the last month of the project if possible, if not, immediately following the completion of the project, as well as support the evaluation process, including through facilitating the evaluators’ access to the project’s beneficiaries and other key stakeholders.

The roles and responsibilities in the evaluation process are described below:

Evaluation Manager (UNCTAD) will: ● Prepare the draft evaluation TOR and revise/finalize based on inputs received

● Prepare the TOR for each member of the Evaluation Team (Team Leader, Team Member and Expert(s))

● Recruit and manage the Evaluation Team

● Backstop the evaluation process, including supporting the development and administration of surveys,

support outreach of the evaluation team to project stakeholders, and access to secondary data listed in

Table 3.

● Oversee/provide quality assurance to the evaluation and the development of the evaluation report

● Facilitate the work of the Evaluation Advisory Committee and the Evaluation Reference Group

● Be responsible for clearance of the evaluation report

● Support the development of a management response to the evaluation report, including an implementation

plan

● Organise a virtual workshop on evaluation findings and lessons learned.

Evaluation Advisory Committee comprises a representative each of the evaluation units of the partner entities (ESCWA, ECA, ECE, ECLAC, ESCAP, DESA) and the Evaluation Officer with the CDPMO/DESA. The EAC primarily serves a support and quality assurance function. Specific responsibilities of the EAC include: ● Review and approve the evaluation TOR;

● Advise on the selection of the evaluation consultant(s) to ensure that the selection is based on the required

skills and qualifications;

● Support facilitating access from their respective entities to relevant project documentation and

stakeholders;

● Review and comment on the inception and evaluation reports; and

● Monitor and conduct periodic follow-ups on the implementation of evaluation recommendations

addressed to the parties within their entities.

Evaluation Reference Group, consisting of a representative from each UN partner entity (e.g., the DA Focal Point for each entity) and the DA-PMT,170 will review and contribute inputs to key steps in this

170 While multiple representatives of DA-PMT may attend meetings of the Global Reference Group, reflecting different roles held by each staff in relation to the Programme, DA-PMT will provide one consolidated written input as part of the review of the draft inception report and the draft evaluation report.

141

evaluation such as the TOR and draft final report. The ERG’s key function is to enhance the relevance, credibility and transparency of the evaluation process. Specific responsibilities include: ● To review the draft evaluation ToR and provide substantive feedback;

● To facilitate access from their respective entities to relevant project documentation and stakeholders;

● To review the draft evaluation report and provide substantive feedback, including coordinating feedback

from other sections, units and offices from headquarters and from the field to ensure quality and

completeness;

● To participate in the validation meeting of the final evaluation report;

● To play a key role in disseminating the findings of the evaluation and implementation of the management

response.

Project Coordination Team will: ● Facilitate the Evaluation Team’s access to relevant Project documentation and stakeholders, including

through:

o Collecting and compiling requested data and information from the participating entities, as

requested by the Evaluation Manager

o Providing an updated list of stakeholders, and facilitating access to the sample of stakeholders that

the Evaluation Team may wish to interview

o Facilitating the administration of questionnaires to workshop participants in the participating

countries

o Ensure the cooperation and contribution of the relevant staff of the implementing entities to the

evaluation process, as requested

● Lead the preparation of a response to the recommendations directed to the participating entities, including

an implementation plan

DA-PMT will: ● Participate in the Evaluation Reference Group

● Provide guidance on the allocation of the evaluation budget

● Organize a virtual meeting with DA focal points to discuss the key lessons from this evaluation as well as from other COVID-19 joint project evaluations and how to incorporate them in future programming, implementation, monitoring and evaluation of DA-funded projects.

D2. EVALUATION TIME FRAME The evaluation will be conducted from December 2022 to August 2023.

The evaluation process will involve five phases with the tentative timelines as below in Table 5 (the timelines may be adjusted should any exigencies arise):

Table 5: Evaluation phases and tentative timelines

Phase Timelines

1. Preparation

August 2022 – December 2022 ● Preparation and finalization of evaluation TOR ● Establishment of the Evaluation Reference Group ● Recruitment of the Evaluation Team ● Prepare package of documents required by the

Evaluation Team

2. Inception

December 2022 -March 2023

142

● Preliminary documentation review and preparation of inception report by the Evaluation Team, including development of data collection instruments (questionnaires/ surveys, interview guides)

● Brief visit to Geneva (3 days) to meet with UNCTAD Evaluation Unit and key project stakeholders (UNCTAD and ECE)

● Draft inception report due: 10 February 2023 ● Evaluation Manager review and inception report

revision by Evaluation Team: 13 - 22 February 2023 ● Reviews by Project Coordination Team, project focal

points of implementing entities, and Evaluation Advisory Committee (in parallel): 23 February – 7 March 2023

● Draft final inception report due: 14 March 2023 ● Final inception report approved: 20 March 2023

3. Data collection and analysis March- May 2023

● Desk review of remaining Project documents, including requesting additional documentation

● Online surveys of stakeholders ● Interviews with stakeholders ● Data analysis and triangulation

4. Report preparation and reviews May – July 2023

● Data analysis and triangulation ● First draft evaluation report due: 16 June 2023 ● Evaluation Manager review and report revision by

the Evaluation Team: 19 – 28 June 2023 ● Reviews by Project Coordination Team, project focal

points of implementing entities, Evaluation Advisory Committee and Evaluation Reference Group (in parallel): 29 June – 11 July 2023

● Revised draft evaluation report due: 18 July 2023 ● Final evaluation report with annexes: 25 July 2023

5. Dissemination and follow-up August 2023 and onwards

● Presentation to the Project Coordination Team, project teams of implementing entities and development and approval of a management response, including an implementation plan for recommendations

● Virtual workshop on evaluation findings, lessons learned and follow-up with the DA Focal Points: April 2023

D3. EVALUATION TEAM DELIVERABLES The Evaluation Team will be composed of a team of three consultants (evaluators), namely Team Leader, Team Member and a Gender and Human Rights (HRGE) Expert who also plays the role of Team Member. The two Team Members will report functionally to the Team Leader. The Team Leader will report to the Evaluation Manager. Each of the Evaluation Team has a set of deliverables as described below:

143

Deliverables for Team Leader and Team Member

o Initial review of key Project documents (preliminary document review)

o Preparation of an inception report with a finalized evaluation scope and focus, evaluation questions and methodology, including information on data sources, sampling and key indicators, stakeholder mapping/analysis, selection of case study/ies, as well as survey design

o Desk review of remaining Project documents

o Data collection and analysis based on the finalized methodology

o Preparation of an evidence matrix presenting a summary of evidence collected through each data collection method by evaluation question

o Development of a draft evaluation report, based on the template presented in Annex 1, for review by the Evaluation Manager, Project Coordination Team, project focal points of implementing entities, the EAC and the ERG

o Revision/finalization of the evaluation report, including all annexes, based on comments received

o Preparation of a 3-page summary of the evaluation report and a presentation (PPT) on key findings, conclusions and recommendations

o Presentation of evaluation report and discussions with relevant stakeholders such as Project Coordination Team, project teams of implementing entities, DA focal points of participating entities and DA-PMT.

Deliverables for Gender and Human Rights Expert/Team Member

o Initial review of key Project documents (preliminary document review), including identifying gender equality, human rights and disability inclusion dimensions and issues for consideration;

o Preparation of an inception report with a finalized evaluation scope and focus, evaluation questions and methodology, including information on data sources, sampling and key indicators, stakeholder mapping/analysis, selection of case study/ies, as well as survey design. Where applicable, gender equality, human rights and disability inclusion considerations will be integrated in the evaluation scope of analysis; evaluation criteria and questions design; methods and tools, and data analysis techniques;

o Desk review of remaining Project documents;

o Data collection and analysis based on the finalized methodology which would be gender sensitive;

o Preparation of an evidence matrix presenting a summary of evidence collected through each data collection method by evaluation question;

o Development of a draft evaluation report, based on the template presented in Annex 1 of the Terms of Reference for the evaluation, for review by the Evaluation Manager, Project Coordination Team, project focal points of implementation entities, the EAC and the ERG. The analysis of gender equality, human rights and disability inclusion dimensions and issues should be integrated in the report as an independent section and to the extent possible, these issues should be mainstreamed throughout the report, including in the evaluation findings, conclusions and recommendations.

o Revision/finalization of the evaluation report, including all annexes, based on comments received;

o Preparation of a 3-page summary of the evaluation report and a presentation (PPT) on key findings, conclusions and recommendations.

o Presentation of evaluation report and discussions with relevant stakeholders such as Project Coordination Team, project teams of implementing entities, DA focal points of participating entities and DA-PMT.

144

E. COMMUNICATIONS AND DISSEMINATION PLAN: The results from the evaluation including key lessons learned, best practices and recommendations will be shared widely with participating entities, partners and stakeholders, and member States. In particular, the following modes of communication could be used:

e) A workshop with all relevant stakeholders to present the key findings, recommendations and lessons learned. The evaluation report will be presented at a workshop attended by the implementing entities, the DA-PMT and other relevant stakeholders for discussion and validation. The implementing entities will be given the opportunity to present their management response, including an implementation plan for the recommendations;

f) A separate virtual meeting will be held with the DA focal points to discuss the key lessons from the evaluation as well as from other COVID-19 joint project evaluations and how to incorporate them in future programming, implementation, monitoring and evaluation of DA-funded projects and projects.

g) A copy of the final evaluation report will be published on UNCTAD’s website and the websites of the partner implementing entities, as appropriate; and

h) The key findings from the evaluation report will also form a key input to the programme-level evaluation of the DA’s response to COVID-19 to be initiated by the CDPMO/DESA.

i) Other communication briefs and products will be produced as appropriate.

  • Lists of figures, tables, and boxes
  • List of Acronyms and Abbreviations
  • Executive summary
  • 1. Introduction
  • 2. Description of the Project
    • 2.1 Background
    • 2.2 Project objectives and expected accomplishments
    • 2.3 Project strategies and key activities
    • 2.4 Beneficiaries and target countries
    • 2.5 Key partners and other key stakeholders
    • 2.6 Resources
    • 2.7 Link to the Sustainable Development Goals (SDGs)
    • 2.8 Innovative elements
  • 3. Evaluation objectives, scope, and questions
    • 3.1 Purpose and objectives
    • 3.2 Evaluation scope, criteria, and questions
  • 4. Methodology
  • 5. Findings
    • 5.1 Relevance
    • 5.2 Coherence
    • 5.3 Efficiency
    • 5.4 Effectiveness
    • 5.4 Sustainability
    • 5.5 Gender, Human Rights, and Leave No One Behind
  • 6. Conclusions
  • 7. Recommendations
  • Annexes
    • Annex 1: Project’s Theory of Change
    • Annex 2: Evaluation matrix
    • Annex 3: Data collection instruments
    • Annex 4: List of documents reviewed
    • Annex 5: List of individuals interviewed
    • Annex 6: Evaluation surveys
    • Annex 7: Evaluation Terms of Reference

Study on JUST TRANSITION ASSESSMENT OF ALBANIA; Sector Decarbonization and the Just Transition Framework Applied to Coal Mining

Languages and translations
English

UNECE

JUST TRANSITION ASSESSMENT OF ALBANIA

Sector Decarbonization

and the Just Transition Framework

Applied to Coal Mining

2

UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE

JUST TRANSITION ASSESSMENT OF ALBANIA Sector Decarbonization and the Just Transition Framework

Applied to Coal Mining

GENEVA, 2024

3

The information, methodologies, data, and opinions contained or reflected herein are based on information made available by third parties, which are subject to continuous change and therefore not warranted as to their completeness, accuracy, or fitness for a particular purpose. The findings, interpretations and conclusions expressed herein are those of the author(s) and do not necessarily reflect the views of the United Nations, its officials, or the Member States. The designation of, or reference to a particular territory, or geographic area, or the use of the term “country” in this document does not imply the expression of any opinion whatsoever on the part of the United Nations concerning the legal status of any country, territory, city, or area, or its authorities, or concerning the delimitation of its frontiers, or boundaries. Mention of any firm, licensed process, or commercial product does not imply endorsement by the United Nations.

Photo credits: Cover, Hans Rüdiger Lange, International Consultant

4

ACKNOWLEDGEMENTS

This work was carried out by United Nations Economic Commission for Europe (UNECE) with the help of Mr. Hans Rüdiger Lange (Professor Identität-Entrepreneurship-Transformation, Brandenburgische Technische Universität Cottbus-Senftenberg, Germany) in his capacity of an international consultant, and with the support provided by the national consultant Mr. Nevton Kodhelaj (Albania).

The document was developed under the supervision of Michal Drabik, the secretary of the UNECE Group of Experts on Coal Mine Methane and Just Transition and with the support of Oleg Dzioubinski, Regional Adviser at the UNECE Sustainable Energy Division.

The study was reviewed and edited by Michal Drabik and Raymond Pilcher, Chair of the UNECE Group of Experts on Coal Mine Methane and Just Transition.

The UNECE Group of Experts on Coal Mine Methane and Just Transition also discussed and approved the document at its 19th session held on 18-19 March 2024 in Geneva, Switzerland.

The United Nations Economic Commission for Europe (UNECE) is one of the five UN Regional Commissions that provides a forum through which 56 countries of North America and Western, Central, and Eastern Europe and Central Asia unite to forge the tools of their economic cooperation. The main areas of UNECE’s activity are economic cooperation and integration, environment policy, forests, housing and land, population, statistics, sustainable energy, trade, and transport. UNECE pursues its goals through policy analysis, developing conventions, regulations and standards, and providing technical assistance. The member states in the Committee on Sustainable Energy discuss energy- related topics such as coal mining and coal mine methane. The Group of Experts on Coal Mine Methane and Just Transition convenes as a subsidiary body of the Committee, meeting regularly to discuss issues and promote best practices for management, capture and use of the CH4 gas liberated during the coal mining life cycle (https://unece.org/sustainable-energy/coal-mine-methane).

Disclaimer: The document does not necessarily reflect the position of individual authors, their respective organizations, or the reviewers and partners listed above.

5

Contents List of Figures .......................................................................................................................... 7

List of Tables ........................................................................................................................... 7

Acronyms .................................................................................................................................... 8

Executive Summary .................................................................................................................... 9

1. Introduction .......................................................................................................................... 11

2. Statement of the problem .................................................................................................... 12

3. Framework for a continued transformation of post-coal mining areas ............................... 13

3.1 Case Study: Malmö (Sweden) ......................................................................................... 14

3.2 Case Study: Buffalo (United States) ................................................................................ 15

3.3. Insights: multilevel character of socio-economic transformation ................................. 17

3.4 Insights: technology architecture, mine closure and ecological healing ........................ 18

3.5 Insights: supply chain decarbonization and value net reconfiguration ......................... 20

3.6 Insights: Entrepreneurial Ecosystems, Smart Specialization and Regional Identity ....... 22

3.7 Insights: JUST Transition – normative context of sustainability policies, goals and KPI’s .............................................................................................................................................. 25

3.8 Insights: Uncertainty, Governmental Programs and Possibilism .................................... 26

3.9 Insights: Examples of Just Transitions Frameworks – World Bank and European Union .............................................................................................................................................. 27

4. Description of Albanian coal sector and post-coal mining communities ............................. 30

4.1 Case Study: A miner’s biography .................................................................................... 30

4.2 Case Study: Mining Community Krrabë and Mushqeta ................................................. 31

4.3 National context and coal mining sector in Albania ....................................................... 33

4.3.1 Political and institutional context ............................................................................ 35

4.3.2 Demographic context .............................................................................................. 37

4.3.3 Economic context ..................................................................................................... 39

4.3.4 Coal deposits and mining activities ......................................................................... 41

4.3.5 Energy market and power supply ............................................................................ 44

4.4 Current situation in each of the post mining communities in Albania ........................... 46

4.4.1 Mining Community Kamza ...................................................................................... 47

4.4.2 Mining Community Vora ......................................................................................... 48

4.4.3 Mining Community Kora .......................................................................................... 49

4.4.4 Mining Community Pogradeci ................................................................................. 50

4.4.5 Mining Community Tepelena ................................................................................... 51

4.4.6 Mining Community Tirana Agglomeration ............................................................. 52

4.4.7 Mining Community Maliq ........................................................................................ 53

4.4.8 Mining Community Kolonja ..................................................................................... 54

6

5. Assessment of Just Transition Readiness of the Coal Sector in Albania ............................... 55

5.1 Digital Twin and quantitative analysis of the coal mining exit in Albania ..................... 55

5.2 Qualitative mapping and assessment of the Just Transition .......................................... 63

5.3 Expert Assessment of maturity of Just Transition with respect to Coal Exit in Albania . 69

6. Stakeholder dialogue and practical recommendations ........................................................ 71

6.1 Stakeholder dialogues 2023 ........................................................................................... 71

6.2 Recommendations .......................................................................................................... 72

6.3 Practical Considerations ................................................................................................. 74

References ................................................................................................................................ 77

Note on the authors ............................................................................................................. 80

7

List of Figures Figure 3.1 Technology Architecture of Just Transition Method

Figure 3.2 Multi-level socio-economic transformations Tomenendal (2018)

Figure 3.3 Primary, Secondary Mining Assets and Categories of Post-Mining Usage

Figure 3.4 Supply chain, value net and cluster as fabrics of value creation (schematic)

Figure 3.5 Schematic Presentation of Entrepreneurial Ecosystems

Figure 4.1a Various data about Albania - Population evolution and migration

Figure 4.1b Various data about Albania - Annual GDP Growth (World Bank Data)

Figure 4.1c Various data about Albania - CO2 / capita in metric tons 2020 (World Bank Data)

Figure 4.1d Various data about Albania - Active coal power plants (World Bank Data)

Figure 4.1e Various data about Albania - Percentage of hydropower 2015 (World Bank Data)

Figure 4.1f Various data about Albania - Active solar and wind power plants (World Bank Data)

Figure 4.1g Various data about Albania - Employment rate +15 pop. 2022 (World Bank Data)

Figure 4.1h Various data about Albania - GDP per capita (constant 2015 US$, 2022)

Figure 4.2 Coal mine basins and coal mines in Albania map

Figure 5.1a Just Transition Digital Twin - Jobs: mining direct, indirect and trickle down

Figure 5.1b Just Transition Digital Twin - Transfer program, emigration including retirement

Figure 5.1c Just Transition Digital Twin - Carbon economy: CO2-emissions and coal production

Figure 5.1d Just Transition Digital Twin - Green economy: electricity consumption, RE production

Figure 5.2 Mapping of socio-economic transition related to coal exit in Albania

Figure 5.3 Mapping of coal and energy supply chain in Albania

Figure 5.4 Mapping of entrepreneurial ecosystems of Albania before 1990 vs. 2035

List of Tables Table 3.1 Procedural aspects of mine closure

Table 4.1 Power generation capacities by technology

Table 4.2 Electricity consumption in Albania 2018 – 2020 by consumer category

Table 4.3 Electricity wholesale market prices 2019 - 2020

Table 5.1 (a, b) Just Transition maturity model of four pillar and eight dimensions

Table 5.2 Set of KPI’s for Just Transition four pillar and eight dimensions model

Table 5.3 Maturity Assessment (Expert 1: x; Expert 2: o; Expert 3: +; Expert 4: -)

Table 5.4 Just transition indicators summary from mining community ID-Cards

Table 6.1 Ideas invoked in the stakeholder dialogue

Table 6.2 Practical recommendation: focus and key activities

8

Acronyms ALPEX Albanian Power Exchange

CCA Climate Change Agreement

DCM Decision of the Council of Ministers

ETS Emissions Trading System

FMF sh.a. Last Resort Supplier part of holding OSHEE sh.a.

FSHU sh.a. Universal Service Supplier

FTL sh.a. Free Market Supplier

FX Reserves Foreign Exchange Reserves

GDP Gross Domestic Product

IMWGCC Inter-Ministerial Working Group on Climate Change

KOSTT Kosovo Transmission System and Market Operator

MSET Multi-level socio economic transitions

MTRS Medium-Term Revenue Strategy

NAP National Adaptation Plan

NSDI National Strategy for Development and Integration

OSSH sh.a. Distribution System Operator

OST Albanian Transmission System Operator

SDG Sustainable Development Goals

TAP Trans Adriatic Pipeline

TPP Thermal Power Plant

UNFCCC United Nations Framework Convention on Climate Change

9

Executive Summary UNECE is working on greening the energy sector in accordance with principles of carbon neutrality and just transition. In its efforts to support its member states UNECE intends to strengthen with its competence and resources the adaptive capabilities of impacted member states. Within this cooperative effort, Albania requested UNECE to develop a study analyzing the country’s readiness for green and just transition in post-coal mining areas. This report develops the Just Transition concept with its conceptual foundations and employs it to characterize the current state of the coal mining sector and post-mining communities in Albania. The presented material is based on two field missions each featuring a series of interviews and stakeholder workshops, as well as on desk research. Especially for the turbulent years 1990 – 2011, the data and information base show considerable discontinuities and gaps. This report, together with the technical report “UNECE Technical, principle-based guidelines for designing and implementing a programme for efficient, safe and environmentally conscious mine closure in Albania and Serbia” (UNECE Report Albania and Serbia, Geneva 2022) provides a consistent picture of the status quo with its challenges and opportunities. The report closes with a few recommendations and practical considerations on how to complete the unfinished coal mine closure process in accordance with the proposed Just Transition Approach for the post-mining communities in Albania. Key findings of this report are:

• Coal Mining has been a core industry of Albania until 1990 with some 22 mines operated in the four coal basins of Albania. Besides the largest Valias mine at the outskirts of the capital Tirana, the centrally planned mining sector relied on a workforce management of internal migrant workers dispatched to the mining communities.

• In the wake of the collapse of the socialistic states in Europe and the Soviet Union in 1989/1990 and subsequent economic liberalization the sector went through a disruptive shut down within less than five years.

• Up to half of the mining workforce emigrated (mostly to Italy and Greece), a restraint social program for elder workers was put in place, and a rapid mining closure program led to a minimal and only partially executed securing of mining shafts, leaving many issues related to environmental safety and land reclamation unaddressed.

• In 2023, a number of strategic opportunities open up for Albania: o hydro-power has been strongly developed and still has some potential; o in an integrated regional electricity market of the “West Balkan Six” Albania can play a

significant role due to its hydro assets and central geographic position; o Photovoltaic and wind energy are still underdeveloped compared to some neighboring

countries, and represent a catch-up potential; o The access negotiation with the European Union brings about a wave of institutional

reforms and modernization impulses, the momentum of which could be leveraged to complete the coal mining exit of the 1990’s and turn it into a successful Just Transition story.

• The specific situation of the eight mining communities screened in this report varies strongly – those in the capital region as well as the regional centers of Kora and Progradeci appear to have passed beyond coal exit, whereas some remote locations seem to carry a double burden of de- industrialization and peripheral disadvantage.

10

• We assessed Just Transition Readiness of Albania with an expert-based maturity model with the following five level score (neutral, basic, managed, defined, established)in four dimensions (governance, people, transition, digitalization): “neutral” in Governance, “basic” with respect to People, “basic” with respect to Transition and “basic” with respect to Digitalization.

This report concludes with the following recommendations:

• Vision: Complete the unfinished coal exit of the 1990’s by a limited Just Transition Initiative focusing on ensuring post-mining safety and revitalization of the mining communities.

• Mission: a core group of stakeholders of post-mining communities and the energy sector in Albania could form a small national work group “Just Transition Initiative Albania”.

• Next step work program: the work group could use this report and the UNECE report on mining closure as a basis for identifying a portfolio of pilot projects suitable to show case how a Just Transition Approach could serve local post-mining communities as a tool for completing the process of securing the abandoned mines and give an impulse for the growth of new business paths.

• At the stakeholder workshop held in Tirana in December 2023 a first set of project ideas was identified. The study suggests the following project focus:

o Support the government of Albania to create a favorable and attractive regulatory and policy framework for a competitive green economy.

o Design and deliver a set of strategy workshops with Institutions of Higher Education impacted by coal exit, with the objective to modernize and re-orient the degrees and curricula towards the possible growth paths of Albania (like resource management, regional cooperation in mining education, etc.)

o Develop an interactive program format for post-mining communities, allowing the latter to set up local public-private business growth initiatives adapted to the local assets, existing infrastructure, and human resources.

This report intends to foster open access to information and data. In their work on this document, the authors favored open access sources of information and encourage the reader to visit the UNECE webpages dedicated to the workshops delivered within the framework of the project of which the presented study is the final report (https://unece.org/sustainable-energy/events/workshop-mapping- albanias-readiness-green-and-just-transition-post-coal and https://unece.org/info/Sustainable- Energy/Coal-Mine-Methane/events/389509) to find out more information on the undertaken work and its results.

11

1. Introduction UNECE is working on greening the energy sector in accordance with principles of carbon neutrality and just transition. To conform to the climate policy objectives, countries have to undergo through a process of decarbonization of their economies, which will create new opportunities, but also entail certain disruptive effects, which are likely to fall disproportionally on the shoulders of the localities that are economically reliant on energy-intensive industries. In its efforts to support its member States in this transition, UNECE recognizes that the scope and pace of the transformation process has to be aligned with the capabilities and needs of individual member states, taking into account their endowment of natural resources, technological base, cultural heritage, national aspirations, environment and social aspects, as well as the legal and regulatory structure. UNECE intends to strengthen with its competence and resources the adaptive capabilities of impacted member States. In this context, Albania requested UNECE to develop a study analyzing the country’s readiness for green and just transition in post-coal mining areas. A “just transition” is an emerging policy framework, which promotes an integrated approach to sustainable development by combining social progress, environmental protection, and economic success into a framework of democratic governance and institutional resilience. In order to best serve Albania’s request, this study takes a practitioner’s approach in order to provide the stakeholders of the transition process in Albania with a sound understanding of the socio-economic transition under way, with an assessment of the readiness of Just Transition Status of the post-coal mining communities in Albania and a set of recommendations for possible next steps in the process. Section 1 reviews the emerging practice of “Just Transitions” in a combination of selected conceptual foundations based in scientific research and insights arising from practice of socio- economic transitions. Section 2 gives an overview of the coal mining sector Albania and its current status based on two short field study missions in Albania conducted in the second half of 2023. Section 3 assesses the readiness of the coal exit in terms of “UNECE Just Transition Framework”. Section 4 offers a set of recommendations for next steps, which derive from the authors’ analysis of the current situation in Albania, and reflect an outcome of an open dialog with stakeholders and international experts engaged in a participatory workshop held in Tirana in December 2023. The authors of the study have both: practical experience in (in Lusatia, Germany and in Kucks, Albania) and academic perspective on the subject of coal exit and decarbonization (holding the Chair of Identity-Entrepreneurship-Transformation at Brandenburgische Technische Universität Cottbus, and the Professorship at the Energy Resources Department, Faculty of Geology and Mining, Polytechnic University of Tirana). Recognizing the importance of accessibility of information for the communities undergoing the transition, the report intends to provide its readers a broad learning architecture: mini-case studies, links to websites, data access, and possibility to add information and shape the transition process through engagement with the UNECE Group of Experts on Coal Mine Methane and Just Transition (comments and contributions are welcomed and can be provided to: [email protected]).

12

2. Statement of the problem A massively expanding global population and continuously increasing per capita consumption have led to overconsumption and partial exhaustion of the planetary resources. The single most evident threat associated with that trend is the global warming: manmade greenhouse gas emissions drive up temperatures and sea levels on a global scale. Humanity is challenged to achieve in a concerted international and local effort the transition from carbon intensive supply chains and their related socio-economic ecosystems towards local sustainable green economies. Each of these transitions requires in itself a complex change management process. The complexity gives rise to many obstacles and risks, which might make such a socio-economic transition socially, economically, and/or ecologically more costly, or even halt the transformation process. Oftentimes, in an initial phase, transitions affect local communities in a disruptive way characterized by surprise and uncertainty. Communities that are unprepared for the systemic change tend to defend their outdated economic models and industries on which they depend. A lack of data, understanding of the process, and capabilities to shift focus from preservation of the traditional industry to exploration of new business opportunities is a significant challenge. At the same time, this transition from carbon intensive towards sustainable green economies is a mankind endeavor and a truly global operation. The complex interplay of the realms of ecology, economy and local society has been studied from multiple perspectives and in many locations on Earth. The global community of experts and an accumulated knowledge offers powerful resources and rich heuristic capital, which allows affected regions to better manage and master their own transition and its specific challenges. The Just Transition Framework of Sector Decarbonization proposed in this study is intended to enable impacted communities to develop an understanding of the socio-economic transition’s needs and objectives, its constituent processes, and system elements. It shares experiences of regions going through the same transition and offers a practitioner’s approach to create transparency of the transition under way, set up a procedural and organizational framework in order to embark on the journey from a coal mining community towards a green economy.

Definition: Framework for Just Transition from carbon intensive towards green economies

A Just Transition Framework for Sector Decarbonization provides an understanding of

the fundamentals of decarbonization driven socio-economic transitions and outlines

how an impacted community may assess and visualize its economic ecosystem and how

it may negotiate the change process, create and develop projects towards an emerging

green economy, while adjusting and balancing ecological, economic, social and

participatory concerns. As a starting point, it provides the current case of post-mining

Communities in Albania with an initial information base and assessment of the country’s

readiness for Just Transition.

13

3. Framework for a continued transformation of post-coal mining areas How to tab into the global knowledge capital on socio-economic transitions for the practice in Albania? This section starts with looking at practice of socio-economic transitions via two mini- case studies of Malmö (Sweden) and Buffalo (United States). It then provides an overview of the fundamental conceptual building blocks of the Just Transition Framework. In order to best serve the target group of stakeholders engaged in real Just Transitions, it presents the practical cases, concepts, and insights in a very succinct manner. References to research are indicative and non-exhaustive.

Let us develop our pragmatic understanding of socio-economic transitions by looking at two mini case studies of socio-economic transitions: in Malmö, Sweden and in Buffalo, the United States, which will provide us with a good understanding of richness and complexity of real-life change situation.* How does a socio-economic transition of an industrial region look like? What are its key features and success factors? In both transitions, we recognize a community with an initial industrial specialization. In the case of Malmö, this was shipbuilding (see page 14), and steel and tire production in the case of Buffalo (see page 15), and in the case of. In our Just Transition Framework, we will refer to these specialized communities as “entrepreneurial ecosystems” – that is a complex interplay between technology, markets, local society, and politics. During the evolution of the transition, each case is characterized by a disruptive shock affecting the above-mentioned initial industrial specialization. As a reaction of the impacted communities to these crises, we see a structured public-private, long-term effort to reinvent the wider economic specialization of those localities. Typical projects concern urban infrastructure investments, modernization of research and educational institutions, and, what is of great importance, a deliberate and centrally coordinated integration of private business projects into a long-term vision and strategy. Along this path of adaptation, a new economic profile built around a certain anchor expertise, science and education poles, or key private investors emerges. This new “smart specialization” allows focusing activities of a wide range of stakeholders within the community. At the same time, it improves communication of the community towards the outside. Interested parties begin to recognize the emerging specialization and might be attracted to become a part of the project. At the end of the transition stories of Malmö and Buffalo, both affected communities reconfigured their knowledge and capability profiles into new regional specializations. In the case of the former, this is live science and medical technology, and in the case of the latter, it is renewable energy, with a focus on solar technologies.

* The two case studies are part of a series developed by one of the authors (Innovationsregion Lausitz GmbH, 2017). They have been selected deliberately from the industrial socio-economic transitions outside the coal and mining sector to allow readers from mining communities to look at them without any bias.

14

3.1 Case Study: Malmö (Sweden)

15

3.2 Case Study: Buffalo (United States)

16

A key insight from the two case studies is: successful transitions are characterized by a combination of both; (1) central supportive measures, and (2) local ownership, agency, and emergence of self-organizing ecosystem. The locally specific evolution and dynamic of such transitions varies strongly from one case to another. However, in all socio-economic transitions, social, economic, as well as ecological balance and justice are achieved and maintained in the long term only if there is strong local owner- and entrepreneurship. This is a key condition of local sustainability and resilience: societal ecosystems have to be empowered to balance their distribution of economic, ecological, and social resources in a sustainable manner. It is this self-regulating capability, which creates the aspired resilience for the disrupted communities. The “Framework for Just Transition in Sector Decarbonization” should help you and your community to build this capability. Starting from that first sketchy understanding of socio-economic transitions, we would like to deepen our understanding of the complexity of socio-economic transitions in general, and Just Transition approaches in particular. The case studies of Malmö and Buffalo exposed the interdependencies between technology, infrastructure, human capital, and public-private partnerships. We would like to frame the heuristics of Just Transition as a social technology in the conceptual building blocks forming an architecture as illustrated below. Figure 3.1 - Technology Architecture of Just Transition Method

The following sections provide insights into the multi-level-character of socio-economic transitions, exploring aspects of mining geology and technology, the role of supply chains and value nets, as well as entrepreneurial ecosystems and normative policies, such as market liberalization or the SDG’s. Other significant shaping factors of socio-economic transformations are the degree and nature of uncertainties, and the availability and the extent of digital cooperation.

17

3.3. Insights: multilevel character of socio-economic transformation The concept of "Multilevel Socio-Economic Transitions" (MSET) is a framework for understanding the complex and interconnected processes of societal and economic change, in particular in the context of transitioning away from fossil fuels, such as coal. This concept has been developed and discussed by scholars like Frank Geels, who have applied it to the study of coal exit and other sustainability transitions (Geels 2004). Figure 3.2 illustrates schematically the structural elements of a MSET with niches, regime and landscape as vertical, partially independent levels of activities. Figure 3.2 - Multi-level socio-economic transformations

Source: Tomenendal (2018) Niches are small scale, decentral activities from individuals, project team organizational units. Niches open space for experimentation and if there is a widespread niche activity with a large number of players, it gives rise to a portfolio of opportunities and a swarm-based exploration of possible futures. At the mezzo level, the MSET collocates the regime, where we observe more structure and indeed specialized cooperation patterns that are characteristic for the community at hand. In the MSET a given regime or entrepreneurial ecosystem evolves from identification of a starting point, for instance a smart specialization as a “mining region”, to focusing on the exploitation of its geological assets. In the transition process, the initial regime undergoes a shock - like mine closure. Following the shock, the regime runs through a reconfiguration of its entrepreneurial ecosystem.

18

On the macro level, the landscape is a source of threats and opportunities to the regime and niches. The landscape is beyond the direct control of the regime or niches, but at the same time, it is typically the origin of the disruption (like, for instance, coal exit instigated by economic liberalization or introduction of climate mitigation measures). Landscape comprises drivers from policy, technology, market, and environmental realms. The socio-economic transition plays out as a complex, and context-specific dynamic interaction of niches, regime, and a landscape level. A given community might successfully achieve the creation of a new smart specialization at the end of the just transition process. Practical recommendations drawn from MSET approaches Socio-Technical Systems. MSET helps communities and their stakeholders to recognize that societal transitions involve more than just technological changes. They also entail shifts in social practices, institutions, policies, and cultural norms. This allows rethinking the socio- technical systems in which initial technologies are embedded – like the miner recruitment and commuter pattern in Albania until 1990 – and adopt a holistic change management approach. Regime Shifts. Transitioning involves moving from an initial regime (e.g., a coal-based national economic system) to a new regime (e.g., coal import, renewable energy). These shifts are driven by changes in technologies, markets, political systems, policies, or social values. Stakeholders benefit from defining their tasks as means of development of a new regime or entrepreneurial ecosystem (see below). Path Dependency and Lock-In. MSET acknowledges that existing systems can be "locked-in" due to historical and structural factors, such as, for instance, existing transport patterns, administrative structures, or beliefs. Transitioning away from coal mining or other established systems often requires overcoming path dependency to enable change. Multilevel. Transitions occur at multiple levels of society, from local and regional to national and global. This framework helps affected communities to discern the complexity of interactions across different levels and the need for coordinated efforts. This is of particular importance in sustainability transitions, as the driving force for change arises in most cases from higher landscape levels – national or even supranational agents. These changes are particularly vulnerable to just transition risks, and they benefit from a careful management of initiatives across the multi-level system into the regime and niche levels.

3.4 Insights: technology architecture, mine closure and ecological healing Just Transition in the context of mining and coal exit has some technical and processes-specific aspects related to the geology, technology, and administration of mining operations. While UNECE provides ample expertise in this field, it seems adequate to give a short overview of the aspects that need to be addressed in a framework for post-mining land recovery, to ensure the effective restoration of ecosystems, mitigation of environmental impact, and promotion of responsible land use. Transformation from an operating mine into a post-mining reusage has been studied intensively in different countries. UNECE has provided some groundwork of this task and applied it to Albania and Serbia (UNECE 2022). Within this study we limit ourselves to elicit the

19

procedural aspects and provide a generic overview of the asset transformation as illustrated schematically in Figure 3.3 (adapted from Jan Bondaruk 2023). Primary assets like shafts, voids, mine water, and methane, as well as the secondary assets like wastes, dumps, and mining infrastructure go through a screening and reconfiguration process, which transfers them into one of five principal fields of reuse. The specific transformation of a given mine is extremely context specific. Figure 3.3 - Primary, Secondary Mining Assets and Categories of Post-Mining Usage

Practical recommendations drawn from Mining Closures Foster favorable conditions for technologically sound post-mining usage from the very beginning. We encourage stakeholders and the affected communities to promote a consistent national setting oriented at international standards. A crucial step is to create a centralized authority and information source responsible for overseeing and coordinating post-mining land recovery efforts. It can then develop and make available industry standards and best practices for land recovery, ensuring consistency across mining operations. We advocate for multi-party collaboration between government agencies, mining companies, environmental experts, and local communities to foster a collective approach. Set up and maintain consistent monitoring and evaluation. As mining intervention are – by their geological nature – build to last a long time, it is highly recommended to implement a robust monitoring and evaluation system to track the progress of land recovery initiatives. This enables successive generations to have a good database, to regularly review and update policies based on technological advancements and evolving environmental standards. Make use of international expert networks and institutions. Mining is a global practice, while local deposits often have particular characteristics distinct from all other locations in a given country. However, globally, it is likely that similar conditions occur also elsewhere. Therefore, it is useful to tap into available international resources and expertise in order to draw from the documented experiences of others.

20

Table 3.1 - Procedural aspects of mine closure

No. Procedural

Aspects

Activities to be undertaken

1 Location Data

Base and

Assessment

• Thorough geological surveys to identify suitable sites for mining

activities, considering environmental sensitivity and biodiversity.

• Prioritization of rehabilitation efforts for high-priority ecological zones.

2 Geotechnical

Risks and

Legacies

• Post-mining geotechnical assessments to identify risks and establish

mitigation measures.

• Assessment of regulatory framework for the responsible closure of

mining operations, including proper handling of waste and hazardous

materials.

3 Topographical

and Hydrological

Conditions

• Topographical and hydrological assessments to minimize disruption to

natural watercourses and terrain.

• Assessment of deployed and available reclamation techniques that

account for the existing topography and hydrological conditions.

4 Other

Environmental

Conditions

• Screen and conduct environmental impact assessments (EIAs).

• Check and where necessary establish protocols for ongoing monitoring

and adaptive management to address unforeseen environmental

challenges.

5 Permitting, Land

Ownership,

Reclamation

Status

• Assess status and streamline permitting processes in order to remove

obstacles to environmental protection and post-mining reuse.

• Facilitate transparent land ownership and reclamation status databases

accessible to relevant authorities and potential future users.

6 Development

Opportunities

• Collaborate with local communities to identify suitable and socially

acceptable development opportunities – for instance through a Just

Transition program on national level.

• Encourage diversified land use post-recovery, supporting sustainable

agriculture, forestry, or renewable energy projects amongst others.

7 Funding • Establish a dedicated fund for post-mining land recovery, sourced from

mining companies, government contributions, and potentially from

environmental impact bonds.

• Incentivize private-sector investment through tax breaks or other

financial mechanisms.

3.5 Insights: supply chain decarbonization and value net reconfiguration Coal extraction and utilization is typically a technologically- and cooperation-intensive industrial process. This has a number of causes. On the one hand, coal has been the fuel for major industrial processes, like electricity and heat generation, or steel and cement production

21

and therefore, has to be extracted in large, cost-efficient quantities to meet the demand of those energy-intensive sectors. On the other hand, many coal reserves are located at significant depth from the surface requiring heavy technology to operate either profound open pits or deep mining shafts. Related technologies require significant financial investments, safety measures, and intense cooperation of specialized experts. Each of these features – long chains of value creation, technology intensity, and complexity of cooperation – lead to significant economic costs. In a process of Just Transition of coal exit, the entire underlying economic fabric with its interdependencies is impacted. In order to manage such a transition and to capture opportunities for reconfiguration of capabilities and infrastructure assets, we have to understand well these interdependencies. Supply chains and value nets are tools to uncover the economic fabric and analyze the sector under transition. A supply chain is a network of organizations, individuals, activities, and resources involved in creating and delivering a product or a service to the end consumer. It encompasses everything from raw material extraction to delivering the final product to the customer. Key components include suppliers, manufacturers, distributors, retailers, and consumers. The efficiency of a supply chain is crucial for minimizing costs, optimizing processes, and ensuring timely delivery. A mapping of the supply chain provides transparency over the stakeholders and dependencies of the mining sector being affected by the Just Transition. Figure 3.4 – Supply chain, value net and cluster as fabrics of value creation (schematic)

While supply chains focus on the linear flow of goods and services, value nets take a broader approach, emphasizing the interconnected relationships between more than one supply

22

chains. In the context of coal mining in Albania, for instance, the full value net includes coal, copper, chrome, iron, energy, as well as steel and cement industries with their respective webs of interconnections. Consequently, adopting a value net perspective allows for a more holistic understanding of the value creation and cooperation of partners. Value nets include not only suppliers and customers but also competitors, partners, regulatory bodies, and other entities that contribute to or impact the value creation. Practical recommendations drawn from supply chain and value net approaches

How can supply chain and value net concepts help to increase the odds for a successful and just transition? Besides helping to identify the economic stakeholders of the transition, the mapping of value creation ensures a broad perspective and screens a wide scope of opportunities. One inroad to decarbonization is a systematic supply chain optimization. Companies need to identify and adopt sustainable practices, such as using renewable energy sources at all levels of the supply chain, improving energy efficiency, and implementing cleaner technologies in mining and transportation processes. More radically, decarbonization also requires rethinking material inputs, reducing waste, and adopting circular economy principles. Collaboration across the supply chain is essential to ensure that sustainable practices are adopted uniformly, from mining operations to the end product. Value net analysis can help identify opportunities for collaboration and innovation in the broader ecosystem of the Just Transition. In the context of coal mining, stakeholders may explore partnerships with renewable energy providers, engage in responsible resource extraction practices, and work with governments to navigate regulatory challenges. Transitioning away from coal can also open new business opportunities in renewable energy, sustainable materials, mining asset upcycling, and green technologies. Another opportunity is to explore value nets of regional cooperation. Companies and entrepreneurial ecosystems that understand and leverage their position within the value net can gain a competitive edge by aligning their strategies with the broader trend of decarbonization.

3.6 Insights: Entrepreneurial Ecosystems, Smart Specialization and Regional Identity Policy documents as well as actual research acknowledges the importance of the local cultural and socio-economic fabric of a community or a region. When Porter (1990) summarizes his key insight in the analysis of sources of competitiveness in an increasingly globalized world, he highlights the local origin of competitive advantage: “… Competitive advantage is created and sustained through a highly localized process. Differences in national economic structures, values, cultures, institutions, and histories contribute profoundly to competitive success. …”. Isenberg (2011), in turn, analyzed the regional, socio-economic fabric from the perspective of entrepreneurial ecosystems. His concept of entrepreneurial ecosystems refers to the interconnected and interdependent dimensions that influence the creation and growth of entrepreneurial ventures within a region. In the context of coal exit, a key challenge of the affected mining communities lies in the task to create ventures that could substitute for economic income from mining. These regions and the stakeholders of the Just Transition process face the task to reimagine and reinvent the local ecosystem of the mining community

23

at hand. Isenberg argues that entrepreneurial success in such an endeavor is not so much about individual agents, like the state, entrepreneurs, or startups, but rather about the broader environment in which they operate. A schematic presentation of such an entrepreneurial ecosystem shows Figure 3.5. Figure 3.5 - Schematic Presentation of Entrepreneurial Ecosystems

Source: adapted from Isenberg 2011

Insights from research and practice show that particular attention should be given to the interconnectivity of the elements, the ecosystems’ dynamics, and the self-reinforcing nature as well as the significance of the local context. As shown in Figure 3.5, entrepreneurial ecosystems encompass various elements, including entrepreneurs, investors, mentors, educational institutions, government policies, and support organizations. These elements are required to work together to create a conducive environment for entrepreneurship and economic development. The interaction typically leads to dynamic and self-reinforcing effects. However, in the coal exit situations, oftentimes a negative self-reinforcing can be seen as well. Communities enter into a downward spiral of closed mines, deterioration of towns and real estate, negative reputation of the region that is economically doomed and thus affected by emigration. In contrast, a thriving ecosystem attracts more resources, talent, and investment, which, in turn, foster a conducive climate for entrepreneurship. Due to this multi-facet character of a given entrepreneurial ecosystem, the transitions are highly context specific. What works in one region may not work in another due to differences in culture, regulatory frameworks, and

24

available resources. As a result, strategies and policies, in order to be effective and lead to the desired outcomes have to involve the local stakeholders and develop community specific responses. Starting from the concept of local ecosystems, smart specialization has been coined as an approach in the policy realm, encouraging communities to view their own entrepreneurial ecosystem in a perspective of global specialization, collaboration, and competitive positioning (The European Commission 2015). Smart specialization also highlights the importance of communication for the purpose of identification and gaining recognition: only be being visible and adequately promoting its successes, can a region benefit from a clear-cut profile and appreciation of its capabilities and specialization, whether internally or by the outside world. This is a particular challenge in the situation of a disruptive socio-economic transition like a coal exit, in which the image of the region in question is typically still connected with the old industrial specialization. The emerging new specialization is initially not yet, and in a later stage, tends to remain widely unknown to the outsiders. Communication and marketing play therefore a crucial role. On a deeper level, along with these strategic considerations go also shifts in the identities of the involved persons, families, and the entire communities. These changes of identity and the associated narratives can be both: sources of conflicts and/or a unifying force fostering change. Practical recommendations drawn from entrepreneurial ecosystems approaches When transitioning away from coal-based economies, regions can employ the entrepreneurial ecosystem framework and smart specialization perspective in order to take all relevant structural elements of the ecosystem into consideration. What adaptions are implied by the transformation in each dimension? What are the challenges and risks, and where lie opportunities and strengths? The following key points are of primary importance in practice. Diversification. Regions can use smart specialization to identify new industries or sectors in which they have a competitive advantage. The awareness of the different building blocks of entrepreneurial ecosystems is a key success factors for growth of new businesses. Innovation and Skills. Entrepreneurial ecosystems can be harnessed to encourage innovation, and redeployment of the existing as well as acquisition of new skills, thus ensuring that the workforce can adapt to the changing economic landscape after coalmine closure. Investment and Infrastructure. Regions can leverage concepts that lie in smart specialization to more efficiently attract investments, develop and adapt infrastructure, and create a supportive environment for emerging industries, thereby mitigating the economic impact of the coal exit. Collaboration. A clear awareness of stakeholders within a given entrepreneurial ecosystem fosters collaboration between local businesses, research institutions, and government agencies, which is crucial for the success of the transition. Both: entrepreneurial ecosystems and smart specialization promote such collaboration.

25

3.7 Insights: JUST Transition – normative context of sustainability policies, goals and KPI’s The concept Just Transition not only describes a transformation process. It also claims a qualitative property, i.e., that the transition ought to be just. In order to understand this normative aspect, it is useful to look at the history of Just Transition concepts and the recent trend of applying Just Transition concepts to climate protection policies. The term "Just Transition" is often attributed to the labor movement, and it gained recognition during the 1990s in the United States and Great Britain. The principles it represents have historical roots in earlier labor and social justice movements that advocated for fair treatment and protection of workers and communities affected by economic and industrial changes. The main concern was that any abrupt shift away from coal mining and other heavy industries could lead to job losses and economic hardships for workers and communities that rely on them. While in the 70-90’s of the 20th century, disruptions of industrial regions in the United Kingdom and the United States were driven by a loss of competitiveness of these sectors vis- a-vis quickly developing nations, such as South Korea, Japan, or China, in the wake of the collapse of the former Soviet bloc in 1989, the main culprits of the of the demise of the coal mining regions and heavy industries in Central and Eastern Europe were economic liberalization and rapid adaptation to the rules of the market-economy. It is only since approx. 2005 that climate concerns become to be a significant driver of socio-economical sector transformations. The presented below 2021 quote from the International Labor Organization clearly links the social concerns with the broader shift towards the green economy. „A Just Transition means greening the economy in a way that is as fair and inclusive as possible to everyone concerned, creating decent work opportunities and leaving no one behind.” International Labor Organization (2021) Over time, the concept has evolved and expanded to encompass a broader range of normative “justices”. Two major drivers influence the current ever more prominent role of the Just Transition concept and the policies: (1) the increasing physical deterioration of global natural resources and the global warming , and (2) the political activities in a form of multilateral negotiations intending to establish a consensus about values, goals, and targets in order to formalize these goals in form of international treaties (in other words, policy domains emphasizing multiple justices in terms of social equity, worker rights, and community well- being in the transition to a more sustainable and inclusive economy). “A just transition, broadly defined as ensuring that no one is left behind or pushed behind in the transition to low-carbon and environmentally sustainable economies and societies, can enable more ambitious climate action and provide an impetus to attaining the Sustainable Development Goals. Countries need to develop, through inclusive dialogue, approaches to a just transition that reflect the needs, priorities and realities of their societies and their historical responsibilities for climate change and environmental degradation.” United Nations Committee for Policy Development (2023) As a result of this international policy making process, a generalized normative framework of justices – the Sustainable Development Goals (SDGs) – have emerged and were adopted by the UN General Assembly in September 2015. SDGs consist of 17 parallel policy goals and 169 related targets, some of them being underpinned with measurable key performance indicators

26

(KPI’s). The relevance of a particular goal, target, or indicator has to be determined by each region or entity depending on the application case and situational context. At the same time, the portfolio of goals and indicators may serve as a publicly accessible, standardized data source. It provides a basic diagnostic instrument allowing to discern aspects of sustainability and resilience of a given community, as well as the challenges and risks that is needs to address. It helps to characterize the context of a given Just Transition. Practical recommendations drawn from entrepreneurial ecosystems approaches Discern carefully the normative elements of the disruptive force and its policy dimension. The pre-1990 regime in Albania had developed some clear-cut ideologically motivated policies – goals of autarky (local sourcing of coal and steel, widespread development of hydropower, weak road infrastructure aiming to increase defense capabilities of the population). Yet, the 1990s brought a deep change of the political system –the core change drivers where the concepts of a liberal market economy and subsequent privatizations. Nowadays, climate mitigation policies appear to be a driving force of coal exits amongst broader efforts of Albania to introduce international standards in national governance and adhere to SDGs. Identify and thoroughly understand the long-term policies and market trends, which drive the transition. In the situation of Albania, the European accession process and investment funds from development agencies, such as e.g., the World Bank, are setting criteria for continuing support and therefore represent quite a stable value and normative framework for the Just Transition process of the post-mining communities in Albania.

3.8 Insights: Uncertainty, Governmental Programs and Possibilism Despite all the theory and multiplicity of concepts, there is no “recipe” or a “fast track” towards a successful Just Transition. Any Just Transition has to be created by people on the ground and involve real life experimentation. It requires a lot of hard entrepreneurial work entails trial and failure practices. Transition is not a platitude of theory-practice differences. We know by sociological theory that in each socio-economic transition, there is a lot of unknown at the outset. One notable theoretical but practice-inspired perspective prominent in this field is "possibilism," which was introduced and elaborated upon by Albert O. Hirschman, an influential scholar in economics and social sciences (Hirschman, 1970). Possibilism offers a lens through which transition is perceived as a socio-economic process that hinges on exploration of possibilities, rather than as a deterministic path, and therefore it emphasizes such factors as uncertainty, agency, and adaptation. Such perspective seems particularly important in the context of predominantly top-down coal exit programs. Just by the nature of their agenda and target setting, as well as the built-in governance rules and structures, UN-, EU- and central government-driven exit transitions run the risk of a programmatic and thus deterministic mind set. Hirschman analyzed this type of bias in the World Bank’s programs at the time, making it particularly pertinent in the context of socio-economic transitions. At its core, possibilism is built on the premise that, even within challenging conditions, there are always opportunities for transformation and development. It encourages regions and communities facing socio-economic transitions, such as coal exit, to view constraints not as insurmountable barriers, but as potential triggers for innovation and reconfiguration. This outlook places considerable weight on the creative problem-solving capacity of societies,

27

underlining the need for adaptable and resilient approaches to address the unique challenges posed by socio-economic transitions. In the context of coal exit, possibilism becomes a valuable perspective. Coal-dependent regions, often confronting a decline in the coal industry, may perceive their situation as a daunting limitation. Possibilism fosters a spirit of optimism and empowerment, enabling regions to actively shape their developmental trajectories. By fostering a proactive approach and engaging in creative problem solving, such regions can potentially discover innovative solutions, harness underutilized resources, and stimulate new economic activities (Hirschman, 2013). Practical recommendations drawn from a possibilism approach The concept of possibilism, combined with the principles of subsidiarity and entrepreneurial agency, creates a framework for addressing the development challenges on a regional level. It encourages regions to see the potential for growth within their unique circumstances, to leverage the agency of local entrepreneurs, and to make decisions at the most appropriate level of governance. This holistic approach can contribute to more resilient and prosperous regional development, fostering a sense of hope and empowerment in the face of obstacles. Subsidiarity in Regional Development Decentralized Decision-Making. Subsidiarity is a principle in regional development that promotes decision-making at the most local level possible. It suggests that regional issues should be addressed by regional actors who have the best knowledge of the specific context. This aligns with Hirschman's view of self-help and with the principle that communities should be in charge of their own development. Tailored Approaches. Subsidiarity recognizes the diversity of regions and encourages tailored approaches to development. Instead of one-size-fits-all policies, it promotes policies and strategies that fit the unique needs and circumstances of each region. Community Empowerment. Subsidiarity empowers local communities to be actively engaged in the decision-making process. When communities have a say in matters that concern them, they develop a sense of ownership and commitment, which can be a powerful driver of change. Collaboration and Networking. While subsidiarity emphasizes local decision-making, it does not preclude collaboration and networking among regions. In fact, it encourages regions to learn from one another's experiences and best practices, thus creating a potential for more effective regional development strategies.

3.9 Insights: Examples of Just Transitions Frameworks – World Bank and European Union Over the last decade the concept of Just Transition has become an established field of research and has been adopted by key institutions, be it the United Nations, the International Labor Organizations, the World Bank, or national institutions, as a policy reference. Starting from the perspectives of socio-economic-technical systems outlined above, heuristic suggestions for the process of how to design and govern a Just Transition process have emerged. In this

28

section, we refer to two recent and comprehensive examples for institutional approaches: one developed by the World Bank (2020), and the second one adopted by the Wuppertal Institute as a part of a research project funded by the European Union (Wuppertal Institute, 2023). We with a reference to a recent publication on open issues of research in the field of sustainability transitions, intending to provide the reader with an understanding of open questions and debates that are present in the literature (Zhang, 2024). The “World Bank Coal Sector Transition Assessment Framework” has been initiated and developed by the World Bank and the European Commission on behalf of the European Union via a €500,000 technical assistance project in Western Macedonia, Greece by an international team of two team leaders and 9 experts. The elaboration of the transition road map started in 2019 and the final road map for the project was presented at the end of 2020. That document offers a detailed view on one specific mine closure and a transition road map using the World Bank’s methodology for coal transition based on a 3x3 Matrix (World Bank, 2022) that consists of three pillars running through three phases of mine closure. The three continuous pillars forming the Just Transition are: (1) institutional governance, (2) people and communities, and (3) environmental reclamation, and re-purposing of land and assets. The three phases are, in turn: (1) 10-18 months of pre-closure planning, (2) two plus years for closure, and (3) 5-10 years for regional transition. The detailed project report on Western Macedonia provides a valuable overview of research and development issues to be addressed in the road map development process and offers an example of setting up the transition project governance. In the case of Western Macedonia, four transition pathways were identified: alternative energy, green region, start-up economy, and digital region. Within a research project funded by the European Union’s Horizon 2020 research and innovation program, a research consortium led by the Wuppertal Institut prepared a study “Evaluation of design and implementation of decarbonization policy-mixes” in 2023. The resulting publicly available report “A Just Transition Readiness Evaluation Tool for coal and carbon-intensive regions” intends to offer a whole-system approach combining distributional, procedural, and recognitional justices. Its methodology is built on three principles (environmental, transition, and good governance and justice) that are applied to goals, definitions, and transition levers across 34 policy fields. For each of those field, “why”, “what”, and “how” considerations are explained in a one-page format. The study also provides a synopsis of Just Transition goals, i.e., “International reference documents for synthesizing just transition goals” including the United Nations Sustainable Development Goals. The report is insightful, contains valuable references to research in the related fields, and is rich in practical examples from recent projects (delivered in the last five to ten years) addressing just transition-related matters in the context of coal exits. We do not want to conclude this section without addressing some of the open issues and ongoing research in the field of sustainability transitions. As the concept of Just Transitions in the context of coal exits driven by climate policies emerged around 2005 and the life cycle of a complete socio-economic transition from mining towards a new industrial specialization of the affected region amounts to 30 – 50 years, we simply do not yet have the data and experience base to validate these concepts. The two studies mentioned above stem mostly from projects in the preparation stage of coal exit and are clearly policy driven. In order to allow the reader and stakeholders of the affected regions an independent view of state of Just Transition Concept, we refer to a recent publication by Zhang on Strategic Management and

29

Sustainability Transitions Theory and Practice (Zhang, 2024). Open theoretical questions concern the interaction and integration of ecological systems and human systems, the role of multi-national companies in the emergence of local circular economies, and the challenge of multi-stakeholder coordination in sustainability transformations. Practical examples from the food sector, SME sustainability transitions in emerging economies, or stakeholder coordination in the energy sector provide an appreciation of the diversity and space for creativity in managing sustainability transitions. Practical recommendations drawn from Just Transition Methodologies Each Just Transition has to be created locally. The two presented frameworks show that any Just Transition is a highly localized, creative process. The fact that the development of the road map for a Just Transition in Western Macedonia takes a 10-person expert team supported by local stakeholders more than two years illustrates well the complexity of the challenge. Therefore, a community facing such challenge requires support; it needs change-makers, entrepreneurs, and a strong support from the government in order to set up a Just Transition process that has a chance to achieve the set goals. Develop your own, unique Just Transition approach taking as much inspiration and lessons learned from experiences of others. There is much more knowledge and innovative ideas outside of any core team for the Just Transition than within such a team. Therefore, look elsewhere – learn from a wide variety of internet accessible sources like the earlier discussed the World Bank report and the Wuppertal Institute Tool Box, and adapt their findings to your needs and circumstances on the ground. Get inspired, copy what worked elsewhere, but select well and adapt so that the replicated solutions are closely tailored to your particular needs and aspirations. They have to integrate and reflect the local conditions. From our experience, selection of examples that are to be followed requires a profound, community-wide debate; a constructive conflict is necessary to identify the best way forward for the entire community. Collective bargaining of all parties involved is a key success factor of empowerment and mobilization of the local community. Start thinking about governance after the key players are identified and have committed themselves to the Just Transition. There are many possible governance structures for a Just Transition process. The most critical initial task is to identify the key players who have the will and capability to set up the process and drive it over several years. Once they are identified and have committed themselves, one can proceed to the next stage of designing a suitable, efficient governance structure, which allows to integrate key stakeholders into the process. It should be noted here that proper preparation and development of such a transition takes time for exploration, learning and adaptation. It cannot be rushed despite calls for "immediate solutions".

30

4. Description of Albanian coal sector and post-coal mining communities

4.1 Case Study: A miner’s biography

31

4.2 Case Study: Mining Community Krrabë and Mushqeta

32

33

4.3 National context and coal mining sector in Albania Albania is a small mountainous country on the western side of the Balkan peninsula in Southeastern Europe, with a land area of 28,748 square kilometers (km2). Albania shares borders with Montenegro to the northwest, Kosovo to the northeast, North Macedonia to the east, and Greece to the south. The country has a long coastline along the Adriatic and Ionian Seas which forms the majority of its western border. About 70% of Albania’s territory is mountainous with an average altitude of 700 meters (m) above sea level; in the east, Mount Korab is the highest peak of 2,753 m. Mountainous and hilly areas are located in three regions: Northern, Central, and Southern, while the plains occur to the West along the Adriatic coast, between Hani Hoti in the North and Vlora in the South. The high variability in terrain relief creates high rates of soil degradation and highly erosive river flows (National Adaptation Plan Albania, 2020). Albania is a highly biodiverse country. Its territory is comprised of maritime ecosystems, coastal zones, lakes, rivers, evergreen and broadleaf bushes, broadleaf forests, pine forests, alpine and subalpine pastures and meadows, and high mountain ecosystems. The narrow coastal belt (along the Adriatic and Ionian Seas), which represents less than 12% of the overall land surface, is globally significant from a biodiversity perspective (National Adaptation Plan Albania, 2020). Albania’s flora constitutes 29% of flora in Europe and 47% of flora in the Balkans. Its fauna includes a variety of mammals, birds, and reptiles, as well as sea, lake, and river fishes. Protected areas occupied a total area of 523,831 ha in 2020, representing 30.0% of the forest fund area and about 18.0% of the total country area. Albania is also well known for its rich and complex hydrographic network of rivers, lakes, wetlands, groundwater, and seas. Wetland ecosystems are important migration routes for migratory species of wild fauna (3 Ramsar sites of international importance have been designated, i.e., Karavasta Lagoon, Butrinti Lake, and Shkodra Lake). Albanian lakes and rivers are also important in terms of their contribution to the biological and landscape diversity of the country. About 247 natural lakes of different types and dimensions, and a considerable number of artificial lakes, are located in the country. The alteration to the natural flow regimes of rivers and streams and their floodplains and wetlands is recognized as a major factor contributing to the loss of biological diversity and ecological function in aquatic ecosystems, including floodplains. Albania is a rich country in water resources. The total annual rate of flow is 39.22 billion m3/year, where 95 % is discharged into the Adriatic Sea and only 5% into the Ionian Sea. Water resources are an important source of hydropower, producing around 90% of the country’s energy and providing irrigation for agriculture. However, water resources have been polluted in populated areas. (Albania’s Fourth National Communication, 2022). The geographical position of Albania determines its Mediterranean climate, characterized by mild and humid winters followed by hot and dry summers (Albania’s Third National Communication, 2016). The mean annual temperature (1901-2016) is 11.5°C, and mean precipitation is 1019.8 mm (Albania Revised NDC, 2021). It is characterized by mild winters with abundant precipitation and hot, dry summers. Based upon the relief of its territories and distance from the sea, Albania’s territory is divided in four climatic zones: Mediterranean Plain Zone, Mediterranean Hilly Zone, Mediterranean Pre-Mountain Zone, and Mediterranean Mountain Zone.

34

Figure 4.1 – Various data about Albania

(c) CO2 / capita (metric tons 2020) (d) Active coal power plants

(e) Percentage of hydropower (2015) (f) Active solar and wind power plants

(g) Employment rate +15 pop. (2022) (h) GDP per capita (constant 2015

US$, 2022)

(b) GDP growth & unemployment rate(a) Population & net migration

-30

-20

-10

0

10

20

30

1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021

GDP growth (annual %) Unemployment, total (% of total labor force) (modeled ILO estimate)

-70

-60

-50

-40

-30

-20

-10

0

2,5

2,6

2,7

2,8

2,9

3

3,1

3,2

3,3

3,4

1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020

Ta us

en de

M ill

io ne

n

Net migration Population Albania, total (Worldbank Data)

Source: data from the World Bank

35

All existing studies reveal that Albania is likely to become warmer under IPCC scenarios. The projected future trends define continuously increasing temperatures. The changes in annual temperatures in the Albanian Costal Area are likely to reach values of 1.7°C (1.3 to 2.2), 2.8°C (2.0 to 3.5) and 3.2°C (2.4 to 4.1) respectively by 2030, 2050, and 2100 compared to the reference period 1961-1990 For summer projections, the annual temperature change is likely to reach up to 5.3°C (4.6 - 6.0°C) by 2100. The coastal zone is unlikely to experience average temperatures less than 25°C by the summer of 2050; average temperatures up to 30°C will dominate in all the parts of this zone by 2100. The IPCC scenarios project the lowest increase for temperature in winter and higher increases in spring. All scenarios project a likely decrease in seasonal precipitation related to 1990 for all time horizons. Projected sea level rise will result in higher inundation risks for most urban areas along the coast and in increasing threats of coastal erosion (National Adaptation Plan of Albania, 2021). Albania has a fragile economy reliant on the service, industrial and agriculture sectors that faces a range of challenges in addressing climate change risks. Large part of the country’s terrain is conducive to seasonal flooding. Other challenges include both man-made and natural soil erosion, under regulated coastal development, tenure insecurity and contamination of the water supply, compounded by low public awareness of climate change. The vulnerability of Albania’s energy supply and agriculture sector to climatic changes, combined with a series of recent heavy floods and landslides, are elevating climate change preparedness as a priority within Albania’s development planning (Monitoring of the Climate Change Strategy in Albania, 2020-2030, 2021). Albania is at risk of various natural disasters. Earthquakes and large-scale river flooding pose the biggest danger. In addition to these, Albania is exposed to small-scale disasters related to floods, landslides, and extreme weather events. Vulnerability of the Albanian population to natural disasters of various scale is accompanied by poverty, poor quality infrastructure, and a variety of human-influenced environmental factors, from rapid deforestation and poor management of watersheds to environmental pollution (National Strategy for Disaster Risk Reduction and action plan 2023–2030, 2023).

4.3.1 Political and institutional context The Republic of Albania is a constitutional republic with a democratically elected parliament. The president is the Head of State and has general powers as Commander-in-Chief of the army and Chair of the national Security Council. He is also the head of the High Council of Justice. Legislative power is concentrated in the Albanian Parliament. The system of government is based on the separation and balance of legislative, executive, and judicial powers. Since the early 1990’s, the legislative power belongs to a single organ, the Assembly of Albania. The Assembly consists of 140 deputies. The Council of Ministers is selected at the beginning of each term of the parliament, as well as following a resignation or a removal of the Prime Minister. The latter is the main figure of the executive power. The Council of Ministers carries out foreign and domestic policies and directs and controls the activities of the ministries and other organs of state. The parliament must approve legislation proposed by the cabinet or it will not come into force.

36

The Judiciary of Albania interprets and applies the law of Albania. Albania's judicial system is a civil law system divided between courts with a regular civil and criminal jurisdiction, and administrative courts. It is governed by the High Council of Justice (Këshilli i Lartë i Drejtësisë), and its management is aided by the office of the President of Albania, the Ministry of Justice, and the various courts chairpersons (Albania’s Fourth National Communication, 2022). In 2015, Albania completed a restructuring of subnational governments ("territorial reform"), consolidating local government jurisdictions and decreasing the number of administrative units from 373 to 61 municipalities. This change was intended to give local governments more leverage to act on behalf of their constituents and to highlight the importance of involving subnational entities in any Climate Change Agreement (CCA) plan. In addition to the 61 municipalities, the country has 12 regions. While regions have a limited role, the municipalities have significant autonomy under the new structure. Social sector responsibilities are still largely centralized. However, for infrastructure, water supply and wastewater, and waste removal the municipalities have complete authority over their own processes (Advancing Albania’s planning for medium and long-term adaptation through the development of a National Adaptation Plan Process, 2020). In May 2016, the Government of Albania adopted the National Strategy for Development and Integration 2015-2020 (NSDI-II). This strategic document reflected the vision, priorities, objectives and means for social and economic development of the country up to 2020. Around 37 sectoral strategies adopted by the Albanian Government (and in three cases, by the Parliament) complemented the NSDI-II. The NSDI-II was organized around 13 cross-cutting foundations on good governance, democracy and rule of law, and four main sectoral pillars: i) growth through macroeconomic and fiscal stability ii) economic growth through enhanced competitiveness and innovation iii) investing in social capital and social cohesion iv) growth through sustainable use of natural resources and territorial development. The overarching goal of NSDI-II was the accession to the EU. After the EU’s decision in March 2014 to open accession talks with the country, Albania has been advancing the EU integration agenda. As part of the process, the country is transposing and implementing parts of the EU legislation - most national plans or actions, including in the environmental domain, have been designed since to consider policies and directives of the EU. Albania is also considering the EU’s strategies and plans for the Western Balkans of which Albania is part, such as the EU Economic and Investment Plan for the Western Balkans, adopted in October 2020, and the EU Green Deal for the Western Balkans, adopted in November 2020, among others. Besides the EU, Albania is an active participant in multilateral organizations and agreements. Albania is a signatory Party of the United Nations Framework Convention on Climate Change (UNFCCC), which was ratified by the Albanian Parliament in 1994. In April 2016, Albania signed the Paris Agreement. In December 2017, the Albanian Parliament unanimously approved a resolution confirming the country’s commitment to the 2030 Agenda and achievement of the Sustainable Development Goals. In line with global and regional commitments and national priorities, Albania has made progress on climate change mitigation and adaptation. In 2014, the Albanian government established the Inter-Ministerial Working Group on Climate Change (IMWGCC), which coordinates all institutions involved in climate change processes and facilitates the integration

37

of climate change into relevant new and existing policies, programs, and activities. In July 2019, Albania approved a National Climate Change Strategy and corresponding national mitigation and adaptation plans. The country has implemented several mitigation and adaptation projects and studies. There is currently a law “on climate change” which acts as the UNFCCC implementation law in Albania and covers requirements under the EU Emissions Trading System (ETS) Directive. This law requires all relevant ministries to mainstream climate change mitigation and adaptation issues into their legislation. The draft Decision of the Council of Ministers (DCM) “On monitoring and reporting GHG emissions and other information relevant to climate change at the national level” establishes a mechanism for monitoring and reporting of GHGs and other climate change information at the national level, as appropriate for a Non- Annex I party. There are still areas of national environmental policy that are yet to be implemented effectively. Albania does not have an umbrella policy framework for environmental protection; the recent Environmental Impact Assessment Directive is not always fully enforced, and the national strategy for air quality is yet to be adopted. There is also a need to adopt a climate policy consistent with the EU 2030 framework (Albania’s First Biennial Update Report, 2021).

4.3.2 Demographic context

Albania’s demographic profile has undergone significant changes since the 1960s and particularly during the years following the end of the Communist Regime, which involved profound social and economic reforms (Third National Communication of the Republic of Albania under the UNFCCC, 2016). Recent demographic developments show that Albania's population is shrinking. This is due to negative natural growth and most importantly negative net migration. Data from 2011 Census show that on 1 October 2011, the population of Albania was 2 821 977. It declined by around 8.0 percent, as compared to the 2001 census, where the enumerated population was 3 069 275. Most studies project that the demographic decline will continue (Albania Revised NDC, 2021). Figure 4.1a shows data of population evolution and a simulation for emigration (World Bank data 2024). Population dynamics are determined by four factors: births, deaths, immigration, and emigration. During the inter-cense period 2001-2011 the number of births per year has decreased significantly, from about 53 thousand in 2001 to about 34 thousand in 2011, while the number of deaths per year has remained stable at around 20 thousand. However, the population of Albania started to decline from 1990, as a consequence of a massive emigration. During the inter-cense period 2001-2011 is estimated that around 500 thousand persons emigrated. That fact is also supported by available migration data obtained from some of the main destination countries for Albanian emigrants, in terms of both stock and flow data. The population pyramid of 2011 as compared to that of 2001 shifted 10 years upward showing that a significant part of the 2001 population that is now in the age range of 20-45 is no longer living in the country. The difference is largely due to emigration, which typically occurs in this age bracket. It also shows that the number of children aged 0-9 that has been added to the population in the ten years before the 2011 census is much smaller than the corresponding number that was born in the ten years before the 2001 census (Census, 2011).

38

Albania is fairly densely populated. In 2018, the average population density was 99.7 inhabitants/km2. Recently Albania has experienced a strong urbanization process: urban population increased from one-third in the early 1990s to almost two-thirds (62%) in 2020 (Albania’s First Biennial Update Report, 2021), and is expected to increase to 78.2% by 2050 (Albania Country Risk Profile). The population density in the prefectures of Tirana and Durrës indicates higher values compared to other prefectures, respectively of 454 and 343 persons/km2, resulting from the continuous high flow internal movements towards these localities. (Census, 2011). In 2022, the largest city, the country’s capital Tirana, had an estimated population of 919,511. The second-largest metropolitan area of Durrës, only 30 km from Tirana, has an estimated population of 201,519 (2020). Other major cities include Vlorë, Elbasan, and Shkodër (Albania’s First Biennial Update Report, 2021). A third of the population (36%) lives in these coastal areas. The demographic changes that Albania is expected to go through until 2031 will have an impact on population’s distribution among the regions of the country. By 2031, only the population of the district of Tirana is expected to be higher than that of 2019, reaching about 954 thousand inhabitants. In other words, in 2031, about 35% of Albania's population is expected to live in or around the capital. Gjirokastër and Kukës, in turn, will continue to be the districts with the lowest population inhabiting, respectively, approx. 53 and 60 thousand people (INSTAT, 2023). Domestic migration to the coastal zones places more people at risk of coastal flooding, as the areas of their destination are highly susceptible to such phenomena. In addition, due to migration towards the coast, the remaining rural population becomes more vulnerable, as its large proportion is of higher age, poor, and dependent on small-scale agriculture (average farm size is 1.2 ha). During the period 2011 – 2018, the emigration rate of men turned out to be higher than the estimated numbers. These changes in migratory behavior have also entailed a change in the gender structure of the population (INSTAT, 2023). In 2011, Albania was a country where there were more men than women. That has changed in 2019, when the gender ratio in Albania indicated 99.8 men for every 100 women. According to updated projections, the gender ratio is expected to deepen in favor of women, reaching up to 89.1 men for every 100 women. The population of Albania ages and will continue to do so. It is expected that the median age will reach 42.1 years in 2031. That process is accompanied by a rapid increase in the elderly dependency ratio from about 20.5 elderly persons per 100 people of working age in 2019, to about 35.0 of the former for every 100 of the latter. During this period, the youth dependency ratio will remain at constant levels of around 25.0 young people for every 100 people of working age (INSTAT, 2023). Over the last three decades, social indicators have improved in Albania. In 2019 Albania’s Human Development Index (HDI) value, which considers life expectancy at birth, education, and gross national income per capita, was 0.795— which put the country in the high human development category— positioning it at 69 out of 189 countries and territories. In 2012, the most recent year with official poverty figures, 14.3% of Albanians lived below the national poverty line, while 1.1% lived below the international extreme poverty line, and 39.1% lived below the upper middle-income poverty line. Unemployment rate reached a historically low

39

of 11.4 % in Q3 of 2019. The latest Gini index was estimated at 33.2 in 2017 (0 representing equality and 100 inequality) (Albania’s Fourth National Communication, 2022).

4.3.3 Economic context

After 50 years of the communist rule, Albania has transformed from one of the poorest countries in Europe in the early 1990s to an upper-middle-income country in 2020. Following the dissolution of the Socialist Republic in the early 1990s, free market reforms began to open Albania to foreign investment (Climate Risk Country Profile, Albania 2021). Before the 1997 financial crisis, Albania was one of the fastest-growing economies in Europe (Third National Communication of the Republic of Albania under the UNFCCC, 2016). The country was also relatively less affected by the 2008 financial crisis than the rest of Europe. Its relative insulation from the global crisis is explained in a large part by (1) the low degree of integration of its financial sector with the rest of the world; (2) the presence of sufficient buffers of capital, liquidity, and accommodating monetary policy; and (3) the government’s counter-cyclical fiscal policy that focused on increasing internal demand through increased public investments. All those helped the country avoid the deep contractions experienced by the majority of the EU economies. Nonetheless, national economic growth rates have been falling since 2008, from 7.5% in 2008 to 1.1% in 2013, likely reflective of a delayed negative impact of the global economic downturn (National Strategy for Development and Integration 2015-2020). As a result of three decades of remarkable economic growth Albania’s gross domestic product (GDP) reached in 2020 US$ 14.89 billion in total, and US$ 5,246.1 per capita. Only 2 years later, in 2022, the GDP was 17.2 billion US$ and GDP/capita US$ 6089.5 (Albania’s Fourth National Communication, 2022; see Figure 4.1b). At the same time, the public debt has increased to over 65% in 2019 and reached 78.1% in 2021. This economic growth has been associated with structural economic changes, entailing a transition from an economy based on raw materials, agriculture, and industry, towards a more diverse economy where the services sector plays a leading role. In 2019, the services sector (represented by the subsectors of trade, transport, commercial activities, and telecommunication services) constituted about 50% of the GDP of the country. Industry and construction made up about 20% of the GDP and the agriculture sector contributed about 19% of the GDP (Albania’s Fourth National Communication, 2022). The socio-economic progress of Albania has been recently hampered by two shocks: the country was hit by a devastating earthquake in November 2019 and - in the midst of the reconstruction efforts - by the COVID-19 pandemic (Albania’s First Biennial Update Report, 2021). The earthquake, measuring 6.3 on the Richter scale, the strongest in 30 years, caused 51 fatalities, injured at least 913 people and affected over 200,000 people (17,000 people were displaced). It caused extensive damage to physical assets in 11 municipalities, including the two most populous and developed ones (Tirana and Durrës). Tourism assets and housing were hit the hardest. The earthquake led to losses equivalent to an estimated 7.5% of GDP. In the midst of the reconstruction efforts, the COVID-19 pandemic put significant pressure on the Government’s budget and response, strongly affecting the country’s socio-economic progress. Albania, as other virtually all European countries, was forced to resort to lockdown. As a result, the tourism sector, a key driver of the growth, was hit especially hard because of

40

containment measures and travel restrictions. In the second quarter of 2020, employment declined by 3.6% year-on-year. The earthquake and the pandemic significantly increased poverty, bringing its rates back to 2005 levels (Albania Revised NDC, 2021). The economy rebounded in 2021, driven by a strong recovery in tourism, a construction boom partly supported by post-earthquake reconstruction, and a record year for electricity production. Real GDP grew by 8.5%. Both employment and labor force participation recovered to pre-pandemic levels. The fiscal position saw significant consolidation. Public debt declined to 74% of GDP. Thanks to the €650 million Eurobond (4% of GDP), the government accumulated a liquidity buffer of almost 5% of GDP at the end of2021 (IMF Country Report No. 22/362, 2022). The Albanian economy is facing many risks and uncertainties. Further increases in food and energy prices are a key risk, especially if they trigger larger second-round effects and social unrest. Higher and more persistent inflation could further weigh on real income and weaken growth prospects. A more significant tightening in global financial conditions could hamper Albania’s access to external market financing. Risks are mitigated to some degree by the high level of FX reserves. The economy is also vulnerable to unfavorable weather conditions and a reversal in the rise of the real estate prices, given the sector’s growing contribution to the economy and banks’ rising exposure to the sector (IMF Country Report No. 22/362, 2022). Many vulnerabilities of climate change have to be related to sectors of socio-economic activities, namely: Hydrological systems, agriculture, energy, health, forestry, climate related hazards and disasters, ecosystems, species, tourism. In addition, inequalities and social vulnerabilities produced by uneven development processes can aggravate risks from climate change. Marginalized people are especially vulnerable to climate change as exemplified by illegal settlements along riverbanks and marginalized communities in areas like suburbs of Tirana, Këneta in Durrës, Mifol and the surroundings in Vlora, Shkodra and Lezha plain (National Adaptation Plan of Albania, 2021). The Albanian economy has maintained a positive growth rate in the last decade due to the untapped economic potential and the implementation of active economic reforms. The expectations of the country’s economic development, based on the performance of the private sector as the essential part of the country’s economy, coupled with the trends of exports, public investments in infrastructure and business support, testify to the continuation of a stable growth at around 3.4 % on the annual basis that is projected to continue throughout the period 2023-2025. Such growth is also supported by the expectations of the economic growth (2.7% in 2022) in the European Union, which is Albania’s main trading partner, amounting to about 2/3 of the country’s trade and being a destination of about 80 % of Albanian exports (National Strategy for Development and European Integration 2022-2030, 2023). The International Monetary fund assessed that given Albania’s high government debt, large gross financing needs, and tighter financial conditions; the authorities should take advantage of the still positive growth momentum and make efforts for faster debt reduction. This would reduce pressure on monetary policy to further raise interest rates to bring down inflation and facilitate external adjustment. The budget deficit target in 2023 is in line with IMF recommendation. However, given the prospect of elevated inflation the government should

41

raise more tax revenue through coherent measures and reprioritize spending to create room for higher targeted and temporary support for the most vulnerable without increasing the deficit goal. The government should also aim for a primary surplus of 1.5% of GDP in 2024, mainly through tax policy measures based on a sound Medium-Term Revenue Strategy (MTRS). The size of fiscal adjustment needed to achieve this goal would be comparable to that already envisaged for 2023 under the baseline. If downside risks were to materialize, automatic stabilizers should be allowed to operate and further temporary, targeted support to the vulnerable should be deployed. After the efficiency and transparency of public spending improve, a lower primary surplus of about 1 % of GDP could be considered starting in 2026, provided that fiscal risks are in check. This should serve, first and foremost, to support spending on human development needs and a green transition, and secondly, to address large infrastructure needs (IMF Country Report No. 22/362, 2022). Good progress was done in Albania regarding the wages increase. After a stop in the period of 2014-2021, in the last two years there have been significant increase of wages in the public sector, aiming to achieve US$ 950/month, as the average salary in 2024. Unfortunately, the picture is not the same in the private sector, therefore the Albanian authorities should find the real instruments to “push” the private sector toward a significant increase of their employees’ wages.

4.3.4 Coal deposits and mining activities Albania is considered a country rich in minerals and therefore surveying, exploration, exploitation, and processing of various minerals represent an important economic activity for the country. The history of coal production in Albania includes mines and processing plants. Coal has been traditionally a major source of energy for the industrial sector, and – to much lesser extent – of heating, for the households, as well as public and commercial services. Coal production decreased in period of 1986-1992 from 2.16 million to 0.367 million tons. This industry is mainly located in the central, southeastern, and southern part of Albania (Figure 4.2: Coal mine basins and coalmines in Albania map, see the map on the next page). In Albania, according to the mine closure projects, the coal reserves amount to about 130 million tons, and they are located in the following three main areas: about 86% in the Tirana area, about 10% in the Korça-Pogradeci area and about 4.4% in the area of Memaliaj. There are four Coal Basins of Albania:

• Korçë – Erseka – Coal Basin

• Memaliaj – Selenicë – Coal Basin

• Pogradec – Maliq – Coal Basin

• Tiranë – Kamëz – Vorë – Coal Basin A total of 22 mines with a capacity from 50,000 to 500,000 tons per year each have been exploited over the years. Opening of these mines has been made through horizontal (drifts), incline (slopes) and vertical (shafts) workings. In general, the mining depth is small and varies from the only open - pit mine (Korça - Erseka Coal Basin-Bezhan Mine) to 400 meters (Memaliaj Coal Basin). Albanian’s coals are generally of the lignite type with a calorific value of 2000– 5400 kcal/kg (3200–3300 on average). Some of the coal can be enriched after mining, producing concentrates with a calorific value up to 4500–5500 kcal/kg.

42

Figure 4.2 - Coal mine basins and coalmines in Albania map

4 Coal Basins

32 Coal Mines

43

The main lignite fields of Albania are located different regions: Tirana-Durrës (including Kamëz and Vorë Municipalities), Memaliaj, Pogradec, Maliq and Korça. Lignite is extracted from six mines in Tirana, three mines in Pogradec, and two mines in Korça. Peats are another source of energy and are located in the Maliq reservoir. They amount to about 156 million m³ (characteristics of those peats are an average calorific value of 2200 kcal/kg, humidity 11%, volatile matter 39%, and sulfur presence 1.1%). The development of mining activity in Albania can be divided into three main historical stages. First stage before 1944: in 1922, the geological map of Albania was drafted. It was the first of its kind in the Balkans. In 1929, the mining law of the Kingdom of Albania was adopted, paving the way for the process of surveying, exploration, and exploitation of minerals in the country. The first activities were done by foreign companies, mainly Italian and Austrian. The second stage from 1944 - 1994: The mining industry was a state monopoly, organized on the basis of regional enterprises. The products were mainly intended for the domestic market to meet the needs of the domestic economy (except for chrome ore which was mainly sent for export). The coal production was used only for domestic purposes, such as heating, energy generation, and steel production. The geological report on the detailed exploration of the Valias coal deposit (the largest in Albania) was prepared in 1969 by a group of authors of the Tirana geological enterprise. One year later (in 1970), on the basis of the geological report and with the support of the Chinese experts, the project for the opening and exploitation of the Valias mine was finalized. The marking of the industrial square of the mine began in September 1971, while the preparatory works for the drilling of the first shaft began in 1972. The first level in the first south-west panel of this site was cut with horizontal works in the absolute quota at -113.00 or at a depth of 157.6m from the surface. The opening of the horizontal works from the ventilation shaft started in May 1974, while from the main shaft in August of that year. Coal production began on 25.07.1978 and continued until 31.10.1994. Third stage from 1994 until today: After the political changes in 1990 the privatization process began (1994-ongoing). For facilitating that transition, a new legal and administrative framework based on free market rules was developed resulting, among others, in adoption of the Albanian Mine Law (approved by the Albanian parliament on 1994). Afterwards the sectors entered in the new phase of the liberalization of exploitation licenses. The public institutions (such as e.g., the Mining Institute), as well as private actors had performed an evaluation of all mines’ assets, which led to closure of non-effective mines and to establishing procedures for monitoring them. The following section provides more detailed data on total production per mine and proven reserves, whilst Figure 4.2 above shows the location of coal basins and mines in Albania. The closing mines had a dramatic social impact, as it entails loss of many jobs. From 15.000 people employed in the coal industry before 1991, there is only about 50 still working in the sector today. This process first started in 1991 by the implementation of the “shock therapy” and continued progressively. Between 1995-1996, when the closure of the first coalmines was implemented, around 40% of the miners lost their jobs, and the gradual decrease continued ever since. The last “hit” took place in 2000-2001 when the number was reduced to less than 200 miners. As indicated above, the current number is approximately 50. With an exception of a limited number of miners who resigned and decided to emigrate from the country, the laid

44

off workers were usually entitled to receive a financial support in accordance with the applied social scheme offering a very low payment (around 80-90 US$/month) for a maximum period of three years. Nowadays, most of the former miners are retired. At the time of shut down, majority of them emigrated and the remaining ones found a new job on their own, without any State support. There is no data on the number of former miners who continue to work in the sector in the countries of their current residence. Discussion: problematics related to the coal and lignite mining activities in Albania The use of coal has caused difficulties to the consumers because its net calorific value sometimes went under the design value for the equipment. The equipment was also subject to increased mechanical impact due to the high ash content and frequent slag formation, which led to frequent shut down of the boilers. However, the main factor explaining the sharp reduction of coal production in mid-1990s is a widespread partial or complete shutdown of industrial state-owned enterprises utilizing it as a fuel. The present structure of coal utilization is very different from the past. The main share of the current very small production is exported, and the remaining tiny portion is used by the industry for boilers and by the households for cooking and heating. The domestic technology of coal utilization is very old and not compatible with the nature of Albania coals, which are characterized by a high moisture, high ash and high Sulphur content, as well as low net calorific value. Therefore, impact of the use of coal is twofold, affecting the equipment and the environment. The former is often subject to extraordinary wear and tear leading to temporary stops or a complete halt of the operation. With regard to the latter, coal exploitation and use are associated with environmental pollution from ash and dangerous gases.

4.3.5 Energy market and power supply

Albania is a net importer of energy, particularly of electricity, and is intensively promoting the development of RES (Renewable Energy Sources), which are associated with an increasing level of imbalances in the electricity system. To ensure security of supply additional generation capacities should be built and diversified. The 2022 power generation status is provided in Table 4.1. In 2020, Albania achieved a basic level of implementation of the EU regulatory model in the electricity sector. However, the country still has a long way to go to fully implement the EU market model in the field of the electricity wholesale and regional market integration. This means that in the near and medium future (up to 10 years), further electricity market development and better integration with the regional market should put pressure to get the wholesale electricity prices down. The number of market participants has been increasing each year. Almost all (20) suppliers serve also as traders. Albania has the universal service supplier (FSHU sh.a.) and only one distribution system operator (OSSH sh.a.).

45

Table 4.1 - Power generation capacities by technology

Geothermal Fossil Fuels Hydro Nuclear Other

Renewables (specify)

Total

Capacity MWe

Gross Prod. GWh/yr.

Capacity MWe

Gross Prod. GWh/yr.

Capacity MWe

Gross Prod. GWh/yr.

Capacity MWe

Gross Prod. GWh/yr.

Capacity MWe

Gross Prod. GWh/yr.

Capacity MWe

Gross Prod. GWh/yr.

In operation 0 0 97 0 2,283 7,629 0 0 0 0 2,380 7,629

Under construction

0 0 0 0 557.8 2,435 0 0 0 0 557.8 2,435

Funds committed, but not yet under construction

0 0 0 0 1,204 5,391 0 0 50 50 1,254 5,391

Estimated total projected use

0 0 97 0 4,045 15,455 0 0 250 438 4,392 15,893

Table 4.2 - Electricity consumption in Albania 2018 – 2020 by consumer category

Items Unit 2018 2019 2020

C lu

st er

s o

f

C o

st u

m e

rs

Regulated market GWh 6424 6535 6538

Unregulated market GWh 1215 1077 1051

Qualified costumers in HV GWh 957 867 811

Qualified costumers at 35 kV GWh - 41 61

TSO – coverage of costs and own needs GWh 243 169 172

Transmitted energy at OSHEE network GWh 15 - -

FTL costumers in free market GWh - - 6

TOTAL GWh 7639 7612 7589

The establishment of the Albanian Power Exchange (ALPEX) is foreseen by the Law of the electricity sector of 2015. The “Electricity Market Model” that was approved in 2016 pursuant to adoption of the said law, decided that all preparations for establishing the Albanian Power Exchange should be completed by 2017. The Albanian Power Exchange is at the heart of the Albanian Market Model. As this was not achieved on time, the sector law was amended in 2018 and extended the deadlines. In 2019, the Council of Ministers approved the "Creation and definition of the legal form and the ownership structure of the capital of the market operator". In October 2020, the Albanian Power Exchange consisting of the following shareholders: KOSTT (Kosovo Transmission System and Market Operator) 42.75% and OST (Albanian Transmission System Operator 57.25%, was finally registered in the National Business Center. The Albanian Power Exchange started operations at the beginning of 2022. Selling electricity on the free market within the country is to be an increasingly present alternative as there are legally binding programs requiring that consumers connected to medium voltage (35/20/10/6 kV) are supplied only on the free market. Currently, besides customers connected to the high voltage, only customers connected to 35 kV are supplied on the free market, while those

46

connected to 20/10/6 kV are supplied on the regulated market at prices set by ERE (Free Market Supplier – FTL sh.a., and Last Resort Supplier – FMF sh.a., part of holding OSHEE sh.a.). Table 4.3 - Electricity wholesale market prices 2019 – 2020

Years Delivery interval Quantity (MWh) Price (€/MWh) Value (€)

(VAT excluded)

2019

Baseload 490 41.4 20,271

Hourly1 100,223 55.1 525,983

Peak 44,021 56.7 2,496,965

TOTAL 144,734 55.6 8,043,218

2020

Baseload 78,261 46.0 2,596,656

Hourly1 43,408 46.8 2,031,241

Peak 2,880 55.6 159,984

TOTAL 124,549 46.5 5,787,881

TOTAL

Baseload 78,751 45.9 3,616,927

Hourly1 143,631 52.6 7,557,223

Peak 46,901 56.7 2,656,949

TOTAL 269,283 51.4 13,831,099

4.4 Current situation in each of the post mining communities in Albania In accordance with the proposed holistic approach to mines as entrepreneurial ecosystems, the state of Just Transition in the post-mining communities of Albania is presented in this section by grouping the closed mines in clusters determined by their perceived communal centers. This seems to be crucial for a sound understanding of the transition process, as Albania exhibits a number of quite different post-coal mining situations. We discern (a) post- mining areas in the metropolitan area of Tirana, (b) medium centers (Korça, Pogradeci, Telepania) and (c) remote post-mining communities. For each community, a “Just Transition ID-Card” is completed to the authors’ best knowledge. The information basis has been scarce. And most of the information has been obtained through interviews and desk research. Due to the fact that 30 years have passed since 1990, including quite rough and disorganized liberalization period, official information sources are extremely weak and often contradict one another in terms of numbers and data. Therefore, in order to create an overview of the current situation, also non-scientific sources such as e.g., Google maps and Wikipedia have been used. In situation of disruptive socio-economic transitions, incomplete information is a typical phenomenon. As a result, it is crucial, to use any available data sources to provide transparency and visualize the ongoing dynamic processes at the earliest opportunity. In order to provide some contextual depth, two case studies – one containing the results of a field mission to the post-coal mining community of Krabbë and the second showing the reality of the Albanian coal mining over the last 40 years in a form of a miner’s biography – have been placed at the opening of this section (p. 30-32).

47

4.4.1 Mining Community Kamza

Transition Story

• Historically small town of

6.000 inhabitants (1975)

• Urbanization and

industrialization (mine)

during socialism

• Wild urbanization in vicinity

of Tirana in the 1990s

Activities & Projects

• Agricultural University of

Albania

• Since 1997 international

projects for urban

infrastructure

• City Train Project

Social: Inhabitants Miners

Ecological

Mine closure: 1995 (90%)

Methane:

Water:

Renewable Energy:

Climate risks:

Economical

Inhabitants/km² : 2802

Car: 11 km to Tirana, 0:20 h

Public: bus

1989 12.500

2001 53.000

2007

2011 66.841

1989 5.000

1995 750

2001 5

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Valias 1978 No.139, dated

20.03.1995 No.2978/2001 3.515.178 49.186.000

Just

Transition

Readiness

Score

Coal mine of Valias is located in the north-west of Tirana, approx. 10 km away from the

city. The general area of the mining field is 14 km², while the area of the mining activities is

4.2 km² or 420 ha. The region is characterized by a dense network of regional and national

highways. The exploitation of the Valias coal mine was carried out through vertical mining

works (shafts), such as: Main shaft; Auxiliary shaft No.1; Auxiliary shaft No. 2; Ventilation

shaft A1; Ventilation shaft A2 (North); Ventilation shaft A3 (Laknas-South). From 1973 to

June 1978 by N.N. Miniera. A total of 10,582 m of works were opened, of which: 6924 m of

horizontal works, 1873 m of inclined works, 1785 m of vertical works. After deepening of

the wells up to the first level -113.00 in 1974 the opening of horizontal works began. Coal

production started in 1978 and continued until 1994. In total 3,642,178 tons of coal with an

energetic value of 2,190 kcal/kg and a 47% impoverishment coefficient were produced. By

the decision No. 139 of the Council of Ministers, dated 20.03.1995, the mine was put in

liquidation (closure). The former ITNPM (Institute of Mineral Extraction and Processing

Technology) was tasked with drawing up the Technical Project for its closure with

implementing the decision of the Council of Ministers. The study envisaged: flooding

horizontal and steep works with water and filling all columns of vertical shafts with material

(fractionated limestone gravel), building (in certain cases) ambushes at their bottoms. That

study has never been implemented. The closing of the Valias mine was done according to

project No. 2916 prepared by the former ITNPM in 2004, with a budget of about

10,000,000 ALL (at that time approx. 84,000 US$) The scenario of closing the mine was

applied by plugging the mouths of the shafts on the surface with metal pipes and concrete

and surrounding them (in the perimeter calculated according to the technical requirements)

with walls. In addition, metal profiles were placed on them at a certain distance, connected

with wire networks.

Mining Community: Kamza

Coal Mines: Valias

governance people transition digital

48

4.4.2 Mining Community Vora

Transition Story

• Within wider metropolitan

area of Tirana

• Mine openings (1968 and

1980)

• 2008 tragic accident with

explosions in army depot

devastating part of town

Activities & Projects

• At major transport highway

in the economic zone of

Tirana-Durres

• Business zone attractive for

locating companies

Social: Inhabitants Miners

Ecological

Mine closure: 2000 (90%)

Methane:

Water:

Renewable Energy:

Climate risks:

Economical

Inhabitants/km² : 308

Car: 18 km to Tirana, 0:30 h

Public: bus, train

︎ 1990 825

1995 248

2001 5

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Gërdeci 1978 No.550, dated

26.08.1996 No.2978/2001 293.200 297.000

2 Manzë 1967 No.232, dated

15.05.1995 No.2978/2001 1.317.000 1.281.000

1989

2001

2007

2011 10.901

The mine of Gërdeci is located nearby town of Vora, 4.5 km from the railroad and 4 km from the Tirana-

Durrës highway. The first production started in 1978 and continued until 1995. The cumulated total

production is estimated in the range of 300,000 tons. The calorific value of coal is 1 750 kcal/kg. The coal

was mainly used in the bricks factory of Vora and TPP of Tirana. The coal basin is part of the Preza

anticline (southwest). The geological formations are form Miocene, Pliocene and Quaternary. In this basin

the coal layers are connected with clays and alevrolit. In total there are 11 layers, but the most important in

terms of industrial exploitation are layers 3, 4, V, IIIa, IIIb and Ib. For mining activities there were developed

25 000 m of mining works. The mine is located in the middle of a hilly terrain (130 m asl). Gërdeci creek

flows along the layer’s extension in the quotas of 70-80 m asl. The region is characterized form a highly

intensive hydrologic system, tending to intersect with the coal layers. The hydrology of the systems is not

very rich, mostly composed by five packages of alevrolites altered with sandstones. The water saturation is

very poor. Nowadays, the surface is covered by bushes, but prior the commencement of the mining

activities it was covered by oak trees, which were removed to enable coal exploitation. The tailings are

disposed in the slopes and along the valley together with the wagons. Their volume is estimated in the

range of 160 000 m3. In 1992 an implant for their treatment was constructed and has processed 50 000 m3

of tailings since. All remaining tailings are disposed in 6 damps.

The coal mine of Manza is located in the northeastern part of Durrës, 6 km away from the Tirana – Durrës

highway. The coal basin has bounder with Tirana on the southeast and Kruja on the northeast. The basin

extends along the hilly belt splitting Erzeni form the Tirana flatlands. The relief is very complex due to the

very complex hydrology and lithology of the formations. The coal production began in 1967. Until the

closure in 1993 the total production is estimated in the range of 1,317,000 tons of coal with a calorific

value of 1,960 kcal/kg. The mine was opened with horizontal and inclined galleries. A shaft was excavated

from the quota +60 m up to the quota -195 m asl (255 ml). The amount of the mining activities is estimated

in the range of 10,154 m. The primary consumers of the extracted coal were brick factories of Durrës,

Dibra, Shkodra, and Vora, the cement factory of Fushë-Kruja, and the construction enterprise of Laç. The

lava exploitation system with an extension in the range of 45m-50m was applied. The hydrology is

composed by sandstones, alevrolites, and clays formations. The water flow in the region is estimated in for

12 -13 l/sec. In total, mining excavation activities generated approx. 63 600 m3 of tailings, exploitation

generated approximately (1,317,000 x 25%/1.8 t/m3 =) 183 000 m3 of tailings, and shaft excavation

generated 6,700 m3 of tailings.

Mining Community: Vora

Coal Mines: Gërdeci & Manza

Just

Transition

Readiness

Score

governance people transition digital

49

4.4.3 Mining Community Kora

Transition Story

• Historically important city

• Industrialization during

socialism

• Loss of inhabitants after

1990

• Recently increase in

population

Activities & Projects

• University (7.000 students)

• Tourism

• Brewery

Social: Inhabitants Miners

Ecological

Mine closure: 2000 (23%)

Methan:

Water:

Renewable Energy:

Climate risks:

Economical

Inhabitants/km²:

Car: 163 km to Tirana, 2:52 h

Public: Bus, Train to Guri i Kuq, Pogradec

1989 63.623

2001 55.130

2007 86.176 ⁠*

2011 51.152 ⁠*

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Mborje- Drenovë

1930 No.349, dated

07.07.2000 No.2978/2001 1.100.000 3.698.000

⚒︎

1990 564

1995 169

2001 4

2011 n.n.

The coal mine of Mborje – Drenovë is located in the southeast of Albania, in Korçë

region. The basin is located at around 1000-1400 m asl. It is divided in three

geological formations. Geology, relief, hydrology and infrastructures constitute a basis

for such division. Geologically, the basin belongs to the monocline structure dipping

east, which represent the coal bearing structure of Oligocene, placed transgressively

over the serpentines ultrabasic. The formations are mainly sandstone and mergerless

intersected by granular dolomites bearing the coal reserves. Within the formation it is

possible to differentiate 4 layers: A, B, D & Dk. Among those only A & B are fully

explored, while D & Dk are partially explored, especially in their southern dipping. The

hydrology is related to the Oligocene aquifers and is composed of conglomerates,

sandstone, mergerless, and limestones. The tailings volumes in mine 2 are as follows:

production tailings - 21,500 x 0.25 = 5,400-ton x 0.6 m3/t = 3,300 m3; mining works -

500 m (backfilling) x 5m2 =2,500 m3 x1.5 = 3,800 m3; the total volume of tailings is

therefore 7,100 m3. The mining works of mine 2 are 2,440 x 5.2 x 0.6 = 7 600 m3.

Mining Community: Kora

Coal Mines: Mborje-Drenovë

Just

Transition

Readiness

Score

governance people transition digital

50

4.4.4 Mining Community Pogradeci

Transition Story

• Historically important city

• Mining town during socialism

• Two mines opened in 1985

and 1987, respectively

• Loss of inhabitants after

1990

• Closure of a train line

Activities & Projects

• UNESCO-Heritage Ohrid-

Region.

• Tourism

• Wood industry

• Wastewater treatment 2015

• National road connection

2022

Social: Inhabitants Miners

Ecological

Mine closure: 1995, 1998, 2000 (90%)

Methane:

Water: Wastewater

Waste: Municipal challenges

Renewable Energy:

Climate risks:

Economical

Car: 124 km to Tirana, 2:06 h

Train to Guri i Kuq, Pogradec

1989 73.733

2001 65.231

2007 59.786

2011 49.850

1990 2.241

1995 672

2001 10

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Alarup 1959 No.500, dated

13.08.1998 No.2978/2001 --- 1.600.000

2 Petrushë 1968 No.233, dated

15.05.1995 No.2978/2001 909.300 2.885.500

3 Dardhas 1972 No.349, dated

07.07.2000 No.2978/2001 1.076.100 6.087.000

4 Vërdovë 1978 No.349, dated

07.07.2000 No.2978/2001 900.000 2.300.000

5 Potgozhan 1985 No.233, dated

15.05.1995 No.2978/2001 105.000 10.869.700

6 Homezhë 1986 No.233, dated

15.05.1995 No.2978/2001 1.377.951 8.174.500

The coal mine of Alarup is located in the southeast of Pogradeci. Coal depositions of this basin are divided into three groups:

Lower facia; Middle facia; Upper facia; Lower facia depositions. All these depositions are represented by sandstones, shale

sandstones, alevrolites, and conglomerates. The area was tectonically very active in the post mineralization period. Alarup basin is

divided in two main tectonic zones, which are closing to the north and opening to the south. Alarup structure is a monocline, but it

is very complex due to the late tectonic activity. Ashes content for the first formation ranges between: 10.7-40%, with an average

of 23.5%; and for the second formation between 7-15%, with an average of 14%. Moisture for the first formation ranges between

10-34%. The calorific value is 4,070 kcal/kg and 4,750 kcal/kg is for the first and the second formation respectively. The mine

started operations in 1959 and until 1994 produced 1.22 million ton of coal. The coal was used in Elbasani steel factory, as well as

by the local community, Maliqi TPP, etc. Sulphur content is below 1%. Tailings volume from the mining works is 630 000 m3. They

are covered by the local vegetation and most of them are biodegraded. The coal basin of Pretush extends in southeast of

Pogradeci, nearby the national road Pogradec – Korçë, 500 m from the village of Pretush. The climate is Mediterranean &

continental. The basin is in the Mokra synclinal, whereas the Eocen deposition lays over the Upper Creta limestones. The tectonic

of the basin is very complex. In the coal bearing formation there are 30 layers dipping 8-13. 4 layers are exploited: I, I1, IIa and IIa1,

each being 0.7-0.85 m thick. The calorific value is about 2,000 kcal/kg. About 70% of the formations are sandstones, and the

remaining ones are alevrolites and sandy alevrolites. The total production of the mine is estimated at 1 million tons. The total

volume of tailings is estimated at 169,200 m3. The coal mine of Dardhas is located in the municipality of Pogradec, south-west of

Pogradeci town, 14 km west to the national road Pogradec – Korçë. The creeks of Krushë - Vërdovës, Rëmenjit, and of Dardhasit

belong to its hydrological system. These creeks flow into the lake of Ohrid. The coal bearing formation is composed by the

Oligocene (Dardhas) and Guri i Kamjes conglomerates. Conglomerates are also found over the coal bearing structure. The coal

layers intersect with sandstone and alevrolites. This formation is located in the eastern side of the Mokra synclinal, extended

southeast-northwest dipping 32°-100. The geological works have a very complex tectonic system. The coal production started in

1972, at the quota +1 124 m. The mine works are mostly characterized by Traver banks and field galleries and the quota +1 112 m

and +1 030 m. In total 8,770 ml of mining works have been excavated. The mine was closed in 1995 having produced in total

939,000 ton of coal with calorific value of 3,054 kcal/kg. All tailings are biodegraded, thus do not represent any environmental

concern. The coal mine of Vërdovë is located 5 km southwest of Pogradeci. The coal layers are located at the quotes 1000-1170

m asl. Climate is mediterranean continental. Geologically the formations are Aquitanian, matching with the Oligocene

conglomerates. The coal basin is located at the clay sandstone formations. The coal content is not uniform and extends to the

entire area of the structure. The coal basin has 5 industrial layers: II, V, VII, VIII, XI. The average thickness is 05-0.9 m. The

calorific value of coal is 3150 kcal/kg; ashes content amounts to 50% and sulphur to 4%. The sealing is stable, as is also the floor

of the layers. Traver banks are excavated at the quotas +955 m and +1025 m. The total production is estimated ate 900,000 tons.

Nowadays it is one of the 2 active coal mines in Albania, although its production volumes are very low. The total area of the coal

basin is 7-8 km2. The total volume of the tailings is at 36,100 m3 (17,000 m3 for Gallery 7/1, 4,100 m3 for Gallery, and 15,000 m3

for Traver bank. The Potgozhan coal mine is located 6 km from Pogradec in between the villages of Podgozhan-Kalivaç-Malinjë.

Climate is Mediterranean continental. The geological formations represent mixing of sandstone and alevrolit packages, as well as

a large number of coal shales. The coal bearing capacity is related to the alevrolites packages. The coal basin of Podgozhan is

located in the eastern side of the centroclinal of the Mokra synclinal. The depositions extend southeast-northwest dipping in the

west by 22°-8°. In the centroclinal the depositions dip south up to 10°. In total the coal bearing formation is composed by 40

layers. For the industrial purposes the most interesting layers are: I, IV, VIIIA and IX. The coal layers sealing is stable, except for

the layer 6. Along the opening of the mining works horizontal excavations were implemented. The total production of coal is

estimated at 300 000 tons, whilst the total volume of tailings is estimated at 130,000 m3 from the production and at 80 000 m3 from

the 27,000 ml of the mining works.

Mining Community: Pogradeci

Coal Mines: Alarup, Pretrushë, Dardhas, Vërdovë, Potgozhan, Homezhë

Just

Transition

Readiness

Score

governance people transition digital

51

4.4.5 Mining Community Tepelena

Transition Story

• Historical town @ road

junction

• Historical mining (2016)

• During socialism center of

detention (camps)

Activities & Projects

• Mineral Water Uji Tepelena

• Bënça National Protection

Area

Social: Inhabitants Miners

Ecological

Mine closure: 1996, 1999 (90%)

Methane:

Water:

Renewable Energy:

Climate risks:

Economical

Inhabitants/km² : 21

Car: 202 km to Tirana, 2:34 h

Public: none

1989

2001

2007

2011 3.342

⚒︎

1990 2.200

1995 660

2001 7

2011 n.n.

No. Mine

First Exploitation

Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Memaliaj

1&2 1916

No.268, dated 08.06.1999

No.2978/2001 10.126.170 8.200.000

2 Memaliaj 3 1980 No.29, dated 15.01.1996

No.2978/2001 --- 6.500.000

The source of Memaliaj coal, Tepelena district, has been known since 1914. In 1916 the first 8,000 tons of

coal were produced. Some production also took place during World War II. However, the first researches

were done only in 1950-1951. In 1974 and 1987 the geological reports of the place and the prospect of coal

retention in the Syncline of Memaliaj were developed. The Memaliaj Coal Extraction Mining Enterprise was

established in 1949, each year increasing its production. In 1972, near Well No. 1, due to technological

continuity, the coal enrichment plant was put into operation. The coal of this mine, as compared to other coal

fields of the Balkans, has a relatively high calorific value, but also a sulfur content above international

standards (about 3%, while less than 1% is allowed). Coal was sold to various consumers, such as: TPPs, the

Elbasan Metallurgical Plant, other industrial consumers (e.g., for the production of building materials),

municipalities, etc. At its peak, the Memaliaj Mine produced 540,000 tons of coal per year, a figure that

represented 25-30% of the entire national output. Out of 12 layers found in the fields I, II, and III, only the 5th,

6th, 7th, 2nd, 4a and 4th layers are considered industrial.

− Layer 5: The thickness ranges from 0.48 to 0.87m, with a strength of up to 2. The ceiling consists of

organic breccia with a strength of 3-4, not very compact with average cementation. Therefore, the

stability of the ceiling with plastic properties is not great and the bending is done 3-4 ml from the front

of the lava. The thickness of the breccias is very small, up to 10 cm, which is lost in places and the

coal layer comes into direct contact with massive clays with a gradual transition to siltstone. The floor

consists of compact clay and siltstone in places;

− Layer 6: its thickness varies from 0.61 to .081 m with strength up to 3 m. It consists of one or two

inserts from 0.10 to 0.27 cm. The ceiling has no plastic properties, it is made of siltstone, some clay

and false ceiling 0.10-0.20 m. It first weighs down and then breaks into blocks at a distance of 2-4 ml

from the front of the lava. The floor is made of soft clays that swell and reduce the workspace;

− Layer 7: The thickness of the layer ranges from 0.58 to 0.76 m with one or two 0.10-0.27 m

intercalations, with a strength of 3-4. The ceiling consists mainly of clay with a false ceiling of 0.15-

0.20 m. The floor appears strong and flat.

The number of geological reserves of layers V, VI and VII was 8,773,870 tons.

− Layer 4: It has an unstable ceiling and breaks easily into irregular blocks, while the floor is somewhat

stable. Regarding other technical properties, they are similar to layers 5&6;

− Layer 4a: It has an unstable ceiling, its bending occurs 5m before the lava, while the collapse reaches

7-8 times the thickness of the coal layer.

Mining Community: Tepelena

Coal Mines: Memaliaj

Just

Transition

Readiness

Score

governance people transition digital

52

4.4.6 Mining Community Tirana Agglomeration

Transition Story

• Wider metropolitan area of

the capital Tirana

• Historical (1938) and

socialistic mine openings

(1968, 1980)

• After 1995 predominantly

urban

Activities & Projects

• Central government

• Public Universities

• Private Universities

• Industry

• Tourism

• Culture

Social: Inhabitants Miners

Agglomeration 895.042 (2008)

Ecological

Mine closure: 1996, 2001 (90%)

Methane: Krrabë

Water: Krrabë

Renewable Energy:

Climate risks:

Economical

Inhabitants/km² : 805

Car: 10-30 km to Tirana, 0:40 h

Public: bus

1990 2.092

1995 628

2001 6

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Mëzezi 1968 No.824, dated

04.12.1996 No.2978/2001 1.435.320 1.426.000

2 Mushqeta 1968 No.550, dated

26.08.1996 No.2978/2001 2.300.000 5.365.000

3 Krrabë 1938 No.101, dated

02.03.2001 No.2978/2001 1.658.270 8.100.000

4 Priska 2 1980 No.550, dated

26.08.1996 No.2978/2001 374.057 2.682.000

5 Priskë 1980 No.101, dated

02.03.2001 No.2978/2001 --- 2.460.000

1979 189.000

1989 238.057

2001 343.078

2011 418.495

Krraba

The coal mine of Priska is located close to Tirana, approx. 8 km from the national road Tirana-Dajt. The coal basin extends as a belt at the

base of the Dajti mountain range starting from villages of Surrel and Priska up to the village of Përcëllesh in the south. Climate is

Mediterranean. From the geological point of view, the Tortonian depositions are the most interesting, as they are directly related with the

coal bearing capacity. That formation is divided in three sublayers: Priska; Skutem, and Ibë, which are all very complex. Layers I-IV do not

represent any value in terms of the industrial exploitation potential. However, layer V does. The average thickness is 52 cm. The calorific

value is 3870 kcal/kg. Ash content is 34.5%. The mine started production in 1949. Until 1959 2,000 ml of mining works were developed and

the mine produced 120,000 tons of coal. After that the production stopped and then was restarted and continued until 01.10.1996. In the

second period of activity approx. 374,000 ton of coal with calorific value of 3,500 kcal/kg were produced. In total, 11,326 ml of mining work

were developed. The coal supplied the TPP of Tirana, cement factory of Fushë-Krujë, etc. For the mining activities the Traver banks were

excavated at the quotas of +540 m, +480 m, and +380 m. The second phase continued with the excavation of the Traver banks at the quota

+480 to +80 m; +268 and the shaft (+268 to+80). The hydrology is very complex. The water mineralization is very high (0.8 gr/l, and strength

of 22° German scale, but there are not corrosives). The water flows are 2 l/s. The tailings volume is estimated at: 11,326 x 5.2 x 1.2 =

70,670 m3 for mining works, and for the production, which amounted to 374,000 tons in total they are estimated at (374,000 x 0.3)/1.8 = 62

330 m3.

Mushqeta mine is located approx. 20 km southeast of Tirana, along the Tiran-Elbasan highway. The coal basin covers an extended area

including the northeastern side nearby villages of Pëllumbaj and Kryezi, as well as coal mine of Krrabë. In its southwestern part it borders

villages of Mushqeta, Bërzhita, and Dobresh. The relief is very complex and represent a hilly chain that is very difficult to pass. Hydrologic

system is mostly composed of river of Zalli and creek of Lera. The climate is Mediterranean. Flora is very rich. While the area is covered

mostly with bushes, the region features also many orchards, vineyards, and olives trees. The mining activities commenced in 1968 with the

first Traver bank at the +425 m asl quota till the quota +530 m asl. At the later stage the second Traver bank +333 m and +240 m was

excavated. The first phase of mine development includes the works at the horizon +240 m to +530 m, whilst in the second phase the works

were done below the horizon +240 m to -30 m via a three levels shaft (+150, +60, and -30 m). The designed capacity of the mine was

100,000 t/year, for 30-years. Until 1994 the total production is estimated at 2.2 million tons. In total 8 400 ml of mining works were

developed. The calorific value of the extracted coal is estimated at 2 500 kcal/kg. The geological formations are mainly Tortonian

depositions. The basin is a part of the Tirana synclinal. The industrial interest was related only to the layers of Krrabë, Mushqeta, Bërzhita,

Pëllumbaj, Erzeni, and Kryeziu, precisely with the layers 1b, 1, and 2.

− Layer 1b extends for approx. 2 km (the thickness is 20-10 cm, inclination is 25°-50°);

− Layer 2 extends for 5 km (unstable alevrolites; the layer thickness is about 50 cm);

− Layer 1 extends for 2.8 km.

The coal mine represent and artesian pond composed of the aquifers of Tortonian and Helvetian. The Tortonian represent 7-9 sandstone

aquifers isolated by clays in proximity of layers 2 and 1b. Helvetian represent the coal bearing floor of the coal basin. Tailings from the mine

excavation activities are estimated at 63,000 m3 and from the mining activities at 244,000 m3.

The coal mine of Krrabë is located 25 km southwest of Tirana, in proximity of Tirana-Elbasan highway. The coal basin extends northwest of

villages of Pëllumbaj-Kryezi, borders the village of Skuterra in the east, and the village of Mushqeta in southwest. The geological formations

are mainly Tortonian to middle Miocene. There are also some quaternary depositions represented by alluvions and delluvions of the Erzeni

and Zalli riverbeds. The coal bearing formations intersect with the aquifers of the Tortonian complex and Helvetian. Industrial value is

presented only by layers 1 (composed of shale, clays, and alevrolites – thickness 0.3-1.5 m) and 2 (composed of compact alevrites -

thickness 0.5-0.61 m). Until 01.01.2000 1,658,270 tons of coal with calorific value of 3,474 kcal/kg were produced in total. The mining works

are estimated at 97,762 ml. The mining works tailings are estimated at: 97 762m x 5.2m2 x 1.2 = 610 000m3. The production tailings are

estimated at (1 658 270 x 0.2)/1.8 = 184 252 m3.

Mining Community: Tirana

Coal Mines: Priska, Mushqeta & Krrabë

Just

Transition

Readiness

Score

governance people transition digital

53

4.4.7 Mining Community Maliq

Transition Story

• Traditional agricultural town

• Agriculture (lake transformed

into pastries) & mining

industry during socialism

• Mining activities until 2000

• Administrative reform 2015

bashkia Maliq

Activities & Projects

• Agriculture

• Food industry

• Tourism

Social: Inhabitants Miners

Ecological

Mine closure: 1995, 1998, 2000 (90%)

Methane:

Water:

Renewable Energy:

Climate risks:

Economical

Inhabitants/km²: 64

Car: 151 km to Tirana, 2:36 h

Public: none

1989 63.623

2001

2007

2011 4.290⁠

1990 869

1995 261

2001 8

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Selckë 1984 No.233, dated

15.05.1995 No.2978/2001 253.563 125.000

2 Babjen 1984 No.233, dated

15.05.1995 No.2978/2001 75.236 478.562

3 Krosnisht 1978 No.500, dated

13.08.1998 No.2978/2001 1.342.174 496.000

4 Qenckë 1978 No.349, dated

07.07.2000 No.2978/2001 23.000 69.750

The coal basin of Selcë belongs to the coal basin of Gorë, one of the largest basins of

Korçë. The mine started operations in 1984. Galleries have been excavated at the

quotas +805 m and 840 m asl, and the Traver bank at the quota +780 m. Until 1991,

500 ml of mining works were developed and total of 253,563 tons of coal with calorific

value of 1,965 kcal/kg were produced. The coal was used in Maliqi TPP and in the

steel factory of Elbasani. The Babien sector is located on the other side of Devolli

river. This sector was exploited via horizontal and oriented galleries. In the period of

1986-1992 75,236 ton of coal with calorific value of 1,971 kcal/kg were produced. The

geology of Selcë represent Gora depositions. These depositions are placed over the

coral’s limestones of midmountain, sometimes over the ultrabasic rocks. The

formation is divided into 2 coal bearing structures: the lower one contains 8 coal

bearing layers, and the upper one contains additional 2. The most interesting is layer

3. The formation of Babien is a part of the west toward southwest syncline of Gorë-

Mokër. Besides the coal bearing formations of Gorë, there are also the ultrabasic

layers, base conglomerates of Verbës, coral’s limestones of midmountain and alevrolit

structure of Qenckë. From the 8 layers only layer 5/1 has an industrial value. The

tailings are fully biodegraded therefore they do not represent any environmental

concern anymore.

Mining Community: Maliq

Coal Mines: Krosnisht, Selcë, Qenck & Babien

Just

Transition

Readiness

Score

governance people transition digital

︎ ⚒

54

4.4.8 Mining Community Kolonja

Transition Story

• Historically important city

• Industrialization during

socialism

• Loss of inhabitants after

1990

• Recently rapid decrease in

population

Activities & Projects

• Agriculture

• Brewery

• Tourism (potential for

mountaineering)

Social: Inhabitants Miners

Ecological

Mine closure: 1995 (13%)

Methane:

Water:

Renewable Energy:

Climate risks:

Economical

13 inhabitants/km²

Car: 204 km to Tirana, 3:35 h

Public: Bus

1990 9.621

2001 8.800

2007 8.400

2011 7.500

1990 548

1995 164

2001 2

2011 n.n.

No. Mine First

Exploitation Date

DoCM date on Mine Closing

AKBN Register Date

Production (tons)

Estimated Reserves (tons)

1 Bezhan 1972 No.233, dated

15.05.1995 No.2978/2001 1.068.519 7.714.000

Mining Community: Kolonja (Ersekë)

Coal Mines: Bezhan

Bezhani coal basin is located at the Kolonja flats. The geological formations are

Molasses – fourth cycle of Molasses – Miocene. The formation area is 0.8 km2. The

geometry of the basin represents a syncline extending for 1.5 km toward northwest-

southeast dipping toward south-southwest by 15°. The clay depositions constitute

75% of 200 m of total thickness. Layer 1 represent the primary coal bearing layer and

lays above the coal sealings. Thickness at the surface is 6 m. The production started

in 1972. At first coal was extracted from an open pit at the quota +1060 m asl.

Underground exploitation started in 1979. The total production is estimated at 1.1

million ton, out of which 750,000 ton was extracted from an open pit. In total 12,838

ml of mining works were developed. The calorific value of the coal is 2,100 kcal/kg.

Tow aquifers are located at the coal basin: Gramoz aquifer, yielding 0.02-0.2 l/s;

Quaternary aquifer, yielding 0.1-1.5 l/s. Volume of tailings for the mining works is

estimated at 12,838 x 5.2 x 1.2 = 80,110 m3. The production tailings are estimated at

1.07 x 106 x 0.25/1.8 = 148 600 m3.

Just

Transition

Readiness

Score

governance people transition digital

⚒︎

55

5. Assessment of Just Transition Readiness of the Coal Sector in Albania The assessment of the Just Transition Readiness of the coal mining sector in Albania proceeds in three steps. In a quantitative analysis a set of KPI’s ideally available for the Just Transition are defined for four pillars and six dimensions of the Just Transition. For reasons of limited data availability, we develop a small model as a digital twin of the socio-economic transformation based on assumptions from the fact-finding missions conducted for the purpose of developing this study in September and December 2023. The digital twin provides a quantitative appreciation of the dynamic evolution of the socio-economic transition as well as some of its key features. In the second step we proceed to a qualitative analysis. We employ the concepts of multi-level-transition, supply chain, and value nets, as well as entrepreneurial ecosystems to map the socio-economic transition of coal exit in Albania and develop a deeper understanding of its features, challenges, and opportunities. Finally, we proceed to an expert- based assessment of the Just Transition readiness of the coal mining sector in the country utilizing a maturity model for Just Transitions based on the three pillars and six dimensions used for the set of KPI and the digital twin.

5.1 Digital Twin and quantitative analysis of the coal mining exit in Albania In order to assess Albania’s readiness for Just Transition we propose a data model with 8 dimensions and 5 levels. The dimensions are an extension of the three pillars approach adopted by the World Bank (see p. 28), but they have two instead of one dimension for each pillar. In the “Governance” pillar, we distinguish “State Level Governance” and “Regional Agency”. In the “People” pillar, we distinguish “People Care”, which assesses supportive measures to compensate for hardships, and “People Growth”. The latter helps to track the measures put in place to foster capabilities for adaptation. The pillar of “Transformation” distinguishes the ecological aspects with “Ecological Healing” and the creation of substitute employment in the dimension of “New Economy”. The fourth pillar of “Digitalization” is introduced with the two dimensions of “Data Transparency” and “Digital Cooperation”. For each of the dimensions, we suggest criteria, as a guidance to rate the Just Transition Readiness at each level and dimension. Governance. In most of the fundamental concepts, governance is a key dimension. In the MLST-model, it is typically associated with the landscape level. In Isenberg’s entrepreneurial ecosystem it appears directly in the aspects of policy, finance, and infrastructures. Regional Agency. According to possibilism and entrepreneurial ecosystem concepts, decentralized agency and individual ownership is key to a successful development of communities affected by disruptions such as coal exit. Without it, governance in a top-down manner will have considerable difficulties – especially in an open market economy – to develop a new regional specialization. People Care. Shut down of businesses which until now have been sources of income for dedicated workforce, breaks the bond between the two, leaving the latter in a position of a “lost investment” of time (career-wise) and commitment (in monetary terms, resulting from the loss of income and a great deal of social security). Depending on their age and alternatives at hand, employees of the closing businesses bear therefore the brunt of the disruption. These individuals and communities need support in order to adapt to the new, challenging situation.

56

Especially, if the disruption comes on a short notice. Typically, the capability to adapt depends on a number of factors, such as: worker’s age and qualifications, as well as the speed of the disruption (how many years remain before complete shutdown). People Growth. As a result of a change, people always need to start doing things differently than before. The change is driven by entrepreneurs and people who react to the new situation by learning and employing new skills. The latter are the result of formal education and vocational training undertaken in response to the disturbance, as well as the regional culture. In a coal exit, the established institutions, social roles, communities, and networks are challenged and have to reinvent themselves to serve the new economy. A newly, inspiring and innovative educational and vocational system has to be built. The reorientation leads towards creation of a new economic model that provides the youth with new educational and career opportunities, which they need to adapt to in terms of capabilities and the mindset. Ecological Healing. In general, carbon intensive industries of scale consume various types of resources – water, air, land, minerals, flora, fauna, etc. Ideally, following the closure the initial state of natural environment is reestablished. Sometimes, however, that is not possible. In such case, the objective is to establish a new well-balanced natural ecosystem that does not pose any risks to the adjacent ecosystems. This requires undertaking multiple carefully identified targeted measures to stabilize the land, seal mine entries, address water- and methane-related issues, recultivate and develop the areas and assets, etc. New Economy. As we have seen in the research insight sections about socio-economic transitions, these changes occur everywhere. The Just Transition becomes relevant, when regions, as well as individuals become economically redundant because their traditional industrial activities cease to be competitive and therefore are no more sought for. Individuals and regions are stripped of their occupational basis to earn their living. In such case, the most urgent and indeed existential need is to develop a new sustainable economic model providing those individuals and the region with a solid, well defined, and widely acceptable foundation for profitable business activities. In order to be economically sustainable, the latter cannot be subsidized or offered any preferential treatment not aligned with the principles of the market economy. As it takes between 5 to 40 years or more to establish new and resilient business, this is probably the most challenging task in a just transition. Therefore, in many cases of transition, particularly those when the proposed change needs to be implemented on a fast pace, its success depends on attracting existing business from elsewhere to invest into the region. The will, knowhow, and capability for regional business development is a crucial dimension to assess the readiness of a given area for Just Transitions. Data Transparency. Coordination is key, both in socio-economic transitions – for example between the different levels niche-regime-landscape – as well as in entrepreneurial ecosystems between the six dimensions – e.g., between markets, human resources, and policies. A precondition for effective coordination is data and information. Therefore, it is critical to get, as quickly as possible, a good understanding of the multifaceted, multi-level socio economic situation and the state of the entrepreneurial ecosystem. It will help with identifying the relevant players and the measures that need to be introduced to have the transition take off.

57

Digital Cooperation. Climate Change as well as Just Transitions are a race against time. Rapid communication and spontaneous initiative are key to succeed. Therefore, the degree of accessibility and ease of coordination is a critical success factor. Why do we extend the basic three-pillar model? Judging from our own experience in just transitions, as well as from the theoretical foundations of possibilism, institutional governance has to be complemented with agency and ownership in the region. Consequently, we differentiate the first two dimensions. In both the “People” and the “Reuse” pillars we take care of what exists and of what is new. This reflects the principle of “learning”, that means that a transition requires, on the one hand, detachment from the existing, no more competitive reality, and on the other hand, embracing new concepts and modes of operation. We cannot seek change and at the same time try to keep everything from the past. Transitions needs rupture, and that is why we split each of the first two pillars into two. Finally, socio-economic transitions in a digital world offer different options than the transitions form the pre-digital times. We embrace and encourage data and the “digital first” approaches for data-based learning and extended multi-stakeholder digital cooperation.

58

Table 5.1 - Just Transition maturity model of four pillar and eight dimensions (a)

Dimension Institutional Governance S

Neutral No activity on government level

Basic Use of Term Just Transition in programs

Managed Use as a program in one government agency

Defined Responsibility attributed to a governmental. agency and integration in power sharing

Established Defined program with operations over more than 5 years

Dimension Regional Agency and Entrepreneurship S

Neutral No regional players involved

Basic Regional players are part of project or governance structures

Managed Established local organization. Participates in development process.

Defined Established local organization has an assigned role of certain independence.

Established Local organization manages the transformation process in coordination with central

governance.

Dimension People and Community Care S

Neutral No support scheme

Basic General unemployment scheme

Managed Information and support campaigns / services to cope with increased information and

care need.

Defined Prevision, negotiation or announcement of a specific support scheme (money

allocation, training) for the affected workers.

Established Program effectively running. A significant proportion of the vulnerable are effectively

receiving financial support for a period > 2 years.

Dimension People and Community Growth S

Neutral No adaption of existing educational programs. No dedicated training programs for

affected workers.

Basic Resources available for requalification and training for affected workers.

Managed New educational programs for new vocations complement existing ones.

Defined A defined adaptation strategy of relevant educational institutions of the affected

community.

Established New educational programs in public-private partnership matched with a new smart

specialization strategy of the community. First cohort of students completed the

program.

59

Table 5.1 - Just Transition maturity model of four pillar and eight dimensions (b)

Dimension Ecological Healing S

Neutral No analysis or measures taken.

Basic Analysis of ecological impact and risks has been undertaken.

Managed A government agency is in charge of surveying environmental harm.

Defined A government agency is assigned, a reclamation program decided and resources

allocated.

Established A reclamation has been conducted covering all locations, including projects, budgets

and monitoring for measures. Measures running since more than 2 years.

Dimension New Economy S

Neutral No new business.

Basic Spontaneous, new businesses without a focus.

Managed An agency is assigned or a local initiative active in the support of developing new local

business.

Defined An agency / initiative is officially in charge of new business promotion and attraction.

Services, Program and dedicated staff exists. A strategy for a new economic

specialization exists.

Established Agency/ initiative exist since several years including dedicated staff. First companies

emerged, possibly already a new anchor business, which could serve as a basis for a

new smart specialization of the community.

Dimension Data Transparency S

Neutral No social, economic, or ecological data available.

Basic Some of the data available, but fragmented and inconsistent.

Managed Some of the data available in a structured form, collected by civil, scientific agents.

Defined Government organizes in a systematic way social, economic, or ecological data

relevant for the transition.

Established Government sources provide ample transparency in systematic way on social,

economic, or ecological data as well as the KPI’s of the transition.

Dimension Digital Cooperation S

Neutral No trace on the internet.

Basic 1-3 actors identifiable in the internet as contact points.

Managed 1 or more initiatives or organizations invite to be contacted on the matter and present

their role in the Just Transition.

Defined Defined roles for initiatives and government agencies on a central and community

level. Different players in the ecosystem.

Established Transparent coordination for defined players on central and decentral level. Events

and processes of coordination transparent and open for access.

60

As a starting point, a minimum set of KPI’s for the quantitative analysis of the Just Transition is listed in Table 5.2. It includes an assessment of the data readiness of statistical information in Albania. At a later stage of the Just Transition process, this set can be expanded, so that it provides for a more detailed monitoring and understanding. At the moment, the data availability about Albania for the time span of 1988 – 2023 is very fragmented. Especially the period of adaptation from 1990 to 2015 lacks statistical information and is characterized by administrative reforms which brought a change in statistical categories. In the last decade, the official statistical office of Albania has been gradually adopting the internationally standardized categories and methodology. As a result, the data situation improves rapidly. In light of the above, in the process of developing this study we could not rely on the detailed databases, especially for the period of the widespread mine closures in 1990 – 2011. We also did not have access to any sub-national level statistics for the affected communities and their entrepreneurial ecosystems. Table 5.2 - Set of KPI’s for Just Transition four pillars and eight dimensions model

Just Transition

Maturity

Albania

Useful KPIs for Tracking Data Availability (in this

study)

Governance $ allocated to support programs, FTE dedicated Not available

Regional Agency FTE dedicated to Just Transition

New enterprise creation on the community level

New Jobs creation on the community level

Not available

People Care Employees Coal sector

FTE in transition schemes (pension -> vanish if

national pension scheme exists)

Selected numbers,

estimates

People Develop Training and Requalification programs

Students and vocational training in Mining

New study programs created at traditional faculties

Not available

Ecological

Healing

Coal production (MWh/a)

CO2 emissions

Available

New Economy Electrical production (MWh/a)

Renewable Energy (MWh/a)

Available

Data

Transparency

Statistics KPI

Mining communities

Measured for this study

Digital

Cooperation

International

State

Mining communities

to be measured (expert

based)

61

-

1

2

3

4

5

6

7

8

9

1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020 2022

M illi

on en

Carbon Economy: CO2-Emissions and Coal Production

CO2 Emissions Coal Production

0

1

2

3

4

5

6

7

8

9

10

0

1

2

3

4

5

6

7

8

9

10

1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020 2022

M illi

on en

M illi

on en

Energy Transition (Electricity, MWh)

Electricity Production Renewable Energy Production Hydro Renewable Energy Production PV

Renewable Energy Production Wind Electricity Consumption

0

2.000

4.000

6.000

8.000

10.000

12.000

14.000

16.000

1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020

Transfer Program + Emigration + Retirement Effect

Transfer Program Emigration

-

5.000

10.000

15.000

20.000

25.000

30.000

1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020

Jobs: mining direct + indirect + triggle down

Direct mining jobs Indirect mining jobs Triggle down jobs

p e o p le

c a re

p e o p le

c a re

e c o l. h

e a lin

g n

e w

e c o n

o m

. Figure 5.1a Jobs: mining direct, indirect and trickle down

Figure 5.1b Transfer program, emigration including retirement

Figure 5.1c Carbon economy: CO2-emissions and coal production

Figure 5.1d Green economy: electricity consumption and RE production

data

quality

data

quality

data

quality

data

quality

62

In order to overcome the limits of a fragmented statistical database, we proceeded by estimating lacking data for indicators relevant for the four dimensions of the Just Transition Sector Decarbonization Framework. We based our synthetic data on information systematically collected during the series of interviews conducted during the fact-finding missions that took place in 2023. The resulting – reduced – quantitative image of socio- economic transition KPI’s of the coal mining sector on a national level is depicted in the diagrams of the digital twin in Figure 5.1a-d on page 61. In the pillar “People” we simulated employment in coal mining (KPIs: direct, indirect, and trickledown employment – as a function of coal production) and “People Care” by the KPIs of “Emigration” (indications from interviews: 40-60% of workforce per mine emigrated from the community until retirement) and “Provision of the compensation packet” (3-year package especially for older members of the workforce). The dimension “Ecological Healing” is monitored by two KPIs of the carbon economy: “CO2- emissions of Albania” and “Coal production in million tons per year”. The new economy is limited to KPIs of the energy transition, i.e., “Electricity consumption”, “Total energy production” and “Energy production from the renewable sources” (hydro, photovoltaic, wind) in million MWh/a. The dimension of data readiness is indicated under each diagram with a color code (red: no data, yellow: some reference data; green: available data). As complementary data source and information we used also to the SDG monitoring platform (SDG KPI’s by country, 2024). Albania evolved from an SDG Score of 65,85 (2000) to an SDG Score of 73,5 (2022) and holds the 166th position in the country ranking. Amongst the specific headline indicators, which are highlighted on the monitoring platform for Albania are the following:

Strengths Weaknesses

• Relative low CO2 emissions,

• Access to electricity,

• Rural population with all season access

to roads.

• Limited government spending on health

and education,

• Mean protected areas for biodiversity,

• Mean area in maritime protected sites.

The strengths that corroborate the advanced position in the energy transition can be seen also in the digital twin indicating the strong base in renewable hydropower production. In terms of weaknesses, they are in the “Ecological healing” dimension. Due to lack of data on mine closures, the poor environmental results of the latter are not recorded in the digital twin, but they emerged strongly in the interviews and in the case study of Krrabë (p. 31-32). The digital twin and quantitative analysis visualize the story of the socio-economic transition of coal exit in Albania. They present a pretty clearcut picture that shows that:

1. Coal mining employment collapsed within less than five years after 1990 in a very rapid way. With it, a major part of the dependent service jobs evaporated as well (though possibly shifted into the emerging post-socialistic service sector – to be investigated).

2. There was a short, age-specific support program from government agencies with a duration from 2 to 3 years per person. At that time, it was deemed attractive. Very few workers outside the mining sector were offered comparable and equally attractive

63

conditions in the aftermath of liberalization (Interviews UNECE FFM [Fact Finding Mission], 2023).

3. Most of the workforce adjustment occurred through emigration. Large numbers of workers left for Greece and Italy (an estimated 40% of workforce of Valias mine is said to have emigrated within two years from its closures; UNECE FFM, 2023).

4. The government engaged with a London-based consulting firm to assess needs in the process of mine closure proceeding towards a rapid closure of mines (UNECE FFM, 2023).

5. Carbon economy collapsed in parallel with the collapse and restructuring of the major industrial users of coal (UNECE FFM, 2023: historically a significant share of the coal production went to industrial users, which themselves were shut down in the period of economic liberalization).

6. Power demand: Initial depression reflects restructuring years, followed by growth and stagnation of electricity consumption as a rough indicator of economic development.

7. Green transition in the energy sector – As compared to many other countries Albania is very advanced in that process: as a part of the national autarky strategy of the socialist system the country has become self-sufficient in terms of energy supply through widespread use of hydro power. This indeed facilitated the coal exit, as the low-quality coal was not a critical resource for electricity production. At some point, however, consumption growth outpaced augmentation of hydropower production. In response the latter was significantly increased, what helped the country to close the gap that started to open in the intermediate years of the transition (UNECE FFM, 2023).

8. Renewable energy production: domination of large hydropower. Despite geographical potential, wind and solar power are barely developed (see maps p. 34). This indicates that key elements of the green economy ecosystem and supply chain structure are not fully developed.

5.2 Qualitative mapping and assessment of the Just Transition The mapping of the specific coal exit transition in Albania draws on the information collected in two field trips in the second half of 2023 and a series of interviews and group discussions with stakeholders from the coal mining sector conducted throughout the duration of the project. Figure 5.2 to Figure 5.4 show how we use multi-level socio-economic transition scheme introduced above (p. 17), the supply chain analysis (p. 21) and the entrepreneurial ecosystem (p. 23) to provide a pragmatic description of the key characteristics of the Albanian situation. The MSET mapping in Figure 5.2 illustrates the temporal evolution of the transition with major activities on landscape, regime, and entrepreneurial ecosystem level, as well as a few niche activities. So far, the significant turning points in this transformation have been the breakdown of the initial communist political regime, and the following (within the first years if not months), collapse of the industrial entrepreneurial ecosystem.

64

The initial ecosystem existing before 1990 with its different facets is characterized by the ecosystem-mapping in Figure 5.4 (a). It brought about the shutdown of coal mining activities as coal with relatively low calorific value and comparatively small mines with low productivity were uncompetitive both: in the emerging liberalized market and international. This shut down is perfectly visible in the data of the digital twin of coal production presented above (p. 61). A social transition package accompanied this rapid closure, with significant portion of the mining workforce immigrating to neighboring countries (predominantly Greece and Italy). A structuring next step was the mining law of 1994 introducing various measures especially in terms of property rights and licensing. Rapid and not always consistent measures gave rise to considerable uncertainty about legal status of properties, as well as a fragmented ownership. The next milestone is the start of the EU accession process in 2014. In parallel to this national- level step, integration in the European regional energy market has been advanced through the initiative of the West Balkan Six States. In addition, also in 2014 Albania joined the Paris Climate convention. These two steps shifted the center of gravity of agency within the Albanian Just Transition and decarbonization of the coal mining sector. The UN and EU policy frameworks became integral, and to a large extent dominant parts of Albanian policy. As it has been evident in the interviews with representatives of various Ministries, modernization and adaptation to European legal and governance standards – whether in the field of education, environment, or national statistics – ranks on top of the country’s political agenda. This leads to a multi- dimensional modernization of the entrepreneurial ecosystem on a national level, as outlined in Figure 5.4 (b). The superposition of the initial regime and target regime of the socio- economic transition and their respective entrepreneurial ecosystems is depicted in Figure 5.4 (c). This superposition allows tracing several vectors of modernization, as well as growth opportunities for a Just Transition approach. Reform of the educational sector (UNECE FFM, 2023) may increase the cooperation with international institutions of higher education and allow modernizing curricula, so that they correspond to growth pathways identified in the Just Transition scenarios. Another crucial vector of modernization is administrative and legal reform. If synchronized with the growth pathway of energy transition, it could reduce barriers in land ownership registries and open growth opportunities for mining communities all over Albania. As several dimensions of the entrepreneurial ecosystem undergo consistent modernization, this might considerably increase the attractiveness of Albania for foreign investments and thus provide the country with capital resources necessary for the Just Transition. With respect to the economic situation, the simple, linear industrial supply chain of the period before 1990 has nowadays, to a large extent, ceded to exist on the national level (Figure 5.3 (a)). Large steel mills were closed down, as were also many other energy intensive industrial users. The only exception is the cement industry that still continues to operate. International markets provide fossil fuels (national gas etc.). The energy and especially electricity market liberalization and regional integration has advanced considerably, as outlined in the emerging energy supply chain and value net depicted in Figure 5.3 (b). A national and regionally interconnected power market is emerging. The diversity of market players has increased (e.g., a new category of prosumers emerged, as

65

some of them (PV up to 200 kW) have now an opportunity to feed electricity into the public grid). Regional integration is established, and international players are active in the power market. Market maturity, in terms of the range of power contracts offered, is gradually expanding. This liberalization and modernization of the power market is an important and promising trend of modernization in Albania. Such a market infrastructure is a pre-condition for a possible expansion of the green economy based on a decentralized market model in the energy sector. It is also an opportunity for future Just Transition projects in Albania, as it allows matching the geographic advantages of the country (sun exposure, wind exposure, river systems) with a global trend of increasing renewable energy uptake. A challenge that is persistently evident in all interviews, as well as in available statistics is demography and availability of a qualified work force. This has been raised by equally be representatives of the educational system, and the private sector. With regard the mining industry (chrome, nickel), a strategic reinvention of curricula and cooperation with regional and/or international partner institutions could help, at least partially, to address this deficit. There are also related needs for adaptation of the entrepreneurial ecosystem (Figure 5.4 (c)) and transformation of the supply chain (Figure 5.3). Before 1990, coal mining was a strategic part of energy autarky and of the national heavy industry program. The educational system was aligned. With the collapse of the socialistic system in 1989, its industrial fabric including the coal mining sector imploded under rapid liberalization and internationalization. Today, the size of the national job market for miners appears to be sub-critical due to the limited demand for coalmine experts and only residual mining activities in chrome and nickel. Nevertheless, even such situation holds a number of opportunities. What could be done is a development of regional cooperation allowing to pool capacities for mining education and/or for a strategical realignment of the mining curriculum with one of the potential growth markets of Albania, such as e.g., natural resource management, renewable energy, and nature conservation. The interviews highlighted also the need for greater efforts to open more opportunities in the market of decentral power generation. As mentioned earlier, the transparency and administrative processes related to property rights are respectively low and slow, thus constituting a barrier to project development. It is a considerable obstacle, particularly at times when growth of electricity consumption is expected to continue in parallel with constantly improving material situation of the population. Albania has an opportunity, which at the same time is a challenge, to shift to a growth model not fueled by the fossil-based but rather renewable energy. In order to achieve that, however, the ecosystem has to be prepared for renewable energy expansion, i.e., an effective integrating policy, as well as appropriate legislative, administrative, infrastructural, and educational measures need to be put in place.

66

Figure 5.2 - Mapping of socio-economic transition related to coal exit in Albania

tr a n s fo

rm a

ti o n

t im

e

S o

c io

-E c o

n o

m ic

T ra

n s

it io

n P

h a

s e

s

L a n d s c a p e

R e g im

e

N ic

h e

Socio-Economic Levels

1 9

4 4 -

1 9 8

9 1 9

9 0 –

1 9 9

4 1

9 9 4 –

2 0 1 4

2 0 1 4 –

2 0 2 3

2 0 2 3 –

2 0 3

5

s m

a rt

s p

e c ia

liz e d

s h o

c k

d is

ru p ti o n

e n tr

e p re

n e u ri

a l

e x p

lo ra

ti o n

re g

im e

re

s h

a p in

g

s m

a rt

s p e

c ia

liz e d

„S o c ia

lis ti c

C o a

l M

in in

g

S y s te

m “

„P o lit

ic a

l D

is ru

p ti o

n

& C

o a

l E

x it “

„A d

a p ta

ti o n “

„E U

A s c e

n s io

n ”

„J u s t

T ra

n s it io

n

a c h ie

v e

d “

C e n tr

a l M

in in

g

A d m

in is

tr a ti o n

M in

e r

C o m

m u ti n g

/ M

in in

g T

o w

n

B u s in

e s s M

o d e l

D e c e n tr

a l M

in in

g

S c h o o ls

C e n tr

a l D

iv e s tm

e n t

A g e n c y

In te

rn a ti o n a l C

lo s u re

C o n s u lt a n ts

F ra

g m

e n te

d

P ri v a ti z a ti o n

1 s t w

a v e o

f e m

ig ra

ti o n

P ri v a te

O p e ra

ti n g L

ic e n c e s

C o m

p a n ie

s

C o m

m u n a l L a n d

R e d is

tr ib

u ti o n

In te

rn a ti o n a l In

v e s to

rs

(C o p p e r,

C h ro

m e ,

C o a l?

)

E U

C a n

d id

a te

2 0 1 4

U N

P ro

g ra

m

C lim

a te

& S

u s ta

in a b ili

ty

N a ti o n a l P

ro g ra

m s

R e g io

n a l G

o v e rn

a n c e

S ta

ti s ti c s &

P la

n n in

g P

o w

e r

M a rk

e t 2 0 1 4

A d m

in . R

e fo

rm 2

0 1 5

2 n d w

a v e o

f e m

ig ra

ti o n

In it ia

ti v e s

P ro

je c ts

P ro

g ra

m s

A n c h o r

F ir m

s

N e w

S m

a rt

S p e c ia

liz a ti o n s

N a ti o n a l E

m is

s io

n

R e d u c ti o n T

a rg

e ts

A lb

a n

ia n

P h

a s e s

o

f D

e v

e lo

p m

e n

t

In te

rn a ti o n a l

In s ti tu

ti o n s

N e w

M in

in g

L a w

1 9 9 4

M in

e C

lo s u re

s

E U

a n d r

e g io

n a l

in te

g ra

ti o n

In fr

a s tr

u c tu

re p

ro je

c ts

P a ri

s A

g re

e m

e n

t

R a ti

fi c a ti

o n

2 0 1 6

W e s t

B a lk

a n

S ix

2 0 1 4

8 9 /9

0 T

o p

p li n

g

o f

g o

v e rn

m e n

t

In n e r

A lb

a n ia

n

M ig

ra ti o n &

U

rb a n iz

a ti o n

S to

p o

f M

in e o

p e ra

ti o n

Id e a s

67

Figure 5.3 - Mapping of coal and energy supply chain in Albania

Distribution

Large-scale

Generation /

Industrial

Users

Final

Use

Pump

Storage

Large-scale

Generation

Hydro

DistributionExploration Final

Use Extraction Processing

Industry

Utilities

B2C users

Technology

Providers /

Equipment

Mapping of

Supply Chains

1988

Coal Mining

Electricity

Local Population

Heating Stations

Steel Industry

Power Plants

Regional State Companies

Central State Planning & Control

Russia

China

Poland

Copper …

Chrome …

Iron Nickel …

Regulator Large-scale

Generation

Final

Consumer

Trading

Power

Market

Storage Prosumer

(CHP / PV)

Efficiency

Contracting

Distribution Final

Use Extraction Processing

Customer

Segments

Technology

Providers

Mapping of

Supply Chains

2035

DistributionExploration Final

Use Extraction Processing

Customer

Segments

Coal Mining …

(coal exit >90%)

Electricity

Coal Import

Coal Export

Hydro

PV

Distribution

Wind

Biomass

Transport

Hydro-Carbon

(emerging)

Electricty Import

Electricity Export

Closure &

Recultivation &

Securization

ReuseMarketing

Exploration

Preparation Monitor-

ing

Copper …

Chrome …

Iron Nickel …

free market / private sector

Rural development context

Urban development context

State dependend

Regional Energy Markets

Decentral production of

renewable energy

New Services Natural

Resources

Albania

Mapping of

Supply Chains

Before 1990

(a) Industrial Coal Mining and Energy Supply Chain (before 1990)

(b) Emerging Energy Supply Chain (Horizon 2035)

68

Figure 5.4 - Mapping of entrepreneurial ecosystems of Albania before 1990 vs. 2035

Former Mining

Communities

in Albania

1988 Finance

(e.g. Inter-

/National /

Local

Funding)

Policies

Vision

Mission

Market &

Businesses

Human

Capital

Educational

System

Entre-

preneurs

Infrastructure

Nature

Culture

Ecology &

geology of

mines

Mapping of

Entrepreneurial

Ecosystem

Socialistic

centrally

planned

economy

State

Entreprises

National

Education

Planed

Recruiting

No free

circulation

Planned

Recruiting &

Staffing

Mining:

Gender

Segregation

1st historical

2nd wave

1960

3rd wave

1980

Poorly

developed

infrastructure

Ecology low

priority & lack

of resources

National

Railroad

Central

Ressource

Allocation

Cooperation

with Russia

and China

Totalitarian

mono-party

society

Mining:

male worker

migration

model

centrally

managed

mining sector

Autarcy

Former Mining

Communities

in Albania

2035 Finance

(e.g. Inter-

/National /

Local

Funding)

Policies

Vision

Mission

Market &

Businesses

Human

Capital

Educational

System

Entre-

preneurs

Infrastructure

Nature

Culture

Ecology &

geology of

mines

Mapping of

Entrepreneurial

Ecosystem

Free

circulation

of Workforce

EU

Environmental

Legislation

NGO‘s Free &

International

Research

Institutions Roads, Public

Transport

Nature

Reserves

European

Education

Formats

European

Funds

World Bank

EBRD

Free Capital

Markets

Multi-Party

Constitution

Subsidiarity

Central-

Decentral

Free Trade International

European

West Balkan 6

Cooperations

Increase

Attractivity for

mobile workers

& families

Intercultural Capital

of Albania: muslim,

christian, socialistic

bonds

Mountains,

Rivers, Water,

See

Central Position

Crossroads East-

West and North-

South

Wind, Hydro,

Geothermal,

Solar

Next

Generation

Entrepreneurs

An Age of

Modernization

for Albania

Mixed

Economy

Private Public

European

Single Market

International

Private

National

Education

Socialistic

centrally

planned

economy

State

Entreprises

National

Education

Planed

Recruiting

No free

circulation

Planned

Recruiting &

Staffing

Mining:

Gender

Segregation

1st historical

2nd wave

1960

3rd wave

1980

Poorly

developed

infrastructure

Ecology low

priority & lack

of resources National

Railroad

Central

Ressource

Allocation

Cooperation

with Russia

and China

Totalitarian

mono-party

society

Mining:

male worker

migration

model

centrally

managed

mining sector

Autarcy

Former Mining

Communities

in Albania

2035 Finance

(e.g. Inter-

/National /

Local

Funding)

Policies

Vision

Mission

Market &

Businesses

Human

Capital

Educational

System

Entre-

preneurs

Infrastructure

Nature

Culture

Ecology &

geology of

mines

Mapping of

Entrepreneurial

Ecosystem

Free

circulation

of Workforce

EU

Environmental

Legislation

NGO‘s Free &

International

Research

Institutions Roads, Public

Transport

Nature

Reserves

European

Education

Formats

European

Funds

World Bank

EBRD

Free Capital

Markets

Multi-Party

Constitution

Subsidiarity

Central-

Decentral

Free Trade International

European

West Balkan 6

Cooperations

Increase

Attractivity for

mobile workers

& families

Intercultural

Capital of Albania:

muslim, christian,

socialistic bonds

Mountains,

Rivers, Water,

See

Central Position

Crossroads

East-West and

North-South

Wind, Hydro,

Geothermal,

Solar

Next

Generation

Entrepreneurs

An Age of

Modernization

for Albania

Mixed

Economy

Private Public

European

Single Market

International

Private

National

Education

19881988

before 1990

(a) Entrepreneurial Ecosystem (before 1990)

(b) Entrepreneurial Ecosystem (emerging – possibly 2035)

(c) Entrepreneurial Ecosystem Transitions (from before 1990 to 2035)

69

5.3 Expert Assessment of maturity of Just Transition with respect to Coal Exit in Albania The assessment of the readiness of a country or entrepreneurial ecosystem for a transformational evolution like Just Transition requires an evaluation grid based on a sound methodological approach. As discussed in the introduction, the Just Transition concept reflects simultaneously aspects of observation, practice, and policy. Turning to observation, we would like to increase transparency and understanding of the state of a given Just Transition by developing a simple assessment scheme – a maturity model for Just Transition. Such model allows a stakeholder community not only to evaluate the status, but also monitor the progress of a transformational process, thus providing for its better management. The concept of maturity models has long been used in a widespread range of evolutionary phenomena (biological maturation, maturity of business processes, or information systems - Berghaus, 2016). A maturity model consists typically of a selection of dimensions characterizing the evolutionary process under study. In our case, we use the dimensions of Just Transition developed earlier (p. 55-56) and we combine them with 5 levels of maturity (neutral, basic, managed, defined, established), the criteria for each have been described before (pp. 56). The maturity is then assessed for each dimension and aggregated with proportional weights as an overall maturity for the entire Just Transition Readiness. The maturity value obtained is an indicator of to what extent the process of Just Transition under investigation is already implemented. At the same time, it is not a measure of the degree of completion of the Just Transition indicating which goals of the process in terms of new employment, percentage of land-reuse, or degree of renewable electricity production, have already been achieved. Table 5.3 summarizes the expert-based assessment of Just Transition Readiness of the Coal Mining Sector in Albania. A small group of four experts in Just Transitions who were engaged in the project from its very beginning and participated in all field missions conducted within this study provided their individual assessments based on their own understanding of the situation on the ground. This expert assessment was validated in a group discussion. Table 5.3 - Maturity Assessment (Expert 1: x; Expert 2: o; Expert 3: +; Expert 4: -)

Just Transition

Maturity Albania

Neutral Basic Managed Defined Established

Governance x O+

Regional Agency Xo+

People Care O+ X

People Develop Xo+

Ecological Healing o X+

New Economy Xo+

Data Transparency Xo+

Digital Cooperation X+ o

70

As a part of a structured group discussion Just Transition Readiness of each of the eight mining communities of Albania was subject to analysis and evaluation. An overview of that exercise is provided in Table 5.4. Note of caution: As this project did not include a field visit to all mining communities, this assessment is only an estimate and reflects essentially only publicly available information on the post-mining situation in each community. Table 5.4 - Just transition indicators summary from mining community ID-Cards

Mining community governance People Transition Digitalization

Kamza p. 47

Vora p. 48

Kora p. 49

Pogradeci p. 50

Tepelena p. 51

Tirana Agglomeration p. 52

Maliq p. 53

Kolonja p. 54

71

6. Stakeholder dialogue and practical recommendations

6.1 Stakeholder dialogues 2023 During the stakeholder dialogue workshops held in Tirana on 11 – 13 December 2023 and on 4th of April 2024, the team of UNECE consultants presented the preliminary findings of the fact-finding mission. Findings were reviewed and discussed with participants and amended accordingly afterwards. International experts presented Just Transition cases from various European countries, such as Northern Macedonia, Serbia, Bosnia-Herzegovina, Poland, and Germany. Building on the fruitful exchange the workshop focused then on ideas for actions to be included into the pool of ideas for a Just Transition initiative for Albania. The suggestions are listed below – and cover mine closure (1. – 5.), new business areas (6., 10. and 15.), infrastructure investments (7. and 8.) and change management activities (12.-15.): Table 6.1 - Ideas invoked in the stakeholder dialogue

No Ideas evoked in the stakeholder dialogue

1 It is necessary to have a post-closure business model to support maintenance of the mines.

2 Need for proper closure of abandoned mines (proper closure of Valias mine).

3 Data on potential risks related to closed mines (methane, water, pollution, etc.) is needed.

4 Mines /shafts /mining land repurposing-plans are needed in advance (interdisciplinary pre-

closure screening).

5 Pilot project on proper mine closure should be designed and executed.

6 Critical material and rare earth market analysis needs to progress rapidly as an opportunity

to maintain mining competency for the regions. Screen mines for methane and hydrogen.

7 Infrastructure needs to be improved and could be developed in remote areas.

8 Usage of closed mines for power storage could be investigated.

9 Adventure tourism (mountain biking, rafting, etc.) as well as land use for renewable

production offers a potential and should be explored.

10 Agro-business /agro-tourism offers a potential that should be explored.

11 Special industrial /economic zones offer a potential that should be explored.

12 “Albania Core”: a dedicated initiative for young people to go live in the post-mining areas

and reinvent them could be proposed as an idea for reinvigorating those localities.

13 Organize a regional hackathon.

14 Transfer ideas into projects (effective project management).

15 Learn from success cases.

72

6.2 Recommendations In the sections “Recommendations” and “Practical Considerations”, we share what the project and analysis conducted for its purpose taught us and what conclusions we drew from them, based on our own experience and practice, acknowledging that there are many aspects of the whole transition process in Albania that we were not able to examine and analyze. The following are the key points, which we find to be of importance for the post-mining communities of Albania:

1. A first part of this socio-economic transition of coal mining in Albania is already completed: the exit of coal mining as a business was done in the wake of market liberalization within less than 5 years after the regime change in 1990. The challenging task of finding an alternative employment for the workers laid off by the closing mines has been by now “naturally” solved by the interested parties themselves.

2. A window of opportunity opens to finish the unfinished mine closure of the 1990’s: The matters of ensuring safety of the closed mines, land-reuse, and new business development have still not been properly addressed in Albania. Focus of international institutions like UN and EU on a decarbonization in the Western Balkan could provide the Albanian government with the needed attention and financial resources to support a Just Transition program centered around ensuring safety and revitalization of the post-mining areas in the country.

3. Albania has a unique opportunity to position itself as an ambitious European first

mover towards a net zero economy. Blessed with a considerable geographical potential for renewable energy and having a significant installed hydropower capacity, the country is in a pole position amongst European nations to become a green economy leader. An ambitious program of solar and wind power farms could fill the widening gap between power production and the constantly increasing power consumption. Such program would not only boost local business and energy production, but it could also serve as a modernization drive for higher education institutions and start-up communities, as well as a magnet for targeted foreign investments.

Three major points of action may play a central role for a Just Transition Initiative in Albania and have therefore been selected as recommendations.

1. Create participatory process and governance for “Just Transition & Coal Exit in Albania”

Since the economic coal exit lays some thirty years in the past, the intensity of and collective energy for Just Transition of coal mining areas has by now faded away (if there ever has been any). At the same time a number of issues still remain unresolved. Therefore, a very first task is to identify a core group of players who are committed to execute the (belated) transition and capable to lead such endeavor. The subsequent steps are:

73

• Win stakeholders on a national level and build a shared and methodological sound perspective on the “Just Transition & Coal Exit”.

• Set up a robust multi-layer process based on the centrally coordinated governance supporting the identified areas of action on the local level. Ensure safety of closed mines (protect the environment, explore methane and rare earth spill over) and local business diversification.

• Leverage institutional renewal driven by the EU accession process: Invest in governance, policy frameworks and local entrepreneurship for the mining sector, former mining communities and related education.

2. Modernize into a Competitive Green Economy

Looking at the current position of Albania, the country’s outstanding strength is the high degree of electricity generation from renewable resources – with photovoltaic and wind potential being barely exploited. This opens the opportunity for Albania to become a leader in Green Economy in the European Union, in a way in which some of the Baltic States positioned themselves as leaders in the digitalization, for instance. The particular chance lays in the fact that Albania has been over the last years going through a deep, EU-driven modernization of many aspects of its legal and administrative system. Such situation gives it an opportunity to develop a consistent and holistic legal framework for a low carbon economy. Actions taken towards that goal could help Albania build a smart specialization in this area, developing in the long run a number of competitive advantages. As we have seen in the theory about entrepreneurial ecosystems, a particular focus should be on creating a favorable legal and market frameworks for decentralized electricity generation and related business models. With a wise regulatory framework, this can become a growth market for the former mining communities and other remote areas, providing them with income for medium sized farms operating in a double income model and offering interesting land reuse options for the post mining territories. Adjustments in the educational landscape (modernization of curricula) and lowering barriers to electricity feed-ins into the power grid are the steps with particular potential for facilitating such developments. Other actions could include:

• Careful phase out of fossil fuels (smart end of use strategy, CO2 risk management);

• Building and investing in competitive infrastructure (grid, regional integration, power exchange) for a green, sustainable economic development of Albania;

• Building markets for expanding usage of renewable energy and local resources.

3. Reinvent local business models and foster smart specialization of communities Based on our own experience in regional modernization in coal mining and former socialist regions, the re-vitalization of local entrepreneurship appears to be a strategic long-term task. Taking initiative and ownership of the challenges ahead, but also developing the capability in the post-mining regions to search for solutions with a business developer mindset should be a top priority. Based on our experience, this is very beneficiary and needed not only for Just Transition but also for the purpose of developing healthy and pro-active communities. The Just Transition Initiative can serve as a catalyzer of entrepreneurship and learning by the

74

communities. The authors have an experience of working at a learning center for entrepreneurship and innovation designed to train young talents through interactive workshops offering an ample space for the acquisition of entrepreneurial skills and for networking between regional entrepreneurs. Therefore, drawing from that example, it is recommended to develop a key partnership for a possible Just Transition initiative with a qualified higher education institution with a subject matter focus on innovation and entrepreneurship. Such approach proved to be very fruitful in.

• Fostering and accelerating adaptation via modernization of higher education institutions and research, as well as developing international learning networks and practical cooperation on local, national, and regional level;

• Mobilizing private sector and local initiatives;

• Providing a private sector and local initiative support framework on a central level.

6.3 Practical Considerations Due to the very particular Albanian situation, where the coal exit has already occurred (30 years ago), but ecological healing and new business development is still an open issue, the key focus should be on the initiation and set up of a Just Transition working group. The purpose of such working group is to become a seed for developing a concrete, local pilot project serving as a proof of a concept and showing how to complete the coal exit initiated in the 1990’s by a proper Just Transition. By using the Just Transition framework as a guiding methodology, such a pilot project could easily connect with Just Transition Programs on the UN and EU level and increase the probability of obtaining a financial support for the development of a more systematic program for the post-mining communities in Albania. If there is no local pilot group with a small group of committed stakeholders, the currently interested international institutions will lack a counter part for the development of an internationally funded Just Transition program in Albania and therefore will be likely to turn their attention elsewhere. Therefore, our practical recommendations focus entirely on the next step in the life cycle of a Just Transition program. All required steps can be set up based on information provided in this report and the indicated references. The subsequent steps, such us consultation with stakeholders and development of a Just Transition Road Map will follow only if additional resources are committed by the stakeholders of the pilot Just Transition Action group and, as the process progresses, if they are gradually complemented by financial resources of government agencies and/or international institutions.

75

Possible timeline for the next 12 months after kick-off 6 – 8 weeks. Following the exchanges with UNECE and international experts it is important to set up a local Just Transition initiative of 3 to 10 players, including players from higher education institutions, 2 to 5 businesses interested in green economy, representatives of some the post-mining communities (mayors, municipality representatives) and a relevant governmental actor (at a ministry level). 3 – 6 months. During an upcoming workshop under the auspices of UNECE, this group could prioritize one out of three “speed boat” projects†. “Speed boat projects” are small projects offering rapid outcome but requiring limited resource needs. Their purpose is to provide a showcase helping to attract local stakeholders, international partners, and financial resources needed for upscaling the scope and impact of activities. 1 – 3 years. This project group could become the counter part for a dialog in a continued Just Transition path with UNECE and other international development partners. Since Just Transition is fundamentally about developing a viable and resilient alternative local economy, it is of crucial importance to equip the local project group with a public-private cooperation component. Possible business partners could include international companies active in the energy market, or anchor companies from one of the post-mining communities that have an interest to increase attractiveness of the localities in transition for their future employees. Another promising partner would be an active participant (on a professorship level) from a faculty of entrepreneurship, sustainable development, or innovation at one of the leading higher education institutions in Albania. For the faculty and students, the “Just Transition Initiative Albania” provides a rich field of applied learning in entrepreneurship and a set of interesting research topics for bachelor, master, and PhD theses.

† During the UNECE Workshop on 4th of April in Tirana, the call for the Just Transition Innovation Project Award 2025, donated by Jürgen Lange & Son, was announced. Speed Boat Projects can be handed in until 31.1.2025. For information see https://unece.org/info/Sustainable-Energy/Coal-Mine-Methane/events/389509 .

76

Table 6.2 - Practical recommendation: focus and key activities

Albania Just

Transition

Practical recommendation: focus and key activities which allow to start a

cooperation process of stakeholders following a Just Transition methodology

Governance Identify sponsor for Just Transition on government level (ministry). Suggest a

program. Create a small public/private central working group, which meets

regularly (2 weeks, for an initial phase between 6 and 24 months).

Regional

Agency

Identify 2 to 5 highly motivated key players in one of the mining communities. Start

a pilot Just Transition local community action group.

People Care 30 years after closure, this seems not to be a critical issue any more.

People

Develop

Find 2 to 5 key players amongst stakeholders of higher education and vocational

training institutions (committed persons). Link institutional modernization and

innovation with the Just Transition agenda (central, local). Establish a link between

educational modernization and new growth areas in the green economy – both in

terms of curricula and local public-private cooperation.

Ecological

Healing

Screen the post-mining areas for risks and opportunities. Identify 3 possible

“environmental security projects”. Go through a selection process for the best 3

proposals, and link them, if possible, with the Just Transition local pilot group.

New

Economy

Identify entrepreneurs and companies willing to invest in green economy business,

ideally in a field, which could scale up to include several Albanian post-mining

communities. Besides a conceptual understanding of the growth potential, the

identification and attraction of key business players to the Just Transition project

are also critical success factors.

Data

Transparency

Use this report and related internet sites as a starting point to collect and share

data on the pillars and dimensions of Just Transition. Create a simple website for

the pilot action group on Just Transition and provide relevant data and

information.

Digital

Cooperation

Create interactive options and network activities through periodic meetings and

events to elaborate a Just Transition program for Albania’s post-mining

communities. Try to link applied research project(s) with this project, thus

providing new content for discussion and offering analytical capabilities to the pilot

Just Transition action group. The “Just Transition Innovation Price 2025” is a first

tentative step into that direction – injecting energy into project ideas and bringing

stakeholders together.

77

References 1. https://unece.org/sustainable-energy/events/workshop-mapping-albanias-readiness-

green-and-just-transition-post-coal ; 14.02.2024, 22:34

2. Innovationsregion Lausitz GmbH, unpublished, 2017

3. Geels, F. W. (2004) From sectoral systems of innovation to socio-technical systems: Insights about dynamics and change from sociology and institutional theory, Research Policy, 33(6-7), 897-920

4. Tomenendal, M., Lange, H.R., Kirch, J., Rosin, A. F. (2018). The Entrepreneurial

Development of Regions – Exploring the Socio-Technical Transition of Lusatia from a Multi-Level Perspective, IMB Working Paper Nr. 94, 04/2018

5. UNECE (2022): Technical, principle-based guidelines for designing and implementing a

programme for efficient, safe and environmentally conscious mine closure in Albania and Serbia, UNECE Geneva 2022

6. Just Transition in Coal Regions of Poland, by Mr. Jan Bondaruk, Deputy Director for

Environmental Engineering, Central Mining Institute in Poland – GIG, unpublished https://unece.org/sed/documents/2023/12/presentations/just-transition-coal-regions- poland-mr-jan-bondaruk-deputy, 2024.02.13 21:59

7. Porter, Michael E. (1990): The Competitive Advantage of Nations, Free Press, New York

8. Isenberg, D. J. (2011). The Entrepreneurship Ecosystem Strategy as a New Paradigm

for Economic Policy: Principles for Cultivating Entrepreneurship. The Babson Entrepreneurship Ecosystem Project. Babson College: Massachusetts.

9. European Commission (2015): Smart Specialization Platform – Strategies for research

and innovation-driven growth https://s3platform.jrc.ec.europa.eu, 2024.02.13 22:10

10. International Labor Organization (2021). International Labour Organization, Frequently Asked Questions on Just Transition, 2021, https://www.ilo.org/global/topics/green- jobs/WCMS_824102/lang--en/index.htm

11. United Nations Committee for Policy Development (2023). United Nations Committee

for Policy Development 2023, https://www.un.org/development/desa/dpad/wp- content/uploads/sites/45/CDP-excerpt-2023-1.pdf

12. Hirschman, A. O. (1970). Exit, Voice, and Loyalty: Responses to Decline in Firms,

Organizations, and States. Harvard University Press.

13. Hirschman, A. O. (2013). The Essential Hirschman. Princeton University Press.

14. World Bank, (2020): A Road Map for a Managed Transition of Coal-Dependent Regions in Western Macedonia

78

15. Wuppertal Institute (2020): A Just Transition Readiness Evaluation Tool for coal and carbon-intensive regions, project funded by the European Union’s Horizon 2020 research and innovation program

16. Zhang, M. (2024). Strategic Management and Sustainability Transitions Theory and Practice, Routledge

17. EBRD (Anna Vasylyeva, A. 2023). Financing just transition - Investment Plan for North

Macedonia, Conference Presentation, unpublished.

18. National Adaptation Plan (2020). Project Document: Advancing Albania’s planning for medium and long-term adaptation through the development of a National Adaptation Plan (NAP) process, 2020

19. National Adaptation Plan Albania, 2020.

20. Albania’s Fourth National Communication, 2022.

21. Albania’s Third National Communication of the Republic of Albania under the UNFCCC,

2016, page 15.

22. Albania Revised NDC, 2021

23. https://maps.worldbank.org/datasets, 27.01.2024, 11:40

24. National Adaptation Plan of Albania, 2021

25. Monitoring of the Climate Change Strategy in Albania, 2020-2030, 2021

26. National Strategy for Disaster Risk Reduction and action plan 2023–2030, 2023

27. Albania’s Fourth National Communication, 2022

28. Advancing Albania’s planning for medium and long-term adaptation through the development of a National Adaptation Plan Process, Project Document, 2020

29. Albania’s First Biennial Update Report, 2021

30. Advancing Albania’s planning for medium and long-term adaptation through the

development of a National Adaptation Plan Process, Project Document, 2020

31. World bank Data, 2024

32. Census, 2011

33. Albania’s First Biennial Update Report, 2021

34. Albania’s First Biennial Update Report, 2021

79

35. Advancing Albania’s planning for medium and long-term adaptation through the development of a National Adaptation Plan Process, Project Document, 2020

36. Albania’s Fourth National Communication, 2022

37. Albania Revised NDC, 2021

38. Albania’s First Biennial Update Report, 2021

39. INSTAT, 2023

40. Albania Country Risk Profile

41. INSTAT, 2023

42. Climate Risk Country Profile, Albania 2021

43. Third National Communication of the Republic of Albania under the UNFCCC, 2016

44. Albania’s Fourth National Communication, 2022

45. Albania’s First Biennial Update Report, 2021

46. Albania Revised NDC, 2021

47. IMF Country Report No. 22/362, 2022

48. National Adaptation Plan of Albania, 2021

49. National Strategy for Development and European Integration 2022-2030, 2023

50. IMF Country Report No. 22/362, 2022

51. SDG KPI’s by country, 2024, https://dashboards.sdgindex.org/rankings 27.01.2024, 08:35

52. Interviews UNECE FFM (Fact Finding Mission), 2023

53. UNECE FFM, 2023

54. Berghaus S., Back A. (2016): Stages in digital business transformation: Results of an empirical maturity study. Tenth Mediterranean Conference on Information Systems (MCIS), Paphos, Cyprus.

80

Note on the authors Hans Rüdiger Lange (International Consultant) has been the managing director of Innovationsregion Lausitz GmbH and founder of the LausitzLab as an incubator and accelerator for business innovation and regional transformation in the context of coal exit in Lusatia, Eastern Germany (2016 – 2021). He has been working in the international utility sector for more than 18 years, thereof nearly a decade in lignite mining and power generation in Lusatia. After a diploma from Technische Universität Kaiserslautern (Germany) and a PhD in physics at Ecole Polytechnique (France) he completed a Master of Business Administration at HEC Paris (France). Since 2018 he holds the Honorarprofessur Identität-Entrepreneurship- Transformation at Brandenburgische Technische Universität Cottbus-Senftenberg. Besides papers in natural science and technology, he contributed publications on issues of higher education, start-up and cluster development as well as regional industry structure.

• H.R. Lange, D. Mundt: Schwarze Pumpe – Retrospective and Perspective, TICCIH Congress: The industrial heritage, economy and ecology, 5.-6. September 2009

• H.R. Lange, K. Lehmann: Bildungsinnovation als regionale Chance – Vermittlung von unternehmerischen Fähigkeiten im Master, Wissenschaftsmanagement 1/2014, S. 26

• C. Baumgarten, G. Bruche, C. Dörrenbächer, F. Nagel (Eds.) - M. Tomenendal, H.R. Lange: Cluster-Entwicklung in einem dreistufigen Modell: das Fallbeispiel des Berlin- Brandenburger Energietechnik-Clusters, Working Paper No. 79, 06/2014

• Lange HR, Tomenendal M. 2017. The regional entrepreneurial transformation process — A mid-level framework for describing and fostering socioeconomic changes. Management and Economics Research Journal 3: 67-77.

• Tomenendal M., Lange HR, Kirch J., Rosin A.F.: The Entrepreneurial Development of Regions – Exploring the Socio-Technical Transition of Lusatia From a Multi-Level Perspective, IMB Working Paper / Case Study, IMB Working Paper Nr. 94, 04/2018

• David M. Lehmann, Hans R. Lange, René Mauer: The Role of Entrepreneurial Individuals for Regional Development – The Case of the Innovation Region of Lusatia, G-Forum, 11-12th of October 2018, Stuttgart („award paper“)

• M. Tomenendal, H.R. Lange, C. Raffer (2020): Cluster Competence for Higher Resilience – A Neo-Institutional Perspective on How Firms from the Lusatian Energy Cluster Cope with an External Shock, IMB Working Paper / Case Study, IMB Working Paper No. 99, 12/2020

• Weinmann, J., Kupp, M., Lange, H.R. (2020): Wild Herbs Grow Tall - Mastering Structural Change in Lusatia, Harvard Business Publishing, Case Centre and Ivey Publishing, ESMT Case Study No. ESMT-820-0186-1. 2020.

• Tomenendal M., Lange H. R. , Abdelkafi N., Winkler H.: Managing the Coal Exit in a Mining Region – Strategic Landscape Design and Niche Management for a Sustainable Socio-Technical Regime in Lusatia; In: “Strategic Management and Sustainability Transitions: Theory and Practice”, Zhang M. (editor), Routledge, 2024

81

Nevton Kodhelaj (National Consultant) has been the Permitting Local Expert at the Uniper Technologies GmbH, under the scope of the branch activities to provide engineering support services required in the course of development and construction of Trans Adriatic Pipeline Project (TAP) designs. The activities performed were part of the SoW developed by UNIPER TECHNOLOGIES (UTG) and were related to the permitting process of TAP Project sections in Albania. Due to his results and internal developments of the process he was promoted in the position of the Permit Coordinator Albania, responsible for the coordination of the preparation of the Application Packages for the permits of TAP Project sections. Simultaneously he has been working as a full-time lecturer (at Bachelor, Master and PhD level) at the Energy Resources Department, Faculty of Geology and Mining, Polytechnic University of Tirana, since October 1st, 2011, responsible for the Reservoir Engineering, Petroleum engineering etc. Since 2016 he held the position of the Head of Energy Resources Department, and since 2020 he held the Academic position of Professor Doctor. He has an extended cooperation experience with several international institutions and companies, including UN - Geneva, World Bank, EBRD. Millenium Challenge Corporation, Exxon Mobile, BP, Bankers Petroleum ltd, Total Energy etc. Author and Coauthor of over 60 research papers, over 40 scientific presentations, 2 textbooks and 4 monographs:

• Kodhelaj N., Bozgo Sh., "Well Testing and Information Role in The Petroleum Industry; Wells Testing in The Multilayers Reservoirs," in 4th International Conference on Petroleum Engineering, London, August 15-17, 2016.

• Kodhelaj N., Studimi Hidrodinamik i Puseve të Naftës, 1 ed., vol. I+II, A. R. Thodhorjani S., Ed., Tiranë: Shtëpia Botuese e Librit Universitar, 2011, p. 650.

• Kodhelaj N., Bode A., Koja N., Zeqo E., Merjemaj B., "Designing of the Integral, Cascade and Hybrid Use Scheme, for the Kozani-8 Geothermal Water; Some Thermal and Economical Calculations," in “Elsevier-AASRI Conference on Modeling, Identification and Control (MIC 2012)”, Hong Kong, December 19-20, 2012.

• Kodhelaj N., Çela B., Bode A., Aleti R., Thodhorjani S., Mumajesi M., "Combined use of the Kozani-8 geothermal water, some thermal and economical calculations," in International Conference (RSETE 2013), “The International Conference on Remote Sensing, Environment and Transportation Engineering”, Nanjing, China, July 26-28, 2013.

• KODHELAJ Nevton, BODE Aida, KOJA Nevina, ZEQO Esmeralda, ZOGA Pirro, MUMAJESI Rajmonda, "Combined use of the Kozani-8 geothermal water through an integral, cascade and hybrid scheme and its positive effects on the environment, some thermal and economical calculations.," in CMSE, 2012.

• Kodhelaj N., Bode A., "3D Conceptual Modeling and Direct Utilization Calculations of the Albanian Low and Middle Enthalpy Geothermal Resources," Journal of Energy and Power Engineering, vol. 7, no. 8, pp. 1464-1471, August 2013.

• Kodhelaj, N., "Albanian Possibilities on Geothermal Direct Utilization," Renewable and Sustainable Energy, vol. 15, no. 5, pp. 2534-2544, 2011.

• Kodhelaj N., GEOTHERMAL ENERGY AND ITS USE IN ALBANIA, 1 ed., vol. 1, L. A. Publishing, Ed., USA: Lambert Academic Publishing, 2018, p. 169.

82

A deep reservoir for hydrogen drives intense degassing in the Bulqizë ophiolite, by Mr. Bardhyl Muceku, Polytechnic University of Tirana

Languages and translations
English

Hydrogen reservoirs in ophiolites L. Truche, F-V Donzé, E. Goskolli, B. Muceku, C. Loisy,

C. Monnin, H. Dutoit, A. Cerepi

April 4 th 2024, UNECE, AKBN, Tirane

The exemple of the Bulqiza chromium mine (Albania)

Ophiolites: the only place on the continent where H2-rich gas can be found at the surface

The Giant East – Mediterranean supra- subduction zone ophiolite belt > 3000 km long

Dilek et al., 2014

Xiong et al., 2015

Ophiolite in Albania: Bulqizë mine, chromium ore

Bulqizë Mirdita – Bulqizë

Ophiolite

Bulqizë mine: chromite ore, AlbChrome Ltd. mining company

Bulqizë mine: chromite ore, AlbChrome Ltd. mining company

Schematic 3D view of Bulqizë underground chromite mine. The entrance of the mine is at an altitude of 840 m above mean sea level and the deepest level is at -180 m.

Entrance (+840 m amsl) Batra deposit

The jacuzzi at L19 (-110 m bmsl)

> 1 km below the surface

H2 drainage boreholes at L17

Fault zone at L17 (+10 m amsl)

One geotechnic well closed: P = 20 bar (leaking, no casing)

L17 network of gas drainage boreholes L9 : H2 concentration at the exhaust of the boreholes

L9 : Air flow at the exhaust of the boreholes

L19 : H2 concentration at the base of shaft N9

1.2 vol % as measured by GC-TCD

L19 ventilation at the base of shaft N9: - 840 Nm3/min - 0.4 vol% H2 in the stall air

Air flow rate through the boreholes 4532 Nm3/hrs

Vented at L9

L 19

Schematic 3D view of Bulqizë underground chromite mine + locations of the measurements.

1.0 ×108 mol yr-1

Outgassing rates of H2 and concentrations of H2 and CH4 in the free gas phase from Bulqizë mine and other ophiolite-hosted seeps and bubbling pools.

Leong et al., 2023

Leong et al., 2023

Etiope et al., 2023

What could support this flux of 200 tons of H2 per year? (constant over 6 years)

1) Fluid inclusion/occluded gas decrepitation? 2) Active and pervasive serpentinization ?

3) A deep reservoir perforated by the mine’s galleries?

Fluid inclusions/occluded gas decrepitation?

• 7 to 38 ×10-6 mol kgrock -1 in the bulk harzburgite, dunite and chromitite rock samples collected

in the deepest levels of the mine.

• H2 flow rate in the mine constant during the last 6 years,

 drained rock volume of 5 to 27 km3.

• the total volume of ophiolite constituting the entire Bulqizë massif (i.e., 370 km2 x 3 km) would be depleted in 250 to 1300 years.

Fluid inclusion/occluded gas decrepitation?

Thus, this scenario seems unlikely, as all H2 within the massif would have vanished instantaneously on a geological timescale.

• 1.2 ×10-4 km3 must be altered every year to account for the observed H2 flow rate of 1.0 ×108 mol yr-1, assuming that 0.3 mole of H2 are produced per kg of serpentinized peridotite (Leong et al., 2023).

 the velocity of the serpentinization front = 0.15 m/yr If it remained constant over time, the reaction front would have advanced beyond the maximum thickness of the ophiolite (6 km) in 40,000 years, implying that the H2 production potential should be exhausted nowadays. (uplift 0.6 mm/yr)

• Global estimates of H2 production rate oceanic lithosphere + Precambrian continental crust : 0.02 to 2.4 Mt/yr (Sherwood Lollar, Merdith, Worman)

 The contribution from Bulqizë mine alone (200 tons) would be 0.01 to 1% of this global flux.

Active and pervasive serpentinization?

Active and pervasive serpentinization?

 The whole drainage volume should have been fully serpentinized after solely 13.5 Ma

A similar conclusion can be reached by considering a maximum mine drainage volume of 135 km3, corresponding to the effective rainwater catchment area of the mine of 45 km2 , and a rock thickness of 3 km.

A deep reservoir perforated by the mine’s galleries?

• fault zone: ≈10 m wide, with a length varying from 100 m to 1 km, and a maximum height of 5 km

volumes of rock ranging from 5.0 ×10-3 to 5.0 ×10-2 km3. Porosities has an average value 5% at depth as measured in fault zones in Oman ophiolites.

Could the fault-reservoir sustains the observed H2 rate flow during 6 years? Let’s compare!

A deep reservoir perforated by the mine’s galleries?

5000 to 50,000 tons of H2 stored in the fault zone (@ 30 MPa and 100°C)

Conclusions

 Bulqizë = 200 t/yr  This flux cannot be sustained by an active process  A reservoir must exist The fault zone being the most probable

Thank you!

Amount of H2 and CH4 released from 2 different samples and one blank (MONTAUT-Lh) after milling at 500 rpm as a function of milling time. Error bars are within the size of the symbols.

Radon: AlphaGuard

GE MIMS: Miniruedi

Electromag: CMD DUO

J S

U

A

Kr

K-C

K-C

K-C

U

U

Ko M

G

KG PKWKP KPPK

I

Upper plate crust

Lower plate (Apulian) crust

KG

174 MaA

A’

Geologic cross-section of the Albanides

Ar/Ar (Dimo-Lahitte 2001)

N

165 Ma

 Geodynamic framework

40 – 50 Ma

6 Ma

20 Ma

> 60 Ma 50 Ma

Slow cooling

Fast cooling

 Geodynamic implications

  • Slide Number 1
  • Slide Number 2
  • Slide Number 3
  • Slide Number 4
  • Slide Number 5
  • Slide Number 6
  • Slide Number 7
  • Slide Number 8
  • Slide Number 9
  • Slide Number 10
  • Slide Number 11
  • Slide Number 12
  • Slide Number 13
  • Slide Number 14
  • Slide Number 15
  • Slide Number 16
  • Slide Number 17
  • Slide Number 18
  • Slide Number 19
  • Slide Number 20
  • Slide Number 21
  • Slide Number 22
  • Slide Number 23
  • Slide Number 24

JUST TRANSITION ASSESSMENT OF ALBANIA; Sector Decarbonization and the Just Transition Framework Applied to Coal Mining, by Mr. Hans Rüdiger Lange, UNECE International Consultant

Languages and translations
English

UNECE JUST TRANSITION STUDY 2023

2nd Workshop on 4th of April 2024

Tirana

Mirëdita

Overview

1. The study project

2. Final Report

• Approach

• Findings

• Recommendations

3. Discussion

The Study Project

The Study: ACKNOWLEDGEMENTS

THANKS TO ALL ALBANIAN PARTICIPANTS IN THIS STUDY – IN PARTICULAR THE SUPPORT OF AKBN

This work was carried out by United Nations Economic Commission for Europe (UNECE) with the help of Mr. Hans Rüdiger Lange (Germany) as international consultant supported by the national consultant Mr. Nevton Kodhelaj (Albania).

The document was developed under the supervision of Michal Drabik, secretary of the UNECE Group of Experts on Coal Mine Methane and Just Transition and with the support of Oleg Dzioubinski, Regional Adviser at the UNECE Sustainable Energy Division.

The study was reviewed and edited by Michal Drabik and Raymond Pilcher, Chair of the UNECE Group of Experts on Coal Mine Methane and Just Transition, with a contribution by Dario Liguti, Director of the UNECE Sustainable Energy Division.

The UNECE Group of Experts on Coal Mine Methane and Just Transition also discussed and approved the document at its 18th session on 18th March 2024 in Geneva, Switzerland.

Approach

• Framework for a continued transformation of post-coal mining areas

• Description of Albanian coal sector and post-coal mining communities

• Assessment of Just Transition Readiness of the Coal Sector in Albania

• Stakeholder dialogue and practical recommendations

UNECE Just Transition Albania Dialogue 2023/24

Framework for a continued transformation of post-coal mining areas

UNECE Just Transition Albania Dialogue 2023/24

Description of Albanian coal sector and post-coal mining communities

UNECE Just Transition Albania Dialogue 2023/24

Description of Albanian coal sector and post-coal mining communities

UNECE Just Transition Albania Dialogue 2023/24

Description of Albanian coal sector and post-coal mining communities

UNECE Just Transition Albania Dialogue 2023/24

Assessment of Just Transition Readiness of the Coal Sector in Albania

transformation time

Socio-Economic Transition Phases

Landscape

Regime

Niche

S o

c io

-E c o

n o m

ic L

e v e ls

1944 - 1989 1990– 1994 1994 –2014 2014 –2023 2023 – 2035

smart specialized

shock disruption

entrepreneurial exploration

regime reshaping

smart specialized

„Socialistic Coal Mining

System“

„Political Disruption

& Coal Exit“ „Adaptation“ „EU Ascension”

„Just Transition achieved“

Central Mining

Administration

Miner Commuting

/ Mining Town Business Model

Decentral Mining Schools

Central Divestment

Agency

International Closure

Consultants

Fragmented

Privatization

1st wave of emigration

Private

Operating Licences Companies

Communal Land

Redistribution

International Investors

(Copper, Chrome, Coal?)

EU Candidate 2014

UN Program

Climate & Sustainability

National Programs

Regional Governance

Statistics &Planning Power Market 2014

Admin. Reform 2015

2nd wave of emigration

Initiatives

Projects

Programs

Anchor Firms

New Smart

Specializations

National Emission

Reduction Targets

Albanian Phases of Development

International

Institutions

New Mining

Law 1994

Mine Closures

EU and regional

integration

Infrastructure projects

Paris Agreement

Ratification 2016

West Balkan Six 2014

89/90 Toppling

of government

Inner Albanian

Migration & Urbanization

Stop of Mine operation

Ideas

UNECE Just Transition Albania Dialogue 2023/24

Description of Albanian coal sector and post-coal mining communities

UNECE Just Transition Albania Dialogue 2023/24

Description of Albanian coal sector and post-coal mining communities

UNECE Just Transition Albania Dialogue 2023/24

Assessment of Just Transition Readiness of the Coal Sector in Albania

1. A first part of this socio-economic transition of coal mining in Albania is already completed: the exit of coal mining as a business has been finished in the wake of market liberalization within less than 5 years after 1990. The challenging and immediate task of relocation of employees from closed mines has been solved by time.

2. A window of opportunity opens to finish the unfinished mine closure of the 1990s: Closed mine securization, land-reuse and new business development are still an open end of Albania’s coal mining exit. Attention and efforts of international institutions like UN and EU on a decarbonization of the Western Balkan could provide government attention and financial resources to support a Just Transition program centered around a second securization program of the post-mining areas.

3. Albania has a unique opportunity to position itself as an ambitious European first mover towards a net zero economy. Blessed with a considerable geographical potential for renewable energy and a legacy of significant installed hydropower capacity the country has a pole position amongst European nations to become a green economy leader. An ambitious program of solar and wind power farms could fill the widening gap between renewable power production and increasing power consumption. Such a program would not only boost local business and energy production, but it could serve as a modernization drive in higher education institutions, start- up communities and targeted foreign investment attraction.

Create participatory process and governance for „Just Transition & Coal Exit in Albania“ Win stakeholders on a national level Set up a robust multi-lever process, centrally coordinated governance supporting the identified areas of action on the decentral, local level. Leverage EU driven institutional renewal: Invest in Governance, Policy Frameworks and Local Entrepreneurship.

Modernize into a Competitive Green Economy Carefully phase out fossil fuels (smart end of use strategy, CO2 risk management) Build and invest in competitive infrastructure (grid, regional integration, power exchange) for a green, sustainable economic development of Albania Build markets for expanding usage of renewable energy and local resources

Reinvent local business models and foster smart specialization of communities Foster and accelerate adaptation via modernization of higher education institutions and research, international learning networks and practical cooperation on local, national and regional level Private sector and local initiative mobilization Private sector and local initiative support framework on a central level

UNECE Just Transition Albania Dialogue 2023/24

Stakeholder dialogue and practical recommendations

Observations Recommendations

Just Transition Innovative Project Award

2025

UNECE Study 2023 / 24

UNECE Just Transition Albania Dialogue 2023/24

Just Transition Innovative Project Award 2025

2025 Award

• Donation of 333 EUR by Jürgen Lange & Son for the 1st Price

• Top 3 projects presented at UNECE 03/2025 (via video)

Award Jury and Assessment

• Mixed Jury of Experts (UNECE / region)

• Competition of at least 5 projects

• Project Presentation (max. 20 PPT-Slides)

• handed in by 31.01.2025

Project Assessment Criteria

• Post-Coal-Mining Project for the Next Generation

• Value Creation in the Regional Mining Community

• Simplified Business Plan of the Project Idea

• English Presentation as the world learns together

UNECE Just Transition Albania Dialogue 2023/24

Just Transition Innovative Project Award 2025

UNECE

Just Transition for Coal Mining Regions Albania

PROPOSITIONS

UNECE Study 2023

1.Create participatory process and governance for „Just Transition & Coal Exit in Albania“

• Win stakeholders on a national level and build a shared and methodological sound perspective on the „Just

Transition & Coal Exit“

• Set up a robust multi-lever process and centrally coordinated governance via the identified areas of action

• Leverage EU driven institutional renewal: Invest in Governance, Policy Frameworks and Local

Entrepreneurship for the Mining Sector, Former Mining Communitites and related Education

2.Modernize into a Competitive Green Economy

• Carefully phase out fossil fuels (smart end of use strategy, CO2 risk mgt)

• Build Infrastructure (Grid, Regional Integration, Power Exchange) for a green, sustainable economical

development of Albania

• Build markets for expanding usage of renewable energy and local resources

3.Reinvent local business models and foster smart specialization of communities

• Foster and accelerate adaptation via learning networks and cooperation on local, national and regional level

• Private sector and local initiative mobilization

• Private sector and local intiative support framework

An Outstanding Opportunity

Just Transition & Coal Exit Albania – Sugggested Areas of Action

UNECE Just Transition Albania Dialogue 2023/24

Just Transition Albania: Just Transition Road Map (Workshop 04.04.24)

AA1: Project Set Up AA2: Government & Governance

AA3: Empower Local Activitites

AA3: Green Economy Infrastructure

M1.1 M2.1 M3.1 M4.1

M1.2 M2.2 M3.2 M4.2

M1.3 M2.3 M3.3 M4.3

M1.4 M2.4 M3.4 M4.4

Component 1: Just transition process to complete mine closure and coordinate activities

Component 2: Reinvent smart specialization in the Communities in a decentral approach

Component 3: Enabling Sustainable Economic Growth by creating infrastructure and preconditions for green economy

Vision:

Use Just Transition process fto leverage EU ascession modernization for building a green economy

Program:

UNECE Just Transition Albania Dialogue 2023/24

Just Transition Albania: Just Transition Road Map (Workshop 04.04.24)

AA1: Project Set Up AA2: Government & Governance AA3: Empower Local Activitites AA3: Green Economy Infrastructure

M1.1 Identify an organization on national level in Albania who organizes a dialogue process „Just Transition“ • Stakeholder Contact

Group on national level • Stakeholder Contact

Group on Westbalkan Six • Series of 3 consecutive

Workshops (Roadshow, Idea Generation, Project Selection) in concerned Mining Communities (see also M3.2)

M2.2 Special Legislation to enhance decentral renewable energy generation • Priority Clearing of Land

issues in Former Mining Sites

• Declare special nature (package)

• protection status for this land in remote areas with routism potential

• Declare favorite development status in urban areas.

M3.2 Summer Academy of Regional Mining Universities

Students, Stakeholders and potential employers elaborate Scenarios for the concerned Mining Communities. Financing via International Educational Programs or throuth the West Balkan Six Initiative.

M4.4 Special Legislation to enhance decentral renewable energy generation • Priority Clearing of Land

issues in Former Mining Sites

• Declare special nature (package)

• protection status for this land in remote areas with routism potential

• Declare favorite development status in urban areas.

Component 1: Just transition process to complete mine closure and coordinate activities

Component 2: Reinvent smart specialization in the Communities in a decentral approach

Component 3: Enabling Sustainable Economic Growth by creating infrastructure and preconditions for green economy

UNECE Just Transition Albania Dialogue 2023/24

UNECE JUST TRANSITION STUDY 2023

Faleminderit

Mirupafshim

  • Standardabschnitt
    • Slide 1
    • Slide 2: Overview
    • Slide 3: The Study Project
    • Slide 4: The Study: ACKNOWLEDGEMENTS THANKS TO ALL ALBANIAN PARTICIPANTS IN THIS STUDY – IN PARTICULAR THE SUPPORT OF AKBN
    • Slide 5: Approach
    • Slide 6: Framework for a continued transformation of post-coal mining areas
    • Slide 7: Description of Albanian coal sector and post-coal mining communities
    • Slide 8: Description of Albanian coal sector and post-coal mining communities
    • Slide 9: Description of Albanian coal sector and post-coal mining communities
    • Slide 10: Assessment of Just Transition Readiness of the Coal Sector in Albania
    • Slide 11: Description of Albanian coal sector and post-coal mining communities
    • Slide 12: Description of Albanian coal sector and post-coal mining communities
    • Slide 13: Assessment of Just Transition Readiness of the Coal Sector in Albania
    • Slide 14: Stakeholder dialogue and practical recommendations
    • Slide 15: Just Transition Innovative Project Award 2025
    • Slide 16: Just Transition Innovative Project Award 2025
    • Slide 17: Just Transition Innovative Project Award 2025
    • Slide 18: UNECE Just Transition for Coal Mining Regions Albania PROPOSITIONS
    • Slide 19: An Outstanding Opportunity Just Transition & Coal Exit Albania – Sugggested Areas of Action
    • Slide 20: Just Transition Albania: Just Transition Road Map (Workshop 04.04.24)
    • Slide 21: Just Transition Albania: Just Transition Road Map (Workshop 04.04.24)
    • Slide 22

Addressing data gaps will help Albania improve access to water and sanitation for vulnerable and marginalized communities

Guaranteeing safe access to drinking water and sanitation remains a challenge in the pan-European region, with 16 million people still lacking access to basic drinking water services and over 29 million people not having access to basic sanitation, including hundreds of thousands who have to practice open defecation.

Mapping Albania’s readiness for green and just transition in post-coal mining areas (Parliamentary document discussed at the 19th session of the UNECE Group of Experts on Coal Mine Methane and Just Transition, held on 18-19 March 2024 in Geneva)

Languages and translations
English

Economic Commission for Europe

Committee on Sustainable Energy

Group of Experts on Coal Mine Methane

Nineteenth session

Geneva, 18-19 March 2024

Item 4 of the provisional agenda

Report on implementation of the work plan for 2022-2023

Mapping Albania’s readiness for green and just transition in post-coal mining areas

Note by the Secretariat

I. Introduction

1. The United Nations Economic Commission for Europe (ECE) is actively promoting

environmentally sustainable practices in the energy sector, aligning with principles of carbon

neutrality and a just transition. This involves countries undergoing a process of

decarbonization, creating new opportunities but also causing disruptive effects, especially for

communities reliant on energy-intensive industries.

2. ECE acknowledges the need to tailor the transformation process to each member

state's capabilities, considering factors such as natural resources, technology, culture,

national aspirations, and legal structures.

3. In response to Albania's request, ECE conducted a study focused on post-coal mining

areas to assess the country's current state and readiness for a green and just transition. The

study aims to provide stakeholders with a comprehensive understanding of the ongoing socio-

economic transition, evaluate the readiness of coal mining communities in Albania.

4. To best serve Albania’s request and the affected communities, the study takes a

practitioner’s approach and provides the stakeholders with a sound understanding of the

socio-economic transition under way, with an assessment of the readiness of Just Transition

Status of Coal Mining Communities in Albania and with a set of recommendations for

possible next steps in the process.

5. Section 1 of the study reviews the emerging practices associated with pursuit of “Just

Transitions” through a combination of selected conceptual foundations rooted in scientific

research and insights arising from socio-economic transitions. Section 2 gives an overview

of the coal mining sector in Albania and its current status. Section 3 assesses the readiness of

the coal exit in terms of “ECE Just Transition Framework”. Section 4 summarizes the

recommendations for next steps in this process.

United Nations ECE/ENERGY/GE.4/2024/5

Economic and Social Council Distr.: General

5 March 2024

English only

ECE/ENERGY/GE.4/2024/5

2

II. Statement of the problem

6. A burgeoning population and increasing per capita consumption have led to the

overuse and partial exhaustion of planetary resources.

7. The primary threat is global warming, driven by manmade greenhouse gas emissions.

8. The challenge is to transition from carbon-intensive supply chains and their related

socio-economic ecosystems towards local sustainable green economies.

9. In each case, such transition requires a complex change management process, posing

obstacles and creating risks that can make the socio-economic shift more costly, or even halt

the transformation process.

10. In an initial phase, transitions oftentimes affect local communities in a disruptive way

characterized by surprise and uncertainty. Communities that are unprepared for the systemic

change tend to defend their outdated economic models and industries on which they depend.

11. Therefore, it is necessary to enable affected communities to strengthen their

capabilities and information basis necessary to enable shift from traditional industries to new

sustainable business development.

III. Framework

12. The Just Transition Framework for Sector Decarbonization proposed in the study is

intended to enable impacted communities to develop an understanding of the socio-economic

transition’s needs and objectives, its constituent processes, and system elements. It shares

experiences of regions going through the same transition and offers a practitioner’s approach

creating transparency of the transition under way, set up a procedural and organizational

framework in order to embark on the journey from a coal mining community towards a green

economy.

13. The developed Framework provides an understanding of the fundamentals of

decarbonization driven socio-economic transitions and outlines how an impacted community

may assess and visualize its economic ecosystem and how it may negotiate the change

process, create and develop projects towards an emerging green economy, while adjusting

and balancing ecological, economic, social and participatory concerns.

14. For the purpose of the study, as a starting point, the Framework provides an

information base and assessment of the just transition readiness of coal mining communities

in Albania.

15. The document also presents two mini-case studies of Malmö (Sweden) and Buffalo

(United States) providing a vision of how to apply the building blocks of the Just Transition

Framework in practice.

IV. Framework for a continued transformation of post-coal mining areas

A. Multilevel character of socio-economic transformation

16. The concept of "Multilevel Socio-Economic Transitions" (MSET), which has already

been extensively discussed in literature, is a framework for understanding the complex and

interconnected processes of societal and economic change, in particular in the context of

transitioning away from fossil fuels like coal.

17. The concept highlights three key levels: niches, regime, and landscape:

(a) Niches are defined as small-scale, decentralized activities allowing

experimentation and creating opportunities. Widespread niche activity leads to a diverse

range of possibilities;

ECE/ENERGY/GE.4/2024/5

3

(b) Regime represents a structured level with specialized cooperation patterns,

evolving from a starting point and undergoing reconfiguration aftershocks (e.g., mine

closures);

(c) Landscape is a macro-level source of threats and opportunities that are beyond

direct control of the community, e.g., such disruptions like coal exit driven by economic

liberalization or climate mitigation measures.

18. The socio-economic transition involves dynamic interactions between niches, regime,

and landscape levels.

19. Practical recommendations from MSET include:

(a) On a Socio-Technical Systems level: Recognizing that societal transitions

involve more than technology, stakeholders are advised to consider shifts in social practices,

institutions, policies, and cultural norms;

(b) On a Regime Shifts level: Transitioning from initial to new regimes involves

changes driven by technology, market, politics, policies, or societal values;

(c) In the context of Path Dependency and Lock-In: Existing systems may be

"locked-in," requiring efforts to overcome path dependency, crucial for transitioning away

from established systems like coal mining;

(d) From a Multilevel Perspective: Emphasizes coordinated efforts across local,

regional, national, and global levels. In sustainability transitions, managing initiatives

carefully is essential for addressing just transition risks and benefits arising from higher

landscape levels.

B. Technology architecture, mine closure and ecological healing

20. The study underscores the significance of a "Just Transition" in the context of mining

and coal exit, recognizing the specific technical and administrative challenges. UNECE's

expertise is acknowledged, prompting the need for a framework to guide post-mining land

recovery, ensuring effective ecosystem restoration and environmental mitigation.

21. Highlighting intensive studies in Poland, Germany, Serbia, and Albania, the document

outlines a UNECE study structure for coal mines.

22. Emphasizing context-specific transformations, it addresses procedural aspects,

including the screening and reconfiguration of primary and secondary assets.

23. Practical recommendations advocate for a technologically sound approach, consistent

national standards, centralized oversight, multi-party collaboration, ongoing monitoring, and

the utilization of international expertise for a globally informed strategy. The overarching

goal is to establish a standardized, sustainable model for post-mining land recovery.

C. Supply chain decarbonization and value net reconfiguration

24. The document highlights the technologically and cooperation-intensive nature of coal

extraction, emphasizing the pivotal role that coal has been playing in many major industrial

processes.

25. As a result, the Just Transition from coal significantly impacts the entire economic

fabric, marked by long chains of value creation, technological intensity, and complex

cooperation. To navigate this process effectively and capitalize on opportunities for

infrastructure reconfiguration, understanding economic interdependencies is crucial.

26. The document introduces supply chains as tools for analysing the economic fabric

during the Just Transition, highlighting their role in minimizing costs and optimizing

processes. Supply chain mapping is proposed to enhance transparency over stakeholders and

dependencies in the affected mining sector.

ECE/ENERGY/GE.4/2024/5

4

27. Additionally, the concept of value nets is introduced, acknowledging interconnected

relationships beyond a single supply chain. The holistic understanding of value creation in

sectors like coal mining, encompassing various interlinked industries, is emphasized.

28. Practical recommendations derived from supply chain and value net approaches aim

to enhance the success of Just Transitions. The study advocates systematic supply chain

optimization as a key path to decarbonization. Companies are encouraged to adopt

sustainable practices, incorporating renewable energy, enhanced energy efficiency, and

cleaner technologies throughout the supply chain. Radical measures, such as rethinking

material inputs, waste reduction, and embracing circular economy principles, are suggested

for successful decarbonization.

29. Collaboration across the supply chain is highlighted as crucial to ensure uniform

adoption of sustainable practices from mining operations to the final product.

30. Value net analysis is recommended to identify collaboration and innovation

opportunities within the broader Just Transition ecosystem. In the context of coal mining,

stakeholders are urged to explore partnerships with renewable energy providers, engage in

responsible resource extraction practices, and collaborate with governments to address

regulatory challenges. The document views the transition away from coal as fuel as an

opportunity for new businesses in renewable energy, sustainable materials, mining asset

upcycling, and green technologies. Additionally, exploring value nets of regional cooperation

is suggested, emphasizing that companies and entrepreneurial ecosystems leveraging their

position within the value net can gain a competitive edge aligned with the broader trend of

decarbonization.

D. Entrepreneurial Ecosystems, Smart Specialization and Regional Identity

31. The importance of considering local cultural and socio-economic factors in managing

successfully a Just Transition is highlighted.

32. The document underscores the significance of entrepreneurial ecosystems in the

context of coal exit transitions and emphasises the uncertainties and challenge faced by

mining communities in creating alternative ventures, urging stakeholders to reimagine and

reinvent local ecosystems.

33. The role of the broader environment in entrepreneurial success is acknowledged as is

the context-specific nature of these ecosystems.

34. An illustration of the interconnected elements of entrepreneurial ecosystems,

including entrepreneurs, investors, mentors, educational institutions, government policies,

and support organizations is provided and discussed. The study notes the dynamic and self-

reinforcing effects of these interactions and notes that in the coal exit situations negative self-

reinforcing cycles are common, leading to economic decline and emigration. Conversely, it

is argued that a thriving ecosystem attracts resources, talent, and investment, fostering a

conducive climate for entrepreneurship.

35. The document introduces the concept of smart specialization as a policy approach,

encouraging communities to look at their entrepreneurial ecosystem from a global

perspective and align strategies in order to build competitive advantages. It emphasizes the

role of communication in this process, addressing challenges in reshaping the region's image

during disruptive transitions. Changes in identities and narratives are acknowledged both as

potential opportunity in terms unifying forces for change as well as potential sources of

conflict.

36. Practical recommendations based on entrepreneurial ecosystem approaches are

outlined. Key points include diversification, innovation, and skills development, leveraging

investments and infrastructure, and fostering collaboration. The document emphasizes the

need for region-specific strategies, considering differences in culture, regulations, and

resources. Overall, it advocates for employing the entrepreneurial ecosystem framework and

smart specialization perspective to help local communities to navigate the complexities of

transitioning away from coal-based economies.

ECE/ENERGY/GE.4/2024/5

5

E. JUST Transition – normative context of sustainability policies, goals and

Key Performance Indicators (KPIs)

37. The concept Just Transition not only describes a transformation process. It also claims

a qualitative property, i.e., that the transition ought to be just.

38. The principles the discussed concept represents have historical roots in earlier labour

and social justice movements that advocated for fair treatment and protection of workers and

communities affected by economic and industrial changes. However, over time, the concept

has evolved and expanded to encompass a broader range of normative “justices”.

39. Two major drivers influence the current ever more prominent role of Just Transition

concept and the related policies:

(a) the increasing physical exhaustion of natural resources and global warming,

and;

(b) political activities in a form of multilateral negotiations intending to establish

a consensus about values, goals, and targets in order to formalize these goals in form of

international treaties (in other words, policy domains emphasizing multiple justices in terms

of social equity, worker rights, and community well-being in the transition to a more

sustainable and inclusive economy).

40. The study offers practical recommendations, advising careful consideration of

normative elements in disruptive forces and policy dimensions. It stresses the importance of

understanding the long-term policies and market trends driving the particular transition under

study, citing for Albania the European Accession Process and Investment Funds as

institutional frameworks for the Just Transition process.

F. Uncertainty, Governmental Programs and Possibilism

41. The document reflects on the practical aspects of achieving a "Just Transition" in a

coal mining region and highlights the challenges of implementing theoretical concepts in

real-world scenarios. It emphasizes the absence of a one-size-fits-all recipe for a successful

transition, pointing to the need for on-the-ground experimentation and entrepreneurial effort.

42. The concept of "possibilism" is presented as a valuable perspective for socio-

economic transitions. Possibilism encourages viewing constraints not as insurmountable

barriers but as opportunities for innovation and reconfiguration. It emphasizes the importance

of a creative problem-solving capacity within societies, advocating for adaptable and resilient

approaches to address the unique challenges posed by transitions, especially in the context of

top-down coal exit programs.

43. Practical recommendations drawn from a possibilism approach include integrating the

principles of subsidiarity and entrepreneurial agency into policies. This creates a framework

for addressing regional development challenges, encouraging regions to see growth potential

within their unique circumstances, leverage local entrepreneurs, and make decisions at the

most appropriate level of governance. Subsidiarity promotes decentralized decision-making,

tailored approaches, community empowerment, and collaboration among regions, fostering

a holistic and resilient approach to regional development.

G. Examples of Just Transition Frameworks – World Bank and European

Union (EU)

44. The document highlights the establishment of the "Just Transition" concept as a

recognized research field and policy reference, adopted by key institutions like the United

Nations, the International Labour Organization, the World Bank, and various national

institutions.

ECE/ENERGY/GE.4/2024/5

6

45. It refers to two examples of these institutional approaches, one developed by the

World Bank for coal-dependent regions in Western Macedonia and another by the Wuppertal

Institute under the European Union's Horizon 2020 program.

46. The World Bank's "Coal Sector Transition Assessment Framework" and the

Wuppertal Institute's "A Just Transition Readiness Evaluation Tool" are discussed in detail,

providing insights into their methodologies, pillars, and phases. The document acknowledges

ongoing research challenges in sustainability transitions, particularly regarding the

integration of ecological and human systems, the role of multinational companies, and multi-

stakeholder coordination.

47. Practical recommendations drawn from Just Transition methodologies stress the

localized and creative nature of the process. The study suggests creating unique approaches

inspired by external experiences, emphasizing local conditions and community

empowerment. The importance of governance is highlighted, focusing on identifying key

players committed to the Just Transition and designing an efficient governance structure to

integrate stakeholders into the process. The document encourages adaptation, learning from

diverse sources, and fostering constructive debate for effective community mobilization.

V. Albanian coal sector and post-coal mining communities

48. In this section the document offers a multidimensional overview of Albania and

describes the current state of Just Transition in the country’s post-mining communities,

proposing the distinction of the following categories of post-mining communities:

(a) Post-mining areas in the metropolitan area of Tirana;

(b) Medium centers (Korça, Pogradeci, Telepania), and;

(c) The remaining, remote post-mining communities.

49. For each community, a detailed “Just Transition ID-Card” is developed in order

provide a starting point of transparency for discussion.

VI. Assessment of Just Transition Readiness of the coal sector in Albania

A. Quantitative Analysis

50. Building upon the World Bank's three pillars approach, the document proposes a

comprehensive data model for assessing the readiness of a Just Transition consisting of 8

dimensions and 5 levels:

(a) The governance pillar includes (1) State level Governance and (2) Regional

Agency;

(b) The people pillar distinguishes between (3) People Care, which assesses

supportive measures for compensating hardships, and (4) People Growth, focusing on

developing capabilities for adaptation;

(c) The transformation pillar includes ecological aspects - (5) Ecological Healing

- and the creation of substitute employment in the (6) New Economy dimension;

(d) A fourth pillar, Digitalization, is introduced with (7) Data Transparency and

(8) Digital Cooperation dimensions as a precondition for regional capability building and

ownership in this process.

51. For each dimension, criteria are suggested to guide the scoring of Just Transition

Readiness at each level:

(a) Governance is highlighted as a key dimension associated with landscape-level

concepts;

ECE/ENERGY/GE.4/2024/5

7

(b) Regional Agency and Individual Ownership are emphasized for successful

development, particularly in the context of disruptions like a coal exit;

(c) People Care addresses the impact on individuals and communities,

emphasizing the need for support in adapting to disruptions, considering factors like age and

speed of disruption;

(d) People Growth recognizes the importance of change and the development of

new skills through formal education and vocational training, requiring the reinvention of

established institutions and networks;

(e) Ecological Healing focuses on restoring the natural status after the shutdown

of carbon-intensive industries;

(f) New Economy emphasizes the challenge of creating a sustainable basis of

living for affected individuals and regions through self-supporting activities, attracting

existing businesses to invest in the region;

(g) Data Transparency and Digital Cooperation are introduced as crucial in a

rapidly changing scenario, emphasizing the need for coordination and rapid communication

in socio-economic transitions.

52. The extension of the three-pillar model is justified by the practical experience in just

transitions, complementing institutional governance with agency and ownership at the

regional level. The importance of both separating from the old and embracing the new is

recognized.

53. The section concludes with a minimum set of Key Performance Indicators (KPIs) for

quantitative analysis of the Just Transition, with considerations for data availability and

readiness.

54. The limitations of fragmented statistical databases in Albania are acknowledged, and

estimates are proposed based on systematically collected information from interviews.

55. In order to overcome the data gaps, a digital twin simulates the socio-economic

transition based on additional assumptions. The digital twin diagrams provide a condensed

quantitative image of the socio-economic transition in form of a reduced set of KPIs for the

coal mining sector, with color-coded indications of data readiness.

56. The document also refers to the SDG monitoring plan as a complementary data source,

highlighting Albania's progress in SDG scores.

B. Qualitative Analysis

57. This section outlines the specific coal exit transition in Albania through information

collected during the field trips, interviews, and group discussions in 2023.

58. Utilizing a multi-level socio-economic transition scheme, supply chain analysis, and

entrepreneurial ecosystem analysis, the document provides a pragmatic description of key

characteristics.

59. The Mapping of Socio-Economic Transition (MSET) illustrates the temporal

evolution of the transition, highlighting major activities on landscape, regime, entrepreneurial

ecosystem, and niche levels. Significant turning points include the breakdown of the initial

communist regime, the collapse of the industrial entrepreneurial ecosystem after 1990, and

subsequent steps such as the mining law of 1994 and EU integration processes.

60. The document emphasizes the influence of United Nations (UN) and EU policy

frameworks, becoming integral to Albanian policy and opening the opportunity for a

multidimensional modernization of the entrepreneurial ecosystem by 2035. This includes

reforms in education, administration, and legal structures to align with European standards

and attract foreign investments.

61. In terms of the economic situation, the document notes the shift from a linear

industrial supply chain of the energy sector before 1990 to a diversified national and

ECE/ENERGY/GE.4/2024/5

8

regionally interconnected power market. The liberalization and modernization of the power

market create opportunities for the green economy and renewable energy projects, regional

cooperation and aligning with global trends.

62. Challenges identified in interviews and analysis of statistical data include demography

and the availability of a qualified workforce. The collapse of the socialist system in 1989 led

to a sub-critical job market for miners, but opportunities exist for regional cooperation in

mining education and strategic realignment into growth markets such as renewable energy.

63. The document also highlights the need for stronger support for decentralized power

generation, addressing transparency and administrative barriers to project development.

Albania faces the challenge and opportunity of shifting to a growth model fuelled by

renewable energies, requiring coordinated efforts in policy, legislation, administration,

infrastructure, and education.

C. Expert-based assessment of the Just Transition readiness

64. The need for a methodological approach to assess the readiness of a country or

entrepreneurial ecosystem undergoing a transformative evolution, such as the Just Transition

process is emphasized.

65. The concept of a maturity model is introduced to provide a transparent and

understandable assessment scheme, allowing stakeholders to evaluate the status and manage

progress in the transformational process.

66. Maturity models, commonly used in various evolutionary phenomena, consist of

dimensions characterizing the degree of progress of the process under study.

67. In this case, dimensions of the Just Transition are combined with five maturity levels

(neutral, basic, managed, defined, established). Criteria for each level are defined, and the

maturity is assessed for each dimension, aggregated with proportional weights to obtain an

overall maturity for the entire Just Transition Readiness.

68. The obtained maturity value serves as an indicator of the extent to which the Just

Transition process under investigation is implemented. However, it does not measure the

completion of specific goals, such as new employment, land reuse percentage, or renewable

electricity production.

69. The document includes a table summarizing the expert-based assessment of Just

Transition Readiness for the Coal Mining Sector in Albania. The assessment process involves

a two-level approach: individual assessments from a small group of experts who have closely

followed the project and field studies, followed by a structured group interview leading to a

qualified group assessment of the transition maturity.

VII. Practical Recommendations and Considerations

A. Recommendations

70. Based on the described above analysis, the document provides the following set of

recommendations:

(a) Create Participatory Process and Governance for "Just Transition & Coal Exit

in Albania":

(i) Identify a core group of stakeholders dedicated to the mission of the

project;

(ii) Gain national stakeholder support and establish a shared,

methodologically sound perspective on the Just Transition & Coal Exit;

(iii) Set up a robust, multi-level process with centrally coordinated

governance supporting mine closure security, environmental protection, and

local business diversification;

ECE/ENERGY/GE.4/2024/5

9

(iv) Leverage EU-driven institutional renewal by investing in governance,

policy frameworks, and local entrepreneurship for the mining sector and

related education.

(b) Modernize into a Competitive Green Economy:

(i) Exploit Albania's high degree of electricity generation from renewable

resources, focusing on untapped photovoltaic and wind potential;

(ii) Position Albania as a leader in the Green Economy within the European

Union;

(iii) Capitalize on ongoing EU-driven modernization efforts to establish a

consistent legal framework for a low-carbon economy;

(iv) Focus on creating a favourable legal and market framework for

decentralized electricity generation and related business models;

(v) Phase out fossil fuels strategically, invest in competitive infrastructure,

and build markets for expanding the usage of renewable energy and local

resources.

(c) Reinvent Local Business Models and Foster Smart Specialization of

Communities:

(i) Prioritize the revitalization of local entrepreneurship as a strategic,

long-term task;

(ii) Encourage communities to take initiative and ownership of challenges,

fostering a business development mindset;

(iii) Establish the Just Transition Initiative as a catalyst for entrepreneurship

and learning within communities;

(iv) Develop key partnerships with higher education institutions focusing

on innovation and entrepreneurship to support learning and skills acquisition;

(v) Accelerate adaptation through the modernization of higher education

institutions, international learning networks, and practical cooperation at local,

national, and regional levels;

(vi) Mobilize and support private sector and local initiatives centrally to

ensure a comprehensive framework for success.

B. Considerations

71. The document provides also certain practical considerations to be taken into account

while preparing for implementation of the transition process:

(a) Focus on the Initiation and Setup of a Just Transition Working Group:

(i) Given the completed social coal exit but unfinished ecological healing

and new business development in Albania, prioritize the establishment of a

Just Transition working group;

(ii) This group should serve as the seed for developing a local pilot project,

acting as a proof of concept for completing the coal exit initiated in the 1990s

and transitioning toward a finished Just Transition;

(iii) Use the Just Transition framework as a guiding methodology to align

with UN and EU programs, increasing the likelihood of obtaining financial

support for a systematic program for post-mining communities.

(b) Importance of a Local Pilot Group with Committed Stakeholders:

(i) Without a local pilot group comprising committed stakeholders,

interested international institutions may lack a counterpart for developing an

internationally funded Just Transition program for Albania;

ECE/ENERGY/GE.4/2024/5

10

(ii) Practical recommendations emphasize the critical nature of this initial

step in the life cycle of a Just Transition program.

(c) Next Steps in the Just Transition Program:

(i) A local initiative consisting of 3 to 10 players, including representatives

from higher education, green economy businesses, post-mining communities,

and government sponsors, should be formed within 6-8 weeks;

(ii) Prioritize "speed boat" projects during a workshop under the ECE,

focusing on small, resource-efficient projects with rapid outcomes to engage

local and international stakeholders;

(iii) Over the next 1-3 years, this project group becomes a counterpart for

continued dialogue in the Just Transition path with ECE and other international

partners.

(d) Building Public-Private Cooperation into the Local Project Group:

(i) Emphasize the importance of public-private cooperation within the

local project group, recognizing that Just Transition is fundamentally about

building a viable and resilient local economy;

(ii) Engage potential business partners, such as international companies in

the energy market or anchor companies in post-mining communities, to

enhance the attractiveness of these places for future employees.

(e) Involvement of Higher Education Institutions:

(i) Encourage active participation, ideally at the professorship level, from

a faculty of entrepreneurship, sustainable development, or innovation from

leading higher education institutions in Albania;

(ii) Highlight the potential for applied learning in entrepreneurship and

provide research opportunities for students, creating a mutually beneficial

relationship between the "Just Transition Initiative Albania" and educational

institutions.

Agenda and Timetable

Languages and translations
English

Draft Agenda for the Workshop

Mapping Albania’s readiness for green and just transition in post-coal mining areas

Tirana, Albania

4 April 2024

DESCRIPTION

The project titled Mapping Albania’s readiness for green and just transition in post-coal

mining areas assessed Albania’s readiness for green and just transition in local post-coal mining

areas and identified regulatory, social, technical, and financial barriers that the country needs to

address to be able to successfully reclaim and repurpose its post-coal mining areas in accordance

with the principles of green economy and just transition. The project assessed the situation of

various post-coal mining sites across the country and identified elements that are necessary to

enable the start and to ensure progress in reclaiming and repurposing. The project concluded with

a study that is to be presented at the workshop and discussed with the local stakeholders.

To best serve the affected communities the study takes a practitioner’s approach and provides the

stakeholders with a sound understanding of the socio-economic transition under way, with an

assessment of the readiness of Just Transition Status of Coal Mining Communities in Albania and

with a set of recommendations for possible next steps in the process.

The Just Transition Framework for Sector Decarbonization proposed in the study is intended to

enable impacted communities to develop an understanding of the socio-economic transition’s

needs and objectives, its constituent processes, and system elements. It shares experiences of

regions going through the same transition and offers a practitioner’s approach creating

transparency of the transition under way, set up a procedural and organizational framework in

order to embark on the journey from a coal mining community towards a green economy.

The developed Framework provides an understanding of the fundamentals of decarbonization

driven socio-economic transitions and outlines how an impacted community may assess and

visualize its economic ecosystem and how it may negotiate the change process, create and

develop projects towards an emerging green economy, while adjusting and balancing ecological,

economic, social and participatory concerns.

For the purpose of the study, as a starting point, the Framework provides an information base and

assessment of the just transition readiness of coal mining communities in Albania.

The document also presents two mini-case studies of Malmö (Sweden) and Buffalo (United States)

providing a vision of how to apply the building blocks of the Just Transition Framework in practice.

The study also offers a multidimensional overview of Albania and describes the current state of

Just Transition in the country’s post-mining communities.

Building upon the World Bank's three pillars approach, the document proposes a comprehensive

data model for assessing the readiness of a Just Transition consisting of 8 dimensions and 5 levels.

Based on the conducted analysis, the study concludes by providing a set of recommendations and

considerations, that are to be presented in detailed and discussed at the workshop.

In the first part of the workshop the study with its findings and recommendations will be introduced

to the Albanian stakeholders, as well as to the foreign experts and practitioners participating in the

event remotely.

The second part of the workshop will be entirely dedicated to discussing the document and

identifying best ways for implementing its recommendations.

TIMELINE

Opening

9:30 Welcome by the host (Mr. Petrit Malaj, the Executive Director of AKBN)

9:40 Introduction to the workshop by UNECE (Mr. Michal Drabik, Secretary, UNECE Group of Experts on Coal Mine Methane and Just Transition, Mr. Oleg Dzioubinski, Regional Adviser, SED, UNECE, and Mr. Raymond Pilcher, Chair, UNECE Group of Experts on Coal Mine Methane and Just Transition)

Part I: Albania’s readiness for Just Transition

9:55 ILO’s’ concept of Just Transitions and the approaches that the organization adopts in Central and Eastern Europe to mitigate the employment and social impacts of the transition on the communities that currently depend on coal-mining operations for their livelihoods (Ms. Daniela Zampini, Senior Employment Specialist, ILO Office for Central and Eastern Europe)

10:10 Q&A

10:15 Presentation of the study JUST TRANSITION ASSESSMENT OF ALBANIA; Sector Decarbonization and the Just Transition Framework Applied to Coal Mining (Mr. Hans Rüdiger Lange, UNECE International Consultant, and Mr. Nevton Kodhelaj UNECE National Consultant)

Part II: Brainstorming

10:45 Open discussion on the draft findings and recommendations presented in Part I, and on potential scenarios form effective transformation and repurpose of the post coal mining areas in Albania (Moderated by: Mr. Hans Rüdiger Lange, UNECE International Consultant)

11:30 Mid-point summary of the discussed matters (Mr. Raymond Pilcher, Chair, UNECE Group of Experts on Coal Mine Methane and Just Transition)

Part III: Innovative solutions facilitating Just Transition

11:40 A deep reservoir for hydrogen drives intense degassing in the Bulqizë ophiolite (Mr. Bardhyl Muceku, Polytechnic University of Tirana)

11:50 Coalmining as a multipurpose resource platform (Mr. Raymond Pilcher, Chair, UNECE Group of Experts on Coal Mine Methane and Just Transition)

12:05 Q&A

Part IV: Summary

12:15 Summary of the discussion (Mr. Hans Rüdiger Lange, UNECE International Consultant)

Close of the workshop

12:25 Closing remarks by the host and UNECE

12:30 End of the workshop

The role of geo-information in ethics within modern statistical institutions. Mirela Deva (Instat, Albania)

Languages and translations
English

Workshop on Ethics in Modern Statistical Organizations Geneva, 26 - 28 March 2024

THE ROLE OF GEOINFORMATION IN ETHICS WITHIN MODERN STATISTICAL INSTITUTIONS - ALBANIAN CASE

Mirela Deva Geoinformation Unit - INSTAT

Institute of Statistics

1

Institute of Statistics

2

Outline

▪ Principles of ethics and legal framework

▪ GIS at Statistics Albania

▪ Location-based data, fundamental for modernizing statistics

in Albania

▪ Geospatial data and confidentiality

▪ Future plans

Institute of Statistics

3

Ethics in INSTAT The national statistical legislation ensures the implementation of ethics aspects in terms of statistical principles:

Professional Independence

Impartiality

Objectivity

Reliability

Cost Effectiveness

Relevance

Accuracy

Transparency

Statistical Confidentiality

Institute of Statistics

4

Ethics in INSTAT

▪ The principles are in line with UN Fundamental Principles of Official Statistics and European Statistics Code of Practice

▪ Structures to ensure the implementation of ethics principles: − The Statistical Council − Confidentiality Committee on Confidentiality − Quality Committee

Institute of Statistics

5

Regulatory Acts

▪ Legal act on ethics on public administration

▪ INSTAT’s Code of Ethics - a tool to encourage discussions

about ethics and improve attitudes or reactions at work

▪ A dedicated structure for monitoring ethics within INSTAT

▪ INSTAT’s Internal Regulation

Institute of Statistics

6

GIS at Statistics Albania

Year 1 2 4 5 6 7

Map update tablets

Census Paper Maps

Digitizing / Geocoding

3

INSTAT Geoportal

Census geography completed

Map update Bld. and Dwll

8 2001 2009 2010 2011 2014 2019 2023 2024

Census fully geocoded

Census dissemination Improving geoportal

Institute of Statistics

7

2001 2011 2023

GIS at Statistics Albania

Institute of Statistics

8

GIS at Statistics Albania

Institute of Statistics

9

GIS in modernizing statistics

▪ Supporting processes for surveys and censuses

▪ Improving data accuracy

▪ Verifying and quality control

▪ Reducing errors and inaccuracies

▪ Analysis and visualization of statistics (printed and digital maps, web maps) potentially

increasing the understanding of information

▪ Monitoring and ensuring rapid interventions by finding quick solutions

▪ Establishing a statistical register of buildings and dwellings

Institute of Statistics

10

GIS in modernizing statistics

[1] The Global Statistical Geospatial Framework - Statistics Division, Department of Economic and Social Affairs, United Nations - https://unstats.un.org/unsd/statcom/51st-session/documents/The_GSGF-E.pdf

Institute of Statistics

11

Ethics in Geospatial Data

▪ Data ethics in geospatial statistics is a crucial consideration due to the sensitive nature of location-based information and its potential impact on individuals and communities

Key aspects of data ethics in geospatial statistics:

Informed Consent

Confidentiality & Privacy Protection

Data Quality and Accuracy

Legal and Regulatory Compliance

Openness and Transparency

Responsible Use

Institute of Statistics

12

INSTAT Geoportal and Ethics

INSTAT Geoportal since 2014:

▪ Innovation within the framework of increasing the role of

geostatistics

▪ Possible comparison of geographic distribution of

statistical data

▪ New approach to users

▪ Increasing data transparency and communication with

users

▪ Enrichment with regional indicators

Institute of Statistics

13

INSTAT Geoportal and Ethics INSTAT Geoportal since 2014 :

3 levels of presentation:

Prefectures

Municipalities

1 km² grid

Themes of Census 2011:

Population

Education and Employment

Housing and Living Conditions

General and Regional Statistics, since 2019

Institute of Statistics

14

INSTAT Geoportal and Ethics

Grid-based statistics towards the integration of statistical and geospatial information

Grid-based typology for Albania in 2014, a study on urban and rural population based on a method proposed by the EC at 1 km² grid, following INSPIRE Directive

Institute of Statistics

15

Future Plans

▪ Improving Geoportal following the international recommendations on regard of : − Confidentiality − Transparency − Public engagement − Data reusable − Enrichment with Census and socio-economic data

▪ To visualize grid population data at 1 km² with Census 2023 indicators (13 indicators), based on Commission Implementing Regulation (EU) 2018/1799

Institute of Statistics

16

Future Plans

▪ Implementation of ASRBD for statistical purposes which together with the statistical population register will serve as a key element to implement a register-based Population Census in the future

▪ Assessment of the existing national legislation and formulation of the proposed changes needed for the setup and functioning of the Register, including data protection and data exchange issues

▪ Transforming our geographical data according to NSDI in the Republic of Albania and data specification of INSPIRE, responsible for two themes; Population Distribution (PD) and Statistical Units (SU)

Institute of Statistics

17

Main Points to Focus

Ethical principles like data privacy, consent transparency, data collection and

continuous monitoring must be constantly applied

Responsible use of geospatial data is a fundamental pillar of ethical data use since

can serve as a de facto identifier of individuals

Users of spatial data must consider privacy and confidentiality implications

Enhancing trust in official statistics through transparent communication of

ethical practices

Institute of Statistics

18

Thank you for your attention!

Nexhmije Leçini [email protected] Ledjo Seferkolli [email protected] Mirela Deva [email protected]

Instat Geoportal: https://instatgis.gov.al

  • Slide 1: Workshop on Ethics in Modern Statistical Organizations Geneva, 26 - 28 March 2024 THE ROLE OF GEOINFORMATION IN ETHICS WITHIN MODERN STATISTICAL INSTITUTIONS - ALBANIAN CASE Mirela Deva Geoinformation Unit - INSTAT
  • Slide 2: Outline
  • Slide 3: Ethics in INSTAT
  • Slide 4
  • Slide 5: Regulatory Acts
  • Slide 6
  • Slide 7
  • Slide 8
  • Slide 9
  • Slide 10
  • Slide 11
  • Slide 12
  • Slide 13
  • Slide 14
  • Slide 15
  • Slide 16
  • Slide 17
  • Slide 18