Q&A: Measuring the Effectiveness of Chinese Agricultural Assistance in Africa

 In analysis, op-ed, Q&A

China has a long history of involvement in agriculture in Africa. As far back as 1959, China offered food grants to Guinea, and especially since the 2007 introduction of China’s “Agriculture Going Out” initiatives – a set of policies that encouraged Chinese agricultural companies to invest in Africa – Chinese agricultural engagement on the continent has grown significantly.

Today, with so many Chinese-funded agricultural aid and development programs now underway across the continent, effective monitoring and evaluation is critical to determine if these initiatives are actually achieving their stated objectives.

For some perspective on how these programs are evaluated, I spoke with Professor Xu Xiuli, Dean of the College of International Development and Global Agriculture (CIDGA) at China Agricultural University (CAU) in Beijing. Professor Xu is one of China’s foremost experts in overseas agriculture assistance, with more than a decade of experience in international development and China-Africa agricultural issues.

PETER GRINSTED: To what extent do China and its partners in Africa perform evaluation and monitoring programs on agriculture development initiatives in Africa? How is this undertaken? Which metrics and indicators?

PROFESSOR XU: Before answering this question, we should be aware that “development initiatives” in the Chinese context includes aid, investment, trade, and other development-oriented activities. If we simply focus on aid, it’s important to note that different Chinese agriculture programs have different evaluation practices, and there is not yet one centralized system. The newly established China International Development Cooperation Agency (CIDCA), previously the Ministry of Commerce (MOFCOM) and other related agencies, build the develop an evaluation framework, basically enlightened from both multilateral and bilateral development organizations such as the World Bank, UNDP, and Development Assistance Committee (DAC), but also pay attention to the local experiences and complicated realities.

For example, for Agriculture Technology Demonstration Centers (ATDCs), of which there are now over 20 across the African continent, the Ministry of Commerce (MOFCOM) and Ministry of Agriculture manage and implement the evaluation. Official teams and project supervisors are usually sent to the field to ask questions, checking whether the projects match their objectives and also check on financial management. The evaluation criteria used are usually developed with some inspiration from other international development evaluation systems. They have indicators regarding sustainability, relevance, and effectiveness, etc.  The same is true for other categories of Chinese agri-aid in Africa, such as China-FAO South-South and Triangular Cooperation, which has an international independent evaluation system as well as a regular monitoring system.

For locally initiated agri-aid projects launched by entities like universities, research centres or even individual professors, there are different practices, but they are aware of the above criteria to a different degree subject to their knowledge of this established framework. At the China Agriculture University, for example, with programmes like the China-Tanzania Joint Agricultural Research Program, participatory monitoring and evaluation is facilitated. Progress reports, annual working group discussions, on-site coaching, as well as independent mid-term evaluations using indicators of relevance, effectiveness and sustainability are mixed to help to ensure the project progresses.

One feature to highlight is that Chinese evaluation systems place greater priority on mutual learning among key stakeholders, rather than simply accountability to others in the international development system. In fact, I think this is also one of the features of South-South Cooperation, and it encourages learning by doing. Such learnings don’t just happen on the China side but also on the African side. And so, for instance, in the China-Tanzania Joint Agricultural Research Program, during the process, both sides will identify problems during the interaction process, allowing both to get feedback quickly. For instance, we have invited professors from local universities, like the Sokoine University of Agriculture, to help get even more feedback from the grassroots level. One feature of this prioritization is that the evaluation results are used by all key stakeholders involved for reflection and dynamic change.

PETER: What steps could be taken to improve the ability of all stakeholders involved to evaluate the performance of China-Africa agriculture initiatives?

PROFESSOR XU: This is a really important question. Many teams in China and other southern countries are making efforts to explore the topic, i.e., how to evaluate the south-south cooperation considering its diverse modalities as well as varied culture and institutions in different countries. The fact is the existing systems of evaluation developed by DAC donors and even some of the multilateral institutions don’t always fit very well. There are many adaptations or different situations arising from the initial design in real development practices, and the traditional evaluation system seems to struggle to capture the dynamics and guide the project to adapt effectively.

In the design of DAC development project process, a rigid logical framework (logframe) is normally taken as a good instrument for identifying the rational logics among goals, objectives and activities in a certain context. This is something we lecture to students in class, and it works in some ways for helping different stakeholders to clarify the overall goal and different steps to implement it. Very clear and logical. Yet, in the field, with a rigid logframe, it’s hard to guide actions in the complex realities at the grassroot level in developing countries. The reality in the field doesn’t follow the rational logic on paper. When the evaluation result tells the facts in the field and feedback to the decision makers, the established development routines still finds it hard to adjust quickly and easily in many cases.

On the other side, as for South-South Cooperation (SSC) projects, normally there is not such a rigid framework at the early beginning, particularly in practice. The logic of the SSC is different in nature as many projects are initiated and developed based on the demand of partners, rather than on the providers’ design. There is not a very clear blueprint at the early beginning. But rather the partners initiate a certain kind of activity, test it and see what happens, and then mutually adapt during the process. The whole process doesn’t necessarily involve a very specific focus on changes in certain indicators. It does, however, give the space to both sides, allowing them to mutually adjust the process as a project is progressing. I see the process more like a dance with mutual innovation, rather than following an already made recipe for complicated development challenges in the field. This entails a new paradigm on knowledge generation and experiences sharing, i.e., learning from the field, giving spaces to local stakeholders in the practices, and adjusting the design accordingly based on local complicated facts in practice. This may involve a more complicated learning and managing process.

That said, I don’t think SSC gets everything right. But it gives us an opportunity to look at development cooperation projects in a different way. And I think the task now is how to create clear evaluation systems that emphasize mutual learning – I don’t think the international development sector has found an easy answer yet, we need to all keep working on it together with open-minds.

PETER: This is a really interesting point and needs to be worked on. But measuring impact is important. What can be done about this?

PROFESSOR XU: Well, we do try to encourage measuring impact. For instance, together with my colleagues at CAU, we have found very strong evidence of the outputs, outcomes and impacts of Chinese aid for agriculture in Africa. For example, in one case, at an ATDC, the adoption of Chinese planting technology led to an impressive tripling of average annual rice yields per hectare. This is an impressive output. It additionally consolidates impacts on local households’ hope for food security, drivers for market development, as well as pursue gender equality. There are many more examples of the real impact of development projects after accessing internal data from implementing organizations and asking different stakeholders questions to collect the necessary data.

So the examples are there, and we plan to continue evaluating impacts like this going forwards.

Key Takeaways From the Discussion With Professor Xu About Monitoring & Evaluation of Chinese Agricultural Programs in Africa:

    1. The Chinese approach, attaching greater importance to adaptive learning and mutual reference and reflection, is really important to incorporate in evaluation systems and is important for the international development community to reflect on. Tools we particularly like to use at Development Reimagined when we do independent evaluations are “Theories of Change” and “design thinking”, which help to deal with complexity. There may also be means to adjust the sophistication of projects and evaluations as time goes on and projects mature, with stakeholders involved gaining a deeper understanding of each other. But more can be done.
    2. Professor Xu referred to local African involvement in the Chinese evaluations – which is excellent practice and can be built on, especially with more systematic impact evaluations, with the emphasis on transparency and accountability to recipients (rather than other donors). Indeed, having more diverse teams and anonymous and rigorous means of feedback (with, for example, randomised control groups) could really add to the existing approaches.

Agriculture around the world suffers from uncertainty and market failure, in weather, yield, prices, and factor markets. It is excellent that the CAU as well as other Chinese organisations are trying to explore innovative ways to interact with African partners to facilitate sustainable agricultural development. There are no easy answers to making it work, especially in very poor settings. That’s why getting evaluation itself right is so crucial – and learning from different perspectives and experiences in practice and in the field is essential.

Author: Peter Grinsted, Senior Economist, and Jinyu Chen, Research Analyst at Development Reimagined.

This article was originally published on the China-Africa Project website on July 31st 2020

Recommended Posts

Leave a Comment

Contact Us

We're not around right now. But you can send us an email and we'll get back to you, asap.

Not readable? Change text. captcha txt

EDMOND BOSILONG

Research Analyst

Edmond is a research analyst who is passionate about sustainable development, innovation, and the environment. Passionate about climate financing, he firmly believe there is a more reliable system to promote equality, growth, and welfare in societies without affecting the ecosystem. Through his skills, knowledge and experienced gained over 7 years, he wants to make an impact in the world of development. Edmond holds a Master’s Degree in Public Policy from Korea Development Institute and a BA Degree (Honors) in Business from University of Derby.

   HANNAH RYDER

    Founder and CEO

Hannah Ryder is the Founder & CEO of Development Reimagined. A former diplomat and economist with 20 years of experience, named one of 100 most influential Africans in 2021, she is also Senior Associate for the Africa Program of the Center for Strategic International Studies (CSIS), sits on the Board of the Environmental Defence Fund, and is a member of UAE's International Advisory Council on the New Economy. Prior to her role at DR, Ms Ryder led the United Nations Development Programme (UNDP)’s work with China to help it scale up and improve its cooperation with other developing countries, including in Africa. She has also played various advisory roles for the UN and OECD and co-authored the seminal Stern Review of the Economics of Climate Change in 2006.

LEAH LYNCH

Deputy Director

Leah Lynch is Deputy Director of Development Reimagined (DR), and head of the China office. Leah has over 10 years of experience in development and has lived in China for over 8 years. Leah has also travelled extensively around Asia and Africa for research. Leah supports the strategic direction of the team across China, with a mission to deliver high quality research on sustainable development and poverty reduction. Leah is also Chair of the Sustainability Forum at the British Chamber of Commerce in China, providing direction on sustainability initiatives for British and Chinese business. Leah has also consulted on various evaluations on UK aid (ICAI) and is a specialist on development cooperation from the UK and China. Leah has also consulted on various UN projects, including providing support to the UN China team during the COVID-19 Pandemic. Prior to DR, Leah was at the United Nations Development Programme (UNDP) China, supporting the UN’s portfolio on communication strategies, China’s South- South Cooperation and the Belt and Road Initiative (BRI). Before UNDP, Leah lived and worked in Kenya developing sustainable water policies for the Kenyan government.

YIKE FU

China-Africa Policy Analyst

Yike Fu is a Policy Analyst and has been responsible for leading numerous areas of work, including on debt analysis in Africa and beyond, and China-Africa trade and investment logistics and analysis. She is the co-author of “African Debt Guide”, in which she challenged the narrative that Africa is in the midst of a new debt crisis by analysing data back to the 1970s and adopting new metrics to present the real story behind the data. She also developed a benchmark to compare the financial distribution of development partners such as the UK, US, Japan, France and China in Africa. Prior to her role at DR she worked at the International Finance Corporation and African Union Representational Mission to the US. She holds a Masters in International Affairs from George Washington University.

JUDITH MWAI

Research Analyst

Judith is a Research and Policy Analyst, where she specialises in Africa-China relations, international development, and diplomacy. During her time at Development Reimagined, Judith has co-authored several articles published in The Diplomat on debt and China-Barbados relations and was quoted by China Daily in a piece on Women Rights in China. Previously, Judith worked as a research analyst for an Advocate and Commissioner and Oats office in Kenya.

OVIGWE EGUEGU

Policy Analyst

Ovigwe specialises in geopolitics with particular reference to Africa in a changing Global Order. He is adept at critically analysing the politics of contemporary development processes and providing insight into the geopolitical interests that influence them. His work includes research, publications, tailored briefings and advising on global and regional trends, and issues at the nexus of geopolitics and development. Ovigwe appears frequently in media around the world such as Al Jazeera, TRT World, SABC, CGTN, BBC Radio, and other platforms.

JING CAI

Policy Analyst

Jing leads China-African health and agriculture cooperation research at Development Reimagined, having managed our FOCAC Policy Analysis and Advocacy project. She is also the co-author of “China-Africa Health Cooperation under FOCAC Umbrella”, in which she analysed China’s commitments around health cooperation since the first FOCAC summit and deepdived into four African countries’ health overview, challenges and cooperation with China as cases studies. Before DR, Jing worked at GIZ Cambodia on M&E of a disability advocacy project. She also worked as a translator with Chinese medical team in Benin.

PATRICK ANAM

Trade Policy Analyst

Patrick is an International Trade Policy and Trade Law Expert with over 5 years of experience. His expertise includes trade law, trade policy analysis and regional integration. He is currently engaged with Development Reimagined as a Senior Trade Analyst and was the lead author of Development Reimagined's recent Report on Africa-China Relations titled "From China-Africa to Africa- China: A Blue Print for a Green and Inclusive Continent-Wide Strategy Towards China." and “Reimaging FOCAC Going Forward.” Patrick has previously consulted for the East African Community, UNECA and for the Kenya Ministry of Trade.

ROSIE FLOWERS

Senior Policy Analyst 

Rosemary is our Senior Policy Analyst. She is a skilled policy analyst and has previously worked as a UK civil servant. She is studying Human Rights at Birkbeck, University of London with a research focus on international law in the context of health crises such as the COVID-19 pandemic.

JADE SCARFE

Project Manager and Africa-China Communication Assistant

Jade is a Project Manager for Development Reimagined’s flagship project Africa Unconstrained, which focuses on financing needs and debt vulnerabilities of African countries. Her research focuses on China-Africa development finance alongside debt vulnerabilities, infrastructure needs and South-South cooperation. She has worked with a breadth of stakeholders from China, Africa and the wider international community, including governments, private sector, NGOs and civil society. Her writing has appeared in a number of publications, including The Africa Report, The China-Africa Project, The Diplomat and more. Jade holds a Master’s in China and Globalisation studies from King’s College London.

ROSIE WIGMORE

Programme Manager

Rosie is the Project Manager of Africa Reimagined (AR) at Development Reimagined (DR) where she supports high-end African brands with entering the Chinese market by operating services such as trademark protection, Chinese market research, Chinese partnership building, and Africa to China logistical support and import/export services. Rosie has worked with DR for over two years now with proven success in helping high-end African brands navigate the Chinese market. She is extremely passionate about her work because more African brands selling in the Chinese marketplace means African countries can export MORE value-added goods, create MORE jobs and foster MORE innovation in African countries.

Rosie is also alumni of the School of International Studies at Peking University in Beijing where she is also an editor at the Peking Africa Think Tank. PATT is led by a diverse group of scholars who specialise in African Studies within the context of Sino-Africa relations.

LAUREN ASHMORE

Consultant

Lauren has lived in six countries from the Americas to Europe and Asia and speaks both French and Spanish proficiently. At Development Reimagined, Lauren’s research focuses on climate action both in the Asia-Pacific and in Africa, and how countries are using tools such as SDGs and Covid-19 action to build a more climate-resilient future. She holds a Masters in International Relations from Leiden University.

ETSEHIWOT KEBRET

Consultant

Etsehiwot holds a Masters’s degree in Development Studies from the London School of Economics. She has diverse experience in humanitarian and development issues by working in both multilateral organizations and international non-governmental organizations. Etsehiwot is currently a consultant focusing on the SDGs and development finance.

DIBEKULU MULU

Economist Consultant

Dibekulu is an economist by training. He holds an MSc in International Development Studies from Palacky University Olomouc, an MSc in Development Economics from the University of Clermont Auvergne, and an MSc in Economics, Finance, and International Integration from the University of Pavia. At Development Reimagined, he works as an Economist consultant. He has strong data analysis skills, with research interests centring around development finance, impact assessment, food security, and agricultural insurance.

OSARU OMOSIGHO

Project Manager

Osaru is a health professional with an MSc in Health Systems Policy and an interest in women’s health and population management. At Development Reimagined, she applies her health sector experience to global health research and collating locally applicable development insights from China.

PIER FERDINANDO CINOTTO

Research Analyst

Ferdinando’s research at Development Reimagined is centred on South-South Cooperation dynamics, specifically on the analysis of Chinese investment and debt flows in Africa and their linkages to African industrialisation. He is currently a Yenching Scholar at Peking University, after having graduated from the University of Cambridge with an MPhil in Development Studies.

DAVID TINASHE NYAGWETA

Research Analyst

David is a Research and data analyst at Development Reimagined. His scholarly focus is mostly on interdisciplinary research in demographic economics and development with interests in migration, economic development and policy, education, health and subjective well-being. He is currently a PhD scholar at Nelson Mandela University from which he also holds B.com Economics and Statistics and M.com respectively.

IVORY KAIRO

Research Analyst Kenya

Ivory is a Kenyan lawyer with experience in policy research and analysis. She also supports the communications team at DR. Ivory speaks English, Swahili and French.

JOY ENE

Research And Data Analyst China 

Joy Ene is a Research and Data Analyst at DR. Joy is passionate about African/global development, poverty eradication and trade policies between underdeveloped and developing countries. She is also a fourth-year student of International Economics and Trade at the  Liaoning University, Shenyang, China. She serves as the President of the Student Union, Liaoning University, International Students chapter.

CHENSI LI

Research Analyst 

Chensi Li is a research analyst. She has previously worked for local NGOs in Nigeria and Cameroon and think-tanks in China.  Her research areas include Sino-African relations, African foreign affairs, public diplomacy, state-building and national governance.

Yixin Yu

Research Analyst 

Yixin is a Junior Research Analyst and her focus areas is on public-private partnership and entrepreneurship. She has over three years of working experience in both private and public sectors in Ethiopia. She was the China Liaison Officer for project ‘Partnership for Investment and Growth in Africa’ at International Trade Centre, where she accumulated rich experience in investment and trade promotion

HANNAH RYDER

Founder and CEO

Hannah Ryder is the Founder & CEO of Development Reimagined. A former diplomat and economist with 20 years of experience, named one of 100 most influential Africans in 2021, she is also Senior Associate for the Africa Program of the Center for Strategic International Studies (CSIS), sits on the Board of the Environmental Defence Fund, and is a member of UAE's International Advisory Council on the New Economy. Prior to her role at DR, Ms Ryder led the United Nations Development Programme (UNDP)’s work with China to help it scale up and improve its cooperation with other developing countries, including in Africa. She has also played various advisory roles for the UN and OECD and co-authored the seminal Stern Review of the Economics of Climate Change in 2006.