Project Design, Monitoring and Evaluation
Donors are placing more emphasis on aid effectiveness and accountability, and the pressure on evaluation units in governments and multilateral agencies to manage and undertake independent and rigorous evaluations has increased. Formative evaluations are being carried out more frequently for large projects and strategies, as a means of assessing whether interventions are on track to achieve their stated outcomes and objectives. There is an increasing trend for evaluations to be carried out jointly, either between multiple donor agencies and/or with the developing country partner government. ECI expects this to increase in response to the Paris Declaration and the commitment to harmonizing and aligning donor processes.
A key challenge for many development organizations is to improve the quality of project/programme design, monitoring and assessment of impact. Decision making is in its very core a cognitive process; for both (government) institutions and communities, based on technical criteria as well as socio-economic scope and its implications. Any decision making process in the project design has several steps (phases), but should always flow from a thorough analysis of the given situation to a strong understanding of options and alternatives, and a reliable prediction of the most appropriate project design. It’s more often than not an exercise of weighing costs and benefits and choosing the optimal outcome.
With our experience in the fields of analysis, policy formulation and evaluation and advice, ECI experts are the ideal partners to help you with your decision making needs. We have extensive experience with interim management and organizational support assignment.
Impact assessment is making strong headway in both the policy cycle and strategic decisions in development. The main aim of ex-ante impact assessment (or ‘impact analysis’) is to map out the expected effects of intended strategies and policies. It’s all about getting to grips with your starting ground and calculating what future policy choices may bring.
For all sectors listed in the expertise section
• Social Development and Social Protection
• Rural Development, Natural Resources and Climate Change
• Food Security
• Pubic Administration and Governance / Institutional Development
• Development Policy and Cooperation, delivering effective aid and interlinking policy sectors
• Triangular cooperation
Qualitative and quantitative research
At ECI, we believe sound qualitative research is a vital component in decision-oriented analysis and research for policymaking. It is especially useful in developing hypotheses about stakeholders’ motivations and in helping us adapt and understand a development topic from the beneficiary’s perspective and in their own language.
Qualitative research (which is characterised by free-ranging, open-ended interviews among a limited number of respondents) is primarily an exploratory and/or motivational technique. It is used to identify important variables, and to suggest the relationships among these variables so that quantitative techniques can be used.
ECI emphasises non-directive and projective interviewing techniques in our qualitative investigations because we believe these methods produce the most inclusive and unbiased results.
ECI has extensive experience in the design, implementation, analysis and dissemination of quantitative surveys. Our work includes supporting and strengthening existing surveys carried out routinely by statistics offices. ECI has experience working with national household budget surveys measuring income and expenditure poverty, social indicators and rural sector statistics, in which we emphasize the development and strengthening of institutional capacity.
ECI’s experience in implementing big scale surveys
(all stages: survey design, sampling, questionnaire, fieldwork, analysis)
|2016||End-line assessment Food for Progress USDA and Counterpart International Guatemala: 800 interviews (farmers and producers organizations survey)|
|2015||End-line and impact assessment PROCOMIDA USAID Guatemala on food security and service delivery, 1,800 households (combined LSMS and nutrition survey).|
|2014||EMMA Survey WFP Bolivia: 90 interviews (market performance supply and demand assessment surveys) carried out in 11 markets (Riberalta and San Borja).|
|2013||EMMA Survey (Mapping and Analysing Food Markets in emergency situations) in Malawi: WFP mapped 86 markets, 600 interviews (market performance supply and demand assessment survey)|
|2013||End-line survey for impact measurement of WFP food and cash distribution during an emergency period in Malawi 2012/13 (Food security and nutrition survey): WFP, 400 beneficiary households, 400 households control groups, (including exercise propensity score matching).|
|2012||Sample design and technical advice for a panel survey in Mongolia for measuring the impact of climate change on small herders (LSMS panel survey - 5 waves), DIW Berlin: 800 beneficiary households and 800 households in control group, 4 out of 5 panel waves implemented to the date.|
|2011||ACH/CALP learning initiative, Bolivia Cash (voucher) for fresh food distribution (cash transfer/voucher performance and nutritional impact survey).|
|2008||Second Human Development Survey (LSMS survey) - UNDP Paraguay: 2,500 households.|
|2006||First Human Development Survey (LSMS survey) - UNDP Paraguay: 2,500 households.|
|2005||Survey on skills and knowledge of civil servants (human resource survey) - JICA, Paraguay: 700 interviews.|
|2004||Survey on civil servant perception of institutional accountability (opinion survey), Transparency Paraguay: 1,300 interviews.|
|2003||IADB Paraguay – baseline survey (LSMS survey) for SCTP pilot: 1,500 households.|
|2001||Survey on quality of local government services (service provision survey) - World Bank, Paraguay: 66 municipalities - 800 interviews.|