International Center for Tax and Development (ICTD)
Vanguard Economics supports governments and development partners generate and analyze data for research, impact assessments and monitoring, evaluation, and learning.
Vanguard Economics works with governments, universities, research institutions, and development partners in the design and delivery of quantitative research. Our team supports the design of survey instruments, sampling framework, and delivery of desk and field-based data collection.
Our clients include:
Vanguard Economics has provided market research services to global FMCG brands, regional manufacturers and food processors, global consultancy services, and investors in the services sector.
Vanguard Economics specializes in quantitative and qualitative data collection for development in East Africa.
How we can support you
Baseline and endline surveys for evaluations and impact evaluations
Business perception surveys including for taxpayers and investors
Smallholder farmer surveys and focus group discussions for value chain analysis
Impact modeling and assessments for development partners
Provides an overview of Monitoring Evaluation, and Learning (MEL) frameworks in the context of global development as well as in the private sector.
Monitoring, evaluation, and learning – also known as MEL – encompasses adaptable frameworks with processes, best practices, and tools that are strategically tailored for the uniqueness of organizations and sector-specific initiatives. Many government agencies, NGOs, and large multinational companies have in place robust and systemic MEL frameworks across their organizations and supply and values chains; others may use facets or components without calling it MEL explicitly.
At Vanguard Economics, MEL is one of our four stand-alone, yet integrative offerings that make up our continuously evolving Evidence For Transformation (E4T) service line. E4T also includes Data & Analytics, Knowledge Management, and Change Management, with each centering context-sensitive evidence and an array of systems and tools, to help organizations undertake rigorous analysis of efforts, make decisions, align outcomes to goals, improve programs, and drive change.
What is a MEL Framework?
It really depends. Organizations and aims differ, as do goals and initiatives. Therefore, MEL frameworks should be customizable to address specific needs and levels of complexity. Responsively, MEL is not a single process or system; rather, the toolkit we and other practitioners utilize is quite extensive. Predicting which tools are needed at the onset is nearly impossible, since a predetermined set of methods will not cover every case. At the core, MEL is a system or cycle with all three components, monitoring, evaluation, and learning, working in tandem and as a thread through all project and program phases – from early design through implementation and completion.
MEL helps organizations clarify intentions, collect crucial data to assess effectiveness toward impact goals, and monitor levers for change. Ideally, MEL processes should also include the realistic evaluation of capacity, internally and externally across the landscape, to respond and adapt with agility in real-time.
Here are the three components of MEL and the way they work ideally as a system.
The Importance of Monitoring
Regardless of entry point into a project or initiative, ongoing monitoring is crucial.
The first step in collaborating with organizations on MEL design and integration is helping organizations think through and answer a wide range of questions that can be revisited across the duration of an initiative to gauge progress and even readjust.
Evaluation Should be Ongoing
Once an organization establishes what it needs to monitor, the focus then shifts to designing processes for collecting data for evaluation.
Whether an organization wants to address forest sustainability, improve access to clean water, or empower more women-owned businesses, we customize and adapt a menu of evaluation techniques—from participatory to experimental designs—based on an organization’s budget, objectives, and time.
Learning is Key to Impact Longevity
We never collect data for the sake of it. We only collect data that we're going to use and center as part of a rich discussion.
This is learning.
For example, we might conduct a survey at the six-month mark for an NGO that is funding a development initiative aimed at reducing gender-based violence in Colombia.
We take the information we have collected to the team to provide a comprehensive picture. This would include foundationally:
How the project is progressing
Which activities have been completed and which remain unfinished, and
Whether outcomes expected at this stage have been met, and which, if any, are still unattained.
If a project is off track, or if goals have not yet been met, we help an organization consider whether this direction is still worth pursuing, or whether adjustments need to be made.
What Are The Measurable Benefits of MEL?
It is important to note that MEL is not about compliance (though certainly MEL can help clients design, monitor, and evaluate systems to help them attain compliance goals).
Rather, monitoring and evaluating the systemic data we collect enables organizations to continuously learn—this is what ultimately leads to progress and sustainable outcomes.
Benefits of MEL Integration
Enables stronger project design
Leads to better outcomes and more effective programs
Keeps programs on track to meet desired outcomes
Ensures money and resources are spent efficiently and effectively
Provides accurate data
Creates opportunities for adaptive project management throughout implementation
Gives beneficiaries and key stakeholders a voice
Improves motivation and focus of people implementing the program
Provides an overview of Monitoring Evaluation, and Learning (MEL) frameworks in the context of global development as well as in the private sector.
Monitoring, evaluation, and learning – also known as MEL – encompasses adaptable frameworks with processes, best practices, and tools that are strategically tailored for the uniqueness of organizations and sector-specific initiatives. Many government agencies, NGOs, and large multinational companies have in place robust and systemic MEL frameworks across their organizations and supply and values chains; others may use facets or components without calling it MEL explicitly.
At Vanguard Economics, MEL is one of our four stand-alone, yet integrative offerings that make up our continuously evolving Evidence For Transformation (E4T) service line. E4T also includes Data & Analytics, Knowledge Management, and Change Management, with each centering context-sensitive evidence and an array of systems and tools, to help organizations undertake rigorous analysis of efforts, make decisions, align outcomes to goals, improve programs, and drive change.
