Research and Knowledge Management
Research and Knowledge Management
1. Program Monitoring and Evaluation
hether performing an insightful, earlystage evaluation or a data-rich, long-term evaluation, Acumen Research applies highly rigorous methodologies to help clients determine how a program measures up and find methods by which clients can improve programs. We develop and implement flexible, mixed-method approaches that blend qualitative and quantitative methods to conduct program assessments—determining not just whether a program works, but how it works, why it works, and where it can work best—and create a study with long-term value for our clients.
Through demand-driven, rigorous evaluations and robust monitoring systems, our work supports adaptive management and learning, enabling the use of evaluation evidence in decision making to improve the execution and successful dlivery of results. Our monitoring and evaluation professionals have deep practical experience in designing and implementing quantitative and qualitative evaluations that rely on a mix of methods to support generation of evidence-based findings. We have experience in delivering site-specific and complex multi-partner programme and portfolio level evaluation and learning assignments across a wide range of sectors. These include livelihoods and resilience, climate change and sustainable land use, governance and democracy, civil society, gender and human rights, peace and security and economic growth (trade and private sector development).
At Acumen Research, our tailored, unique program evaluations use a combination of traditional and state-of-the-art analytic methods and tools, including:
- Evaluability assessments
- Implementation evaluation
- Logic models
- Program content reviews
- Randomized control trials
- Propensity score matching
- Quantitative analysis of designs
- Synthesis of mixed-method research
- Case studies
- Ethnographic studies
- Social network analysis
- Secondary data research
T hird-Party Monitoring has become an essential monitoring and evaluation tool for many agencies working in hard-to-accessareas. Our independent monitoring and verification services help give our partners confidence that reported results are reliable, ensuring that programmes are achieving the expected outcomes and delivering for end users. Our systems-based approach to data quality helps build stronger partner and in-country monitoring systems and reduces duplicative and extractive third-party data collection.
In fragile environments, Acumen Research can provide a meaningful contribution to the broader monitoring and evaluation toolbox, as well as increase accountability of donor spending, by offering; a mixed methods approach based on Key Informant Interviews (KIIs), household surveys (HHS), Focus Group Discussions (FGDs), direct observation, and social media analysis, high-quality training to enumerators in the field, and research quality assurance. We always provide TPM services in collaboration with a network of local experts, including enumerators, data entry staff and analysts. By effectively measuring performance, our TPM services contribute to new project designs, sector and country portfolio strategies, and to broader strategic revisions that contribute to maximizing development effectiveness and improved delivery of services for beneficiaries.
Our TPM work enables our clients to understand what works and what doesn’t, in near real time, prompting adaptive programming, continuous improvements, and better results overall. Our monitoring work captures the information related to programme achievement to date, challenges, opportunities, risks, and future strategy development. For donor agencies, we also offer the option of verifying monitoring information from your implementing partners. For humanitarian, stabilization and development management programming, we can also provide baseline research and a source of primary field data to inform programming and help verify partner reporting.
S urveys are powerful tools to develop a better understanding of the target audience and stakeholders. With a rigorously designed and implemented survey, firms, government agencies, and non-profits can harness invaluable information to help inform their strategic, financial, and operational decision making. However, if design and implementation aren’t optimal, survey research can lead to ill-informed decision making based on unreliable and invalid information, and with serious consequences for operations, performance, and competitive advantage.
Our survey development team will provide you with a customized approach based on your research goals, sampling frame, intended output, and, of course, timeline. We’ll develop a solution specific to your organization, your survey research needs, and your sector to provide statistical consulting and analysis support for the entire survey research process. Whether you need assistance with specifying the initial survey, developing the sampling plan, conducting psychometric tests for reliability, validity, and power, or analyzing the collected data—or each of these steps—we’ll develop a plan to meet your specific needs.
T he digital world has opened up new and exciting possibilities for collating, analyzing and visualizing data. At Acumen Research, we know how to apply innovative technologies to complement other methodologies and better inform decision-making. Applying digital technologies allows us to deepen our understanding of the impact of policy and programmes on people, society and the environment.
When done well, data visualization can be an effective tool in helping us identify patterns, generate insights and tell the story behind data. Interactive dashboards can take these concepts a step further. Our in-house capabilities allow us to tailor visualizations to the diverse needs and preferences of our partners, utilizing infographics, animations, maps and a wide range of charts. We develop bespoke dashboards that allow partners to intuitively explore complex data sets or share their impact with others in an accessible way.
Our digital services range from remote data collection (e.g. mobile phone surveys) to make the most of existing data (e.g. demographics, social media, satellite imagery) or applying advanced analytical techniques (e.g., modeling impact, sentiment analysis). Digital also includes the enhanced visualization of findings, using technology to support user interactions with a dataset and dashboards for performance management. In all our work, we are careful to consider the implications and limitations of technology, including the ethical implications, and those voices that are excluded or marginalized by the digital world.