Case Study - Developing an enterprise data warehouse and analytics capabilities

Client

LWF World Service is the global humanitarian arm of the Lutheran World Federation (LWF) and operates in 24 countries, delivering humanitarian aid and development programs across Africa, Asia, the Middle East, Europe, and Latin America.

Opportunity

LWF World Service sought to enhance its data management capabilities by creating a centralized enterprise data warehouse. The goal was to streamline data collection, improve analytics, and integrate digital systems for better decision-making and program effectiveness.

Approach

We partnered with LWF to deliver a comprehensive solution that addressed their data management and analytics needs. First, we developed a digitalization strategy by conducting an inventory of existing systems and tools, identifying gaps, and proposing opportunities for integration and automation to enhance data collection and reporting processes.

Next, we designed a detailed data flow framework to streamline how data is collected, integrated, stored, and reported, complemented by digital standard forms and guidelines to ensure consistency and usability across country programs. This included training staff in selected countries and establishing protocols for device management and responsible data handling in compliance with GDPR.

Lastly, we created advanced analytics and visualization capabilities by developing a unified dashboard using Apache Superset, introducing SurveyCTO for mobile data collection, and building a custom ETL process with Apache Airflow for real-time data processing. The integrated system connects tools like Newdea, SAGE, and Kobo Toolbox, enabling LWF to gain actionable insights and make informed decisions.

Outcomes

The project resulted in:

• A robust, centralized data management system with enhanced reporting and analytics.
• Seamless integration of field data with existing systems for improved program insights.
• A unified analytics dashboard enabling real-time decision-making across all country offices.
• Ongoing support for cloud hosting and bespoke systems to ensure scalability and sustainability.

This end-to-end solution empowers LWF World Service to manage data efficiently, driving impactful humanitarian and development efforts globally.

Technologies used