Client
One of the largest QSR companies globally, generating over $40 billion in annual sales from more than 30,000 restaurants across 120 countries.
Business Challenge
- Fragmented datasets lacked real-time customer data for personalized campaigns.
- Ineffective use of insights for product innovation and engagement
- Customer history & support data needed consolidation for issue resolution
- Limited integration with delivery aggregators impacted speed insights
- Weak data foundation blocked advanced
Business Objective
Client aimed to enable analytics for omni-channel sales and marketing:
- Planned to migrate and integrate data from various source systems including 3P vendors, customer data platforms, and POS systems
- Sought to accelerate analytics-centric innovation in customer, store, and product initiatives
- Customer history & support data needed consolidation for issue resolution
- Targeted strategic initiatives to develop "ground-up" analytics capabilities
- Focused on enhancing business growth, operational efficiency, and customer satisfaction and retention.
Approach
- Built a secure AWS data lake using Glue, employing a serverless and event-driven architecture.
- Integrated multiple data sources including POS, ERP, demographics, and API Gateway for comprehensive data ingestion.
- Established secure S3 data drop zones, utilizing Glue Crawlers for effective cataloging and partitioning of data.
- Implemented PII (Personally Identifiable Information) data zones to ensure secure handling and ETL (Extract, Transform, Load) processes.
- Enabled near-real-time analytics for insights into customers, stores, and products to support business intelligence.
- Monitored CI/CD pipelines using CloudWatch and Checkmk, triggering alerts for operational issues and ensuring system reliability.
- Managed operations with Confluence-based runbooks to facilitate monitoring and troubleshooting processes effectively.
- Employed Agile methodology for development, testing, and deployment, with progress tracked in ServiceNow to ensure transparency and collaboration.
Technology Components
- AWS Services: Glue, Lambda, S3, Redshift, Snowflake, CloudWatch
- Monitoring: CloudWatch, Checkmk
- Data Integration: API Gateway, Glue Crawlers
- ETL: AWS Glue, Pyspark
- Project Management: Confluence, ServiceNow, Agile methodology
Transformational Effects
- Achieved over 30% cost savings by switching to Reserved Instances for EC2 and EMR servers.
- Saved $100K+ in license costs by migrating workloads from Cloud ETL to AWS Glue and Informatica.
- Reduced issue resolution time by 20% through automated monitoring of Glue workloads
- 10+ unique data products (Customer 360, Store 360, etc.) providing valuable insights for improving customer loyalty, engagement, and retention
