Amway

Amway is the world’s largest direct selling company ($8.8B reported sales, 2018). They manufacture and distribute nutrition, beauty, personal care and home products—which are exclusively sold in 100 countries through Amway Independent Business Owners (IBOs).

Challenge

  • Data cannot be recent than a day and is a batch process
  • Amway Business Owners (ABO’s) rely on Corporate rather than self-service to provide reporting and analytics
  • Decommision Oracle Exadata

Solution Delivered to Meet Challenges

  • Consolidate ~20 Terabytes of data for analytics from all regions into one platform for global use
  • Implement a cloud-based data lake, enterprise data warehouse and data pipeline process
  • Bulk ingestion of a large ~20 Terabytes of data from different databases and streaming sources to AWS RDS and S3
  • Real-time change data capture (CDC) for all sources
  • Ingested data must be validated and reconciled with source
  • Transform ingested data as per defined business rules
  • Enable data scientists to perform analytics on transformed data
  • Secure data at Rest and in Transit
  • System health monitoring

Architecture Diagram

Amway – AWS Database Migration

AWS Services Used

  • AWS Aurora Postgres
  • AWS Redshift
  • AWS Simple Storage Service (S3)
  • AWS EC2
  • AWS Step Functions
  • AWS Lambda
  • AWS Kinesis
  • AWS Kinesis Firehose
  • AWS CloudWatch
  • AWS CodePipeline
  • AWS CodeBuild
  • AWS CloudFormation
  • AWS X-Ray

Database Workload Migration Details

  • Source DB: 2 On-Prem Oracle
  • Target DB: 1 AWS Aurora PostgreSQL
  • Number of Tables Migrated: 300+
  • Size of migrated data: ~10TB
  • Sources and Targets:
    • Custom Business events -> Kafka -> Kinesis -> Aurora
    • Custom Business events -> Kafka -> Kinesis -> S3
    • 1000’s of events per second

Migration Patterns Used

N/A

Migration Tools Used

  • Sqoop on EMR (Data Ingestion)
  • Spark on EMR (Data Validation & Standardization)

Third-Party Tools Used

  • Tibco DV
  • Grafana

About NorthBay

We are a fast-growing, 100% AWS focused onshore/offshore AWS Premier Consulting Partner, supporting our customers to accelerate the reinvention of their applications and data for a Cloud-native world. Our >350 AWS Certified Employees excel in developing and deploying Database & Application Migrations, Data Lakes and Analytics, Machine Learning/AI, DevOps and Application and Data Modernization/Development that drive measurable business impact.