Fanmio: Distributed Load Testing

Meet Our Customer

Fanmio’s primary mission is to bring the best entertainment to fans worldwide. Fanmio aims to transcend the boundaries of traditional entertainment, offering exclusive access to groundbreaking events and unforgettable experiences. Fanmio is dedicated to creating moments that not only entertain but also connect and inspire.

The Challenge

Fanmio, a media and online video entertainment streaming company, faces significant challenges related to infrastructure scalability. As their user base grows, the demand for bandwidth and server capacity increases, requiring ongoing upgrades to ensure a smooth streaming experience. Sudden surges in viewership during peak times, anticipated events, or popular releases further emphasize the need for agile infrastructure scaling strategies. Without robust measures in place, Fanmio risks encountering buffering issues, downtime, and user dissatisfaction, which could undermine its competitiveness.

Cost is another critical concern for Fanmio. Establishing and maintaining a resilient infrastructure capable of supporting millions of concurrent users requires substantial financial investment. Additionally, unforeseen costs from security breaches or system failures can further strain Fanmio's financial resources. Achieving cost-efficiency while maintaining service quality remains an ongoing challenge for Fanmio.

Download this case study in PDF format

Discovery / Implication

The collaboration between Fanmio and NorthBay began with a Discovery Phase. NorthBay acquired a comprehensive understanding of the Fanmio platform This included an in-depth look at the tools and technologies Fanmio utilized for hosting and maintaining their business applications, as well as a thorough examination of the application's features. The insights garnered during this phase were instrumental in formulating benchmarking scenarios aimed at testing the scalability of the Fanmio Application and determining optimal service limits for enhancement. Additionally, this phase facilitated the establishment of both the Test Automation Team and AWS Solution Team, each endowed with bespoke skills and expertise tailored to address the specific requirements of Fanmio.

Solution

To address the challenges of infrastructure scalability and reliability, NorthBay conducted comprehensive load testing ahead of the PPV streaming event. This process involved simulating the traffic levels expected during the event, allowing Fanmio to identify bottlenecks and weaknesses in its infrastructure before the high-demand period. Through load testing, Fanmio determined the optimal configuration for servers, network bandwidth, and content delivery systems to ensure smooth streaming experiences for approximately 2 million anticipated viewers.

The use of AWS cloud services load testing tools such as Redline13 and JMeter scripts for performance testing, simulating user journeys to test scalability and responsiveness, proved invaluable. These tests helped Fanmio map resource usage and identify areas for optimization. CloudWatch was used to capture the number of invocations during performance testing, with boto scripts gathering data on invocation patterns. This data was crucial for optimizing the infrastructure and maintaining consistent performance during high-demand periods.

NorthBay established industry-standard protocols to ensure smooth benchmarking and testing, including:

Cost Optimization: Regular evaluations were conducted to assess and optimize expenses associated with services. Updates regarding the costs linked to benchmarking and testing scenarios were provided to Fanmio.

Performance Metrics: Detailed reports using various metrics from monitoring and logging tools offered insights into cost optimization strategies.

Cost Calculator: A cost calculator was designed to forecast platform costs based on the number of users, aiding budget planning and resource utilization.

Security and Compliance: Regular updates of cloud services ensured security and compliance with industry standards.

AWS Services

    Additional tools are used for testing and scripting:

    • Redline13
    • JMeter
    • Python
      • Boto3

    Benefits

    Through comprehensive benchmarking, NorthBay systematically augmented the thresholds of AWS Services used within the Fanmio environment, ensuring it could handle anticipated workloads and minimizing failure, throttling, or disruption.

    Benchmarking outcomes were used to guide strategic scalability of resources, allowing for flexible adjustment according to load demands.

    NorthBay's technical support minimized operational challenges and ensured prompt assistance to Fanmio.

    This collaborative effort allowed Fanmio to focus entirely on executing the streaming event and optimizing user experience without concern for service scalability and limitations.

    About NorthBay

    Northbay is a fast-growing, 100% AWS focused onshore/offshore AWS Premier Consulting Partner, supporting our customers to accelerate the reinvention of their applications and data for a cloud native world. Our >350 AWS certified employees excel in developing and deploying database & application migrations, data lakes and analytics, ML/AI, GenAI, DevOps and application and data modernization/development that drive measurable business impact.

    We hold the following competencies, specializations and programs of AWS:

    • Generative AI and Machine Learning

    • Data & Analytics
    • DevOps
    • Mobile
    • Education
    • Migration Competency
    • MSP Partner
    • Public Sector Partner
    • Database Ready
    • Database Freedom
    • Solution Provider Partner
    • Well Architected