Comcast Technology Solutions Logo
Issue 2 | July, 2024

Video Harold

A Newsletter from CVP & AdFusion Engineering

RESILIENCY

NAVIGATING UNCERTAINTY: BUILDING RELIABLE AND RESILIENT SYSTEMS

decorative image

CVP is committed to providing reliable and resilient services to its customers. To achieve this, CVP focusses on several key areas like Service Design, Graceful Degradation and Failover mechanism

Service Design:
  • CVP services are designed to scale and handle traffic spikes using auto-scaling technologies like Kubernetes.
  • Strategically chosen database technologies like auto scaled SQL readers, NoSQL and OpenSearch.
  • Pre-computation and graceful fallbacks to further enhance resilience.
Graceful Degradation:
  • Practices are implemented to minimise service disruptions during outages, including service pipelining, multi-tenant fairness, and strategic timeouts.
  • Added AWS rate limiting and firewall features through the ALB, WAF and Shield Advanced for enhanced and machine learning-based protection.
Failover Mechanisms:

Mechanisms are in place to quickly recover from failures i.e.

  • Multiple availability zones in each region.
  • Geo-redundancy measures for regional outages.

CVP’s reliability roadmap emphasizes proactive risk management, implementing API best practices, rigorous testing, and chaos engineering. CVP’s investment on customer-centric monitoring systems like RADAR to detect and address issues proactively, aiming to deliver reliable services, meet SLAs and ensure seamless deployments for a superior customer experience.

"While planning lays the foundation for success, it is the consistent and deliberate actions that ultimately build and shape the structure of our achievements."
Back Home Next