Overview
To meet growing customer demands and expand our market reach, particularly in regions with strict data residency requirements, we need to start supporting multi-region deployments for the 5X platform. This initiative will enhance our competitive edge and address potential deal-breakers for EU customers and others with specific regional compliance needs.
Current Situation
5X platform is deployed only in AWS US East 1 (North Virginia) region Data residency for warehouses (Snowflake/BigQuery) and ingestion (Fivetran) already supports multiple regions Jobs (orchestration) and Business Intelligence (BI) capabilities are limited to US East 1 Proposed Solution: Phase 1 (Q4 2024)
Jobs Deployment: Enable deployment of jobs in customer-preferred regions Target completion: Mid-November 2024 BI Deployment: Capability to deploy BI in customer-preferred regions Lower priority; may be deferred beyond Q4 2024 Core Platform: The core of the platform will continue to be deployed in AWS US East-1 region. However, no actual customer data processing happens here. So data residency concerns shouldn’t be a problem. The core platform will store only customer metadata like usernames, emails, credentials, connection details etc in this region. Actual customer data sits in the customer’s data warehouse in their preferred locaiton. Key Benefits
Meets strict data residency regulations (e.g., EU requirements) for data processing and expands market reach Enhances platform flexibility and customer satisfaction Maintains compliance with SOC2, GDPR, and DORA standards Balances regional data processing with centralized platform management. Implementation Approach
Modify workspace provisioning flow to include region selection for data processing Leverage Fivetran's supported regions for data processing locations Map customer-selected regions to corresponding AWS regions for deploying jobs on the platform. Develop capability to deploy BI instances in selected AWS regions (if prioritized) Maintain core platform and metadata management in AWS US East 1 Regional Support
Initial focus: EU region to address immediate customer concerns Future expansion: All regions supported by Fivetran's GCP Standard plan Includes US, EU, Australia, Canada, UK, Singapore, Indonesia, India, Japan Potential addition of a third Asia region based on market traction Core platform and metadata remain centralized in US East 1 Timeline and Priorities
Q4 2024: Implement Jobs multi-region support (target: mid-November) BI multi-region support: To be evaluated for priority and timeline Full platform deployment in customer's cloud: Future phase, not in current scope Next Steps
Finalize technical design for Jobs multi-region deployment Begin development of workspace provisioning flow modifications Establish testing and validation processes for multi-region deployments Develop customer communication strategy for new multi-region capabilities Evaluate priority and timeline for BI multi-region support Ensure clear communication about the location of core platform and metadata Conclusion
Implementing multi-region support for data processing while maintaining a centralized core platform is crucial for 5x platform's growth, particularly in privacy-sensitive markets. This initiative will significantly enhance our value proposition, address key customer concerns, and position us competitively in the global data platform market, all while maintaining efficient platform management.
