AWS Platform Engineering at Santander: Transforming Cloud Infrastructure
Santander faced a complex challenge in managing a vast infrastructure capable of processing billions of daily transactions across over 200 critical systems. To address this, the company implemented the Catalyst platform engineering initiative in collaboration with AWS, enabling scalable, agile, and standardized cloud infrastructure provisioning while reducing operational complexity.
The Challenges in Santanders Cloud Infrastructure
Santanders rapid expansion into financial services such as wealth management, insurance, and investment banking introduced unprecedented technological challenges. The infrastructure needed to handle billions of transactions daily while maintaining compliance across diverse systems. Additionally, provisioning new infrastructure often required up to 90 days, leading to inefficiencies and delays in service delivery.
The organization faced two primary issues: ensuring that provisioned services adhered to established architectural standards and significantly reducing provisioning timelines. These challenges necessitated a reevaluation of their existing processes and a move toward a more agile and scalable infrastructure model.
Introduction to Catalyst Platform Engineering Initiative
To address these challenges, Santander developed the Catalyst platform in collaboration with the AWS Platform Strategy Program (PSP). The initiative aimed to provide a unified, automated, and compliant infrastructure provisioning framework. By leveraging AWS Professional Services, Santander created a platform tailored to their operational needs.
The Catalyst platform provides a streamlined developer interface, acting as a centralized portal for all resource provisioning and management tasks. By abstracting complexity, the platform ensures that even sophisticated infrastructure requirements can be managed efficiently and consistently.
Technical Components of the Catalyst Platform
At the heart of the Catalyst platform is the control plane cluster, built on Amazon Elastic Kubernetes Service (Amazon EKS). The control plane acts as the operational brain, coordinating workflows and orchestrating various components within the system. This architecture ensures scalability and seamless integration with AWS services.
A critical feature of the control plane is its use of Crossplane, a universal resource provisioner. Crossplane enables Santander to manage resources across multiple cloud providers declaratively, ensuring consistency and reducing manual intervention. Additionally, ArgoCD handles data plane claims, further automating resource management workflows.
Benefits Achieved Through the Catalyst Initiative
The implementation of the Catalyst platform has transformed Santanders approach to cloud infrastructure. By automating provisioning processes and standardizing compliance, the platform has reduced the average infrastructure setup time from 90 days to a fraction of that duration. This improvement not only increases operational efficiency but also accelerates product delivery timelines.
Furthermore, the platforms unified interface simplifies the developer experience, allowing teams to focus on innovation rather than operational bottlenecks. The adoption of declarative resource management ensures that all resources adhere to predefined architectural standards, reducing risks and enhancing system reliability.
Collaboration Between Santander and AWS
The success of the Catalyst initiative was made possible through a strong partnership between Santander and AWS. By leveraging the expertise of AWS Professional Services and the Platform Strategy Program, Santander was able to design and implement a solution tailored to its unique requirements.
This collaboration not only facilitated the development of the Catalyst platform but also enabled the integration of advanced AWS technologies, such as Amazon EKS and Crossplane. These tools have been instrumental in achieving Santanders goals of scalability, compliance, and operational efficiency.
Future Implications and Scalability
The success of the Catalyst platform sets a benchmark for how financial institutions can modernize their cloud infrastructure. By adopting a platform engineering approach, Santander has positioned itself to scale its operations seamlessly while maintaining compliance and agility.
As the platform continues to evolve, Santander can incorporate emerging technologies and expand its capabilities to address future challenges. This initiative highlights the potential of combining advanced cloud technologies with strategic partnerships to achieve transformative outcomes.