Cloudflares Gen 13 Servers: Enhanced Performance with AMD EPYC Turin Processors
Cloudflare's Gen 13 servers mark a significant upgrade in edge computing capabilities. Based on AMD EPYC 5th Generation Turin processors, this new fleet delivers double the compute performance of its predecessor. By transitioning to the FL2 software architecture, Cloudflare has optimized its systems to prioritize core scalability over cache dependency, ensuring superior performance across its edge network.
Transitioning from Gen 12 to Gen 13 Servers
Cloudflares previous Gen 12 servers utilized AMD EPYC GenoaX processors, which were designed with a cache-centric architecture. This configuration was ideal for their earlier request handling layer, FL1, which heavily relied on large L3 cache for performance. However, new CPUs offering increased throughput presented challenges due to reduced cache sizes, necessitating a shift in software architecture.
The introduction of FL2, a Rust-based rewrite of Cloudflares core request handling layer, addressed these challenges. FL2 moved away from a dependency on large cache sizes, instead leveraging the increased core count of modern processors. This allowed Cloudflare to fully harness the potential of AMD EPYC Turin processors, ensuring that performance scaled effectively with core count while maintaining their service level agreements (SLAs).
Key Features of AMD EPYC 5th Generation Turin Processors
The AMD EPYC 5th Generation Turin processors bring substantial advancements to Cloudflares Gen 13 servers. These processors feature up to 192 cores, double the core count of their GenoaX predecessors, and offer simultaneous multithreading (SMT) with up to 384 threads. This increase in core density is complemented by improved instructions-per-cycle (IPC) through the Zen 5 architecture.
Additionally, the Turin processors provide enhanced power efficiency, consuming up to 32% fewer watts per core despite the higher core count. They also support DDR5-6400 memory, offering higher memory bandwidth to effectively feed the increased number of cores. These improvements collectively position the Turin processors as a powerful foundation for modern server workloads.
The Shift from Cache-Centric to Core-Heavy Architectures
One of the most notable trade-offs in the AMD EPYC Turin architecture is the reduction in per-core L3 cache. Each core in the highest-density Turin OPN configuration has access to 2MB of L3 cache, a significant reduction compared to the 12MB per core in the Gen 12 GenoaX processors. While this change prioritizes overall throughput, it posed challenges for workloads with high cache locality demands.
Cloudflares FL1 software stack, which relied on larger caches, struggled to achieve maximum throughput with the new processors. The transition to FL2 was critical in overcoming this limitation. By redesigning their request handling layer, Cloudflare ensured that performance could scale with the increased core count, effectively bypassing the limitations of reduced per-core cache.
Performance Gains with FL2 and Gen 13
The FL2 software architecture played a pivotal role in unlocking the full potential of Cloudflares Gen 13 servers. By prioritizing core scalability and minimizing reliance on large caches, FL2 allowed the new servers to achieve significant performance gains. This architecture ensures efficient resource utilization and low latency, even with the reduced cache per core in the new processors.
Cloudflares tests demonstrated that the combination of FL2 and AMD EPYC Turin processors resulted in a 2x increase in edge compute performance compared to the Gen 12 servers. This improvement ensures faster request handling and a more responsive experience for users across Cloudflares global network.
Impact on Power Efficiency and Sustainability
In addition to performance improvements, the Gen 13 servers offer enhanced power efficiency. The AMD EPYC Turin processors consume up to 32% fewer watts per core compared to their GenoaX counterparts. This efficiency is particularly important for Cloudflare, given the scale of its operations and the environmental impact of data centers.
By adopting processors with higher core density and lower power consumption, Cloudflare can reduce its overall energy footprint while delivering improved performance. This aligns with the companys broader commitment to sustainability and energy efficiency in its infrastructure.
Conclusion: A Strategic Upgrade for Cloudflare
The launch of Cloudflares Gen 13 servers, powered by AMD EPYC 5th Generation Turin processors and the FL2 software stack, represents a significant advancement in edge computing capabilities. By shifting from a cache-centric to a core-heavy architecture, Cloudflare has effectively addressed the challenges posed by modern hardware configurations.
With 2x edge compute performance, improved power efficiency, and optimized resource utilization, the Gen 13 servers position Cloudflare to meet the growing demands of its global user base while maintaining its focus on efficiency and sustainability.