Cloudflare's Gen 13 Server: A Technical Overview

Cloudflare has introduced its latest server design, Gen 13, which leverages the 5th generation AMD EPYC Turin processor. This new design aims to improve performance, efficiency, and scalability while reducing data center expansion costs. Key features of Gen 13 include:

• Up to 2x throughput compared to Gen 12 while maintaining latency SLA
• Up to 50% improvement in performance/watt efficiency, reducing data center expansion costs
• Up to 60% higher throughput per rack while keeping rack power budget constant
• 2x memory capacity, 1.5x storage capacity, and 4x network bandwidth compared to Gen 12
• Introduced PCIe encryption hardware support in addition to memory encryption
• Improved support for thermally demanding powerful drop-in PCIe accelerators

The Gen 13 server is designed with a 192-core AMD EPYC 9965 Turin processor, 768 GB of DDR5-6400 memory, 24 TB of PCIe 5.0 NVMe storage, and dual 100 GbE port network interface card. The selection of the AMD Turin 9965 processor was based on its ability to balance core count, efficiency, and power consumption. The 9965 has 192 cores, 384 MB of L3 cache, and a maximum configurable TDP of 500W.

Key Takeaways for Developers

• Gen 13 servers offer significant performance and efficiency improvements compared to Gen 12
• The AMD Turin 9965 processor provides a good balance of core count, efficiency, and power consumption
• Developers can expect improved performance, scalability, and reduced data center expansion costs with Gen 13 servers
• The introduction of PCIe encryption hardware support and improved support for thermally demanding accelerators provide additional benefits for developers.