The AMD EPYC 9754 is a server/workstation processor with 128 cores, launched in June 2023, at an MSRP of $11900. It is part of the EPYC lineup, using the Zen 4c (Bergamo) architecture with Socket SP5. Thanks to AMD Simultaneous Multithreading (SMT) the core-count is effectively doubled, to 256 threads. To further increase overall system performance, up to two EPYC 9754 CPUs can link up in a multi-processor (SMP) configuration. EPYC 9754 has 256 MB of L3 cache and operates at 2.25 GHz by default, but can boost up to 3.1 GHz, depending on the workload. AMD is building the EPYC 9754 on a 5 nm production process using 71,000 million transistors. The silicon die of the chip is not fabricated at AMD, but at the foundry of TSMC. The multiplier is locked on EPYC 9754, which limits its overclocking capabilities.
With a TDP of 360 W, the EPYC 9754 is extremely power hungry, which means you need top-notch cooling. AMD’s processor supports DDR5 memory with a twelve-channel interface. The highest officially supported memory speed is 4800 MT/s, but with overclocking (and the right memory modules) you can go even higher. ECC memory is supported, too, which is an important capability for mission-critical systems, to avoid data corruption. For communication with other components in the machine, EPYC 9754 uses a PCI-Express Gen 5 connection. This processor lacks integrated graphics, you might need a graphics card.
Hardware virtualization is available on the EPYC 9754, which greatly improves virtual machine performance. Programs using Advanced Vector Extensions (AVX) will run on this processor, boosting performance for calculation-heavy applications. Besides AVX, AMD has added support for the newer AVX2 and AVX-512 instructions, too.