Dell PowerEdge R7625 Server Review
September 5, 2024The 2U Dell PowerEdge R7625 server (SHOP HERE) has dual 4th generation AMD EPYC CPUs and can deliver up to 256 physical cores and a staggering 512 virtual threads! Again, with top-of-the-line AMD EPYC processors installed. I think you can do the math. As always, we’ll mention cores aren’t everything but that is quite impressive.
As a general-purpose platform the Dell PowerEdge R7625 server is designed to support high-performance computing, virtual desktop integration, and virtualized workloads, not to mention, in-memory database, AI and inference plus machine learning. We always thought VDI was for virtual desktop infrastructure but you know how it is with this industry, the more acronyms the better.
Along with support for CPUs with up to 128 cores each, you also get support for DDR5 memory modules, PCIe 5.0 and can install 2x double-wide GPUs or up to 6x single-wide, with flexible storage. Again, we have a bunch of options supported on this platform, so we’ll do our best not to confuse you. If we do, please watch the video!
Keep in mind Dell states in their spec sheet from February 2023 that future releases will include “additional capacities” and form factors. They also list CPUs with up to 96 cores in that same Spec Sheet. Fast forward 3 months, and we get 128 cores in the Technical Guide from May 2023. Where do those all those cores come from? 4th gen AMD EPYC CPUs used to top out at 96 cores.
AMD just released new 4th Gen EPYC CPUs on June 13, 2023. 3x are workload optimized for cloud-native data centers and 3x more 4th Gen CPUs with AMD 3D V-Cache technology for demanding high-performance computing applications. At least so far. It is hard to keep track. If you will recall, when AMD 3D V-Cache was announced for the 3rd generation processors it enabled L3 cache of up to 768MB compared to the standard 256MB on most other 3rd Gen AMD EPYCs. The 9684X processor with 4th gen 3D V-Cache technology now offers 1,152MB of L3 cache, which offers even better data queuing with faster access to data! The other CPUs, which are workload optimized for cloud native data centers, provide that 128-core count with an L3 Cache of 256MB. All those cores are an asset for virtualized infrastructures too.
AMD has compared these new CPUs to Ampere Altra MAX CPUs. AMD’s new chips deliver a 3.7 times throughput performance increase for cloud-native workloads and 2.7 times better energy efficiency. Even though energy efficiency is supposed to be one of the advantages of using ARM-architecture-based CPUs. Kind of strange that AMD is now comparing their CPUs to Ampere Altra’s ARM-based CPUs, instead of Intel. But, Ampere Altra MAX CPUs have crazy core counts too at up to 128 Cores. That’s of course not mentioning Ampere ONE CPUs, which have a maximum of 192 cores! Again, different architecture compared to x86, and we’re getting off topic. Those last AMD EPYCs with AMD’s 3D V-Cache technology may only have up to 96 cores, but still provide up to 5X the performance gains compared to the previous generation for Azure HBv4 and HX instances. HBv4 and HX-series virtual machines are good at scaling and cost-effective for applications in financial services, computational fluid dynamics, geoscience simulations, and all sorts of high-performance computing applications. Did we mention that the ARM based Ampere CPUs are single threaded CPUs without hyperthreading like Intel and AMD?
Once we remove the optional LCD bezel, the Dell PowerEdge R7625 has a number of storage options to choose from. 8x or 12x 3.5-inch storage bays in front supporting SAS or SATA drive types. 8x, 16x, and 24x 2.5-inch bay options with support for SAS, SATA or NVMe Gen5 U.2. That 24-bay chassis can support up to 368TB. Going to assume one of those “Additional Capabilities” aspects would be support for E3.S NVMe drives—up to 33% more than the previous generation to be exact. The technical guide lists options for 16x and 32x E3.S drive bays. However, only the 16x E3.S chassis has an option for a PERC H755N Front Perc or one of those new H965i Front PERCs that can RAID those NVMe drives. The other 32x-bay E3.S option uses the integrated S160 controller. Maximum storage capacity with 16 or 32 bays for the E3-S drive type is not listed. There are more storage options hosted in back and we will get to those in a minute.
The control panel on the right-hand side of the chassis has the power On button, a USB port, iDRAC Direct Micro -AB USB port, and a VGA port to connect a monitor. On the other side, another panel with system Health, System ID and status LED indicators for drives, temperature, electrical, memory, and PCIe. The system ID button can also be paired with an iDRAC Quick Sync 2 wireless indicator. That will allow you to quickly manage the system using an iOS or Android-based smart phone or tablet. Pretty much gives you access to most of the management features including the system hardware, firmware inventory, diagnostics and troubleshooting, plus system inventory and a bunch of other items.
On the back of the Dell PowerEdge R7625, there are 2x PSUs to either side with a number of options depending on the configuration. Configuration will affect PCIe slots too. There could be up to 4x PCIe slots featuring Gen 5 and up to 32GT/s, which is twice as fast as that supported by PCIe 4. Or an option for 8x PCIe 4.0 slots. If you add either the optional 2.5-inch 2x bay or 4-bay drive cages or GPUs, that will impact the number of PCIe slots available.
The standard LOM module has 1x USB 2.0 port, 1x RJ45 iDRAC Ethernet port, 1x USB 3.0 port, plus an optional serial port and an optional VGA port. That space for the VGA port is optional because it can also be used to support Direct Liquid Cooling (DLC). An optional OCP 3.0 card can also be installed offering several bandwidth options from 1GbE to 10GbE/25GbE with 1 to 4 ports. An embedded NIC offers dual 1GbE ports and is optional as well.
Just above, squeezed between the slots for Riser 1 and Riser 3 is a slot for an optional Boot Optimized Storage Subsystem or BOSS. The monolithic BOSS-N1 offers two M.2 caddies that are accessible from the back of the chassis. With 2x M.2 drives, they can be added to a RAID 1 for mirroring. In the event one of them fails the other takes over. The BOSS can also support just a single drive with a RAID 0 and a blank in the other slot. The PCIe risers are easily removeable using the thumb screws and maybe a Phillips head screwdriver.
As with all Dell PowerEdge Servers, the Dell PowerEdge R7625 can be managed using the integrated Dell Remote Access Controller or iDRAC. iDRAC can be used to manage a single server and the Dell OpenManage application leverages iDRAC to provide multi-server management. Both can be accessed at chassis or as the name would suggest remotely. The R7625 comes with iDRAC Direct but the license can be upgraded to support, Enterprise, or iDRAC Datacenter. An OpenManage license can also be purchases and comes in Enterprise and Enterprise Advanced Plus, typically used to manage multiple servers.
Once we take the cover off, you can see the basic layout. Drives up front, backplane, a row of 6 fans, then the plastic air shroud directing air over the CPUs and memory modules. Lastly, the PCIe risers with Risers 1, 3 and 4 visible and riser 2 in the middle under riser 3. That is assuming it came with those optional risers. This one has most of those things. It is also configured with optional GPU risers and the optional plastic shroud designed to effectively cool the GPUs. As cooling is essential for performance, outfitted with optional Direct liquid Cooling, the R7625 can achieve peak performance almost indefinitely.
This system has riser configuration 4 with 2 x16 Low-Profile slots, plus 2x x8 Full-Height slots, and 2x x16 slots with Double-Width, Full length risers installed. With only one PCIe 5.0 x16 slot in each of the extended GPU in risers 1 and 4 installed on our system it will accept two double-wide GPUs of up to 300W each. It has a performance fan kit and dual redundant 1400W power supply units in back. There are a few GPUS to choose from including the NVIDIA A2, A16, A30, A40 and A100. Also, an AMD card—the MI210 with 64GB of memory for high-performance computing and AI server applications. Oh yeah, this server will also tackle AI and HPC. None of these GPUs drain more than 300W.
The R7625 has fewer memory module slots at 24 compared to 32 on the R7525. The interconnect on the 4th generation AMD EPYCs is twice the speed at 32GT/s compared to 16GT/s on the 3rd Gen EPYC processors.
It has a Front PERC H965i controller, which is the latest 12th generation PERC. This controller will support SAS, SATA and NVMe storage devices. It supports Gen3 NVMe drives at 8GT/s and 16GT/s with Gen4 NVMe drives at a maximum x2 lane width. For Gen2 SAS data rates are 6Gb/s, gen 3 at 12 Gb/s and SAS gen 4 at 22.5Gb/s but we’ll just round that up to 24Gb/s like they do in most of the materials we’ve seen. To be clear 22.5 Gb/s is the data rate wile 24Gb/s is the link speed. It will also support SATA at 3x and 6Gb/s. Mixing speeds for SAS and SATA drives is supported. However, you cannot mix NVMe with SAS and SATA drives with this controller. That said, it will support a full range of RAID options.
The Dell PowerEdge R7625 offers better performance along with improved power efficiency for data center applications. Those 4th gen processors also enable significantly better performance for a wide range of applications with DDR5 memory, and PCIe 5.0. In fact, it grabbed a new world record for accelerating in-memory databases by over 72%. It also delivers 33% more storage, a 55% increase in CPU performance per watt, 50% more cores, and 121% increase in performance in general. Oh, and with optional Direct Liquid Cooling, improved energy efficiency from reduced cooling costs.
To learn more about this server, or any other system, contact IT Creations!
