Article

A mechanical engineer constructed a workstation featuring 4 NVIDIA RTX 6000 PRO and 2 L40S GPUs, totaling 168,960 CUDA cores and 576 GB of unified VRAM. The setup, which rivals $200,000 enterprise servers, operates in a residence and faces thermal challenges of 10.8 kW.

The custom server is based on an AMD EPYC 9754 processor with 128 cores and includes 1.5 TB of DDR5 ECC RAM and 400 TB of storage across 20 drives via Infiniband ConnectX 7. Cooling is managed through a MRCOOL system capable of rejecting 10.8 kW of heat.

The owner reports noise issues that permeate the building despite acoustic treatments. The GPUs dissipate up to 300W each, and the EPYC processor has a TDP of 360W, leading to significant heat generation.

Plans include relocating the server to improve cooling efficiency. The integration of industrial thermal loads with residential HVAC systems presents engineering challenges.