Engineer Builds Home Data Center with 1.5 TB RAM and Faces Thermal Issues
A mechanical engineer has built a powerful home data center featuring 4 NVIDIA RTX 6000 PRO and 2 L40S GPUs, totaling 1.5 TB of RAM and 400 TB of storage, but is facing significant thermal challenges due to a heat output of 10.8 kW. Despite using a cooling system designed to handle this load, the setup generates excessive noise and heat, prompting plans to relocate the server for better cooling efficiency. The project highlights the complexities of integrating industrial-level thermal loads into residential environments.
Theia Market Signal Identification - AI Assisted
A mechanical engineer constructed a workstation featuring 4 NVIDIA RTX 6000 PRO and 2 L40S GPUs, totaling 168,960 CUDA cores and 576 GB of unified VRAM. The setup, which rivals $200,000 enterprise servers, operates in a residence and faces thermal challenges of 10.8 kW.
The custom server is based on an AMD EPYC 9754 processor with 128 cores and includes 1.5 TB of DDR5 ECC RAM and 400 TB of storage across 20 drives via Infiniband ConnectX 7. Cooling is managed through a MRCOOL system capable of rejecting 10.8 kW of heat.
The owner reports noise issues that permeate the building despite acoustic treatments. The GPUs dissipate up to 300W each, and the EPYC processor has a TDP of 360W, leading to significant heat generation.
Plans include relocating the server to improve cooling efficiency. The integration of industrial thermal loads with residential HVAC systems presents engineering challenges.
Comments