This is the current compute and infrastructure setup behind my workbench.
Core System
- Model: Custom-built AI server with dual NVIDIA A100 80GB GPUs.
- CPU: 2x Intel Xeon Gold 6338, for a total of 64 cores and 128 threads.
- GPU: 2x NVIDIA A100 80GB.
- Memory: 512GB DDR4 ECC.
- Storage: 8TB NVMe SSD in RAID1 for primary storage, plus 20TB HDD for backup.
- Network: Dual-port 10GbE.
- Power Supply: 2000W 80 Plus Platinum in a redundant configuration.
- Cooling: High-efficiency airflow system.
- OS: Ubuntu Server 22.04 LTS.
Rack And Power
- Rack: 19-inch standard rack, 600mm x 1000mm x 2000mm.
- Rack Accessories: Power distribution unit and lockable dustproof panel.
- UPS: 5kVA lithium-ion UPS in a redundant configuration.
- Battery Runtime: Around 10 to 15 minutes, enough for emergency shutdown protection.
- Electrical Work: Dedicated 200V three-phase power installation with an additional power distribution panel and dedicated outlets.
Networking
- Switching: 24-port 10GbE switch.
- Cabling: 10GbE fiber optic cabling.
Cooling And Noise Control
- Air Conditioning: Floor-standing precision AC unit rated at 6.0 kW (20,000 BTU/h).
- Operating Range: Maintained between 18 and 25 degrees C.
- Duty Cycle: Designed for 24/7 continuous operation.
- Noise Reduction: Soundproof panels rated for roughly 35 to 40 dB noise reduction.
- Vibration Control: Anti-vibration floor mats and a vibration-reducing rack mount with rubber padding.
- Flooring: Waterproof flooring with an integrated drainage system.
Safety
- Fire Protection: Automatic gas fire suppression system.
- Room Protection: Fire-resistant coating on the server room walls.