AI in Ipswich
- AI in Ipswich: Server Configuration
This article details the server configuration powering the "AI in Ipswich" project, a local initiative exploring applications of artificial intelligence in urban management. This guide is intended for new system administrators and developers contributing to the project. It covers hardware specifications, software stack, networking, and security considerations.
Overview
The “AI in Ipswich” project utilizes a cluster of servers located in a dedicated, climate-controlled server room at Ipswich Borough Council. The primary goal of the infrastructure is to provide sufficient computational power for training and deploying machine learning models focused on traffic flow optimization, predictive maintenance of public infrastructure, and enhanced citizen services. The system is designed for scalability and redundancy. See System Architecture for a high-level diagram.
Hardware Specifications
The server cluster consists of three primary server types: compute nodes, storage nodes, and a management node. Details are provided below.
| Server Type | Model | CPU | RAM | Storage | Network Interface |
|---|---|---|---|---|---|
| Compute Node | Dell PowerEdge R750 | 2x Intel Xeon Gold 6338 | 256 GB DDR4 ECC REG | 2x 1.92TB NVMe SSD (RAID 1) | 100 Gbps Ethernet |
| Storage Node | Supermicro Storage Server 846E16-R1200B | 2x Intel Xeon Silver 4310 | 128 GB DDR4 ECC REG | 16x 16TB SAS HDD (RAID 6) | 40 Gbps InfiniBand |
| Management Node | HP ProLiant DL380 Gen10 | 2x Intel Xeon Silver 4210 | 64 GB DDR4 ECC REG | 2x 480 GB SSD (RAID 1) | 1 Gbps Ethernet |
These servers run on a dedicated power circuit with UPS backup. See Power Redundancy for more details on the UPS configuration. The server room maintains a constant temperature of 22°C with humidity control. Refer to Environmental Controls for specifics.
Software Stack
The software stack is built around a Linux foundation, providing a robust and flexible environment for AI development and deployment.
| Component | Version | Purpose |
|---|---|---|
| Operating System | Ubuntu Server 22.04 LTS | Provides the base operating system. |
| Containerization | Docker 24.0.5 | Enables application packaging and isolation. See Docker Configuration. |
| Orchestration | Kubernetes 1.27 | Manages container deployment, scaling, and networking. Refer to Kubernetes Cluster Setup. |
| Machine Learning Framework | TensorFlow 2.12 | Primary framework for model development and training. |
| Data Storage | Ceph Octopus | Distributed object storage for large datasets. See Ceph Storage Cluster. |
| Monitoring | Prometheus 2.44 | Collects and stores metrics for performance monitoring. |
All software is regularly updated with security patches. See Security Patching Procedure for details. Version control is managed using Git, with all project code stored in a private Git repository.
Networking Configuration
The server cluster is connected to the Ipswich Borough Council network via a dedicated VLAN. A firewall protects the cluster from external access.
| Network Segment | IP Range | Subnet Mask | Gateway |
|---|---|---|---|
| Management Network | 192.168.10.0/24 | 255.255.255.0 | 192.168.10.1 |
| Compute Network | 10.0.0.0/16 | 255.255.0.0 | 10.0.0.1 |
| Storage Network | 172.16.0.0/24 | 255.255.0.0 | 172.16.0.1 |
Internal communication between servers utilizes private network addresses. External access is limited to the management node via SSH and a web-based monitoring interface. See Network Security Policy for complete details. The DNS server is configured to resolve both internal and external domain names. Refer to DNS Configuration.
Security Considerations
Security is a paramount concern. The following measures are in place:
- **Firewall:** A dedicated firewall (pfSense) protects the cluster from unauthorized access. Firewall Ruleset details the current rules.
- **Intrusion Detection System (IDS):** Snort is deployed to monitor network traffic for malicious activity. See IDS Configuration.
- **Access Control:** Access to the servers is restricted to authorized personnel only, using SSH keys and multi-factor authentication. Refer to SSH Access Policy.
- **Data Encryption:** Data at rest and in transit is encrypted using TLS/SSL. See Encryption Standards.
- **Regular Security Audits:** Periodic security audits are conducted to identify and address vulnerabilities. See Audit Schedule.
Future Expansion
Future plans include expanding the compute cluster with additional GPU-enabled servers to accelerate model training. We also plan to integrate a dedicated data lake for storing and processing large volumes of data. See Future Infrastructure Roadmap for more information.
System Documentation Troubleshooting Guide Contact Information Data Backup Procedures Disaster Recovery Plan Server Monitoring Dashboard
Intel-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Core i7-6700K/7700 Server | 64 GB DDR4, NVMe SSD 2 x 512 GB | CPU Benchmark: 8046 |
| Core i7-8700 Server | 64 GB DDR4, NVMe SSD 2x1 TB | CPU Benchmark: 13124 |
| Core i9-9900K Server | 128 GB DDR4, NVMe SSD 2 x 1 TB | CPU Benchmark: 49969 |
| Core i9-13900 Server (64GB) | 64 GB RAM, 2x2 TB NVMe SSD | |
| Core i9-13900 Server (128GB) | 128 GB RAM, 2x2 TB NVMe SSD | |
| Core i5-13500 Server (64GB) | 64 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Server (128GB) | 128 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Workstation | 64 GB DDR5 RAM, 2 NVMe SSD, NVIDIA RTX 4000 |
AMD-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Ryzen 5 3600 Server | 64 GB RAM, 2x480 GB NVMe | CPU Benchmark: 17849 |
| Ryzen 7 7700 Server | 64 GB DDR5 RAM, 2x1 TB NVMe | CPU Benchmark: 35224 |
| Ryzen 9 5950X Server | 128 GB RAM, 2x4 TB NVMe | CPU Benchmark: 46045 |
| Ryzen 9 7950X Server | 128 GB DDR5 ECC, 2x2 TB NVMe | CPU Benchmark: 63561 |
| EPYC 7502P Server (128GB/1TB) | 128 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/2TB) | 128 GB RAM, 2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/4TB) | 128 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/1TB) | 256 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/4TB) | 256 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 9454P Server | 256 GB RAM, 2x2 TB NVMe |
Order Your Dedicated Server
Configure and order your ideal server configuration
Need Assistance?
- Telegram: @powervps Servers at a discounted price
⚠️ *Note: All benchmark scores are approximate and may vary based on configuration. Server availability subject to stock.* ⚠️