AI in the Nile River
- AI in the Nile River: Server Configuration
This article details the server configuration powering the "AI in the Nile River" project, a groundbreaking initiative utilizing artificial intelligence to monitor and analyze the health of the Nile River ecosystem. This document is intended to be a technical overview for other engineers and system administrators contributing to or interested in the project. It assumes a basic understanding of Linux server administration and networking concepts. We will cover hardware, software, and network configuration. Please refer to the Server Administration Policy for overall guidelines.
Project Overview
The "AI in the Nile River" project employs a network of sensors deployed along the Nile, collecting data on water quality, biodiversity, and hydrological conditions. This data is transmitted to a central server cluster for processing by machine learning algorithms. The algorithms identify trends, predict potential problems (such as pollution events or algal blooms), and provide actionable insights to conservation efforts. The project’s success relies heavily on a robust and scalable server infrastructure. See Project Goals for more details.
Hardware Configuration
The core server infrastructure consists of three primary server types: Ingestion Servers, Processing Servers, and Data Storage Servers. Each type is built with specific hardware to optimize performance.
| Server Type | CPU | RAM | Storage | Network Interface |
|---|---|---|---|---|
| Intel Xeon Gold 6248R (24 cores) | 128 GB DDR4 ECC | 2 x 1TB NVMe SSD (RAID 1) | 10 Gbps Ethernet | ||||
| AMD EPYC 7763 (64 cores) | 256 GB DDR4 ECC | 4 x 2TB NVMe SSD (RAID 10) | 10 Gbps Ethernet | ||||
| Supermicro 4U Server | 2 x Intel Xeon Silver 4210 (10 cores each) | 16 x 8TB SATA HDD (RAID 6) | 25 Gbps Ethernet |
These servers are housed in a secure, climate-controlled data center located in Cairo Data Center Location. Power redundancy is provided by dual power supplies and a UPS system. The servers are monitored using Nagios Monitoring System and alerts are configured for critical events.
Software Configuration
The operating system for all servers is Ubuntu Server 22.04 LTS. This provides a stable and well-supported platform. The software stack is designed for scalability and resilience.
- Ingestion Servers: Nginx web server, Apache Kafka, and custom data ingestion scripts written in Python. Kafka acts as a message queue for incoming sensor data. See Data Ingestion Pipeline for a detailed flow diagram.
- Processing Servers: Python 3.9, TensorFlow 2.x, PyTorch 1.12, and Jupyter Notebook for model development and deployment. These servers also utilize CUDA for GPU acceleration. Refer to the Machine Learning Models Documentation for details on the algorithms used.
- Data Storage Servers: PostgreSQL database with TimescaleDB extension for time-series data. Data is backed up daily to a remote offsite location using Backup and Recovery Procedures.
All servers utilize Docker containers for application deployment and isolation. Docker Compose is used to manage multi-container applications. The container images are stored in a private Docker registry hosted on Internal Docker Registry.
| Software Component | Version | Purpose | Server Type |
|---|---|---|---|
| 22.04 LTS | Operating System | All | |||
| 1.22.0 | Web Server/Reverse Proxy | Ingestion | |||
| 3.2.3 | Message Queue | Ingestion | |||
| 3.9.12 | Scripting/ML | Ingestion, Processing | |||
| 2.10.0 | Machine Learning | Processing | |||
| 1.12.1 | Machine Learning | Processing | |||
| 14.5 | Database | Data Storage | |||
| 2.7.1 | Time-Series Database Extension | Data Storage | |||
| 20.10.17 | Containerization | All |
Network Configuration
The server cluster is connected to the internet via a dedicated 1 Gbps fiber optic connection. A firewall (iptables) is configured to restrict access to only necessary ports. Internal network communication is secured using VLANs. The network topology is illustrated in Network Diagram.
| Network Segment | IP Range | VLAN ID | Description |
|---|---|---|---|
| 192.168.1.0/24 | 10 | Server administration and monitoring | |||
| 10.0.0.0/16 | 20 | Communication between ingestion, processing, and storage servers | |||
| 203.0.113.0/24 | N/A | Internet access |
DNS resolution is handled by an internal DNS server running on Internal DNS Server. SSL/TLS certificates are used to encrypt all communication between servers and clients. See Security Protocols for further information. The network is monitored by Network Monitoring Tools.
Future Considerations
Future upgrades include migrating to Kubernetes for container orchestration and exploring the use of GPU instances for accelerating machine learning workloads. We are also investigating the implementation of a data lake using Apache Hadoop and Spark for long-term data storage and analysis. See Future Development Roadmap for planned enhancements.
Server Documentation Index Troubleshooting Guide Security Best Practices Data Privacy Policy Contact Support
Intel-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Core i7-6700K/7700 Server | 64 GB DDR4, NVMe SSD 2 x 512 GB | CPU Benchmark: 8046 |
| Core i7-8700 Server | 64 GB DDR4, NVMe SSD 2x1 TB | CPU Benchmark: 13124 |
| Core i9-9900K Server | 128 GB DDR4, NVMe SSD 2 x 1 TB | CPU Benchmark: 49969 |
| Core i9-13900 Server (64GB) | 64 GB RAM, 2x2 TB NVMe SSD | |
| Core i9-13900 Server (128GB) | 128 GB RAM, 2x2 TB NVMe SSD | |
| Core i5-13500 Server (64GB) | 64 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Server (128GB) | 128 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Workstation | 64 GB DDR5 RAM, 2 NVMe SSD, NVIDIA RTX 4000 |
AMD-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Ryzen 5 3600 Server | 64 GB RAM, 2x480 GB NVMe | CPU Benchmark: 17849 |
| Ryzen 7 7700 Server | 64 GB DDR5 RAM, 2x1 TB NVMe | CPU Benchmark: 35224 |
| Ryzen 9 5950X Server | 128 GB RAM, 2x4 TB NVMe | CPU Benchmark: 46045 |
| Ryzen 9 7950X Server | 128 GB DDR5 ECC, 2x2 TB NVMe | CPU Benchmark: 63561 |
| EPYC 7502P Server (128GB/1TB) | 128 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/2TB) | 128 GB RAM, 2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/4TB) | 128 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/1TB) | 256 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/4TB) | 256 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 9454P Server | 256 GB RAM, 2x2 TB NVMe |
Order Your Dedicated Server
Configure and order your ideal server configuration
Need Assistance?
- Telegram: @powervps Servers at a discounted price
⚠️ *Note: All benchmark scores are approximate and may vary based on configuration. Server availability subject to stock.* ⚠️