AI in the Basque Country Rainforest
AI in the Basque Country Rainforest: Server Configuration
This article details the server configuration supporting the "AI in the Basque Country Rainforest" project, a research initiative utilizing artificial intelligence to analyze biodiversity data collected from the rainforest region. This documentation is intended for new system administrators and developers contributing to the project. It covers hardware specifications, software stack, networking, and security considerations. This project utilizes a distributed system for handling the large datasets involved. See also Data Acquisition Procedures and Project Overview.
Hardware Overview
The project utilizes a cluster of servers located in a secure, climate-controlled facility near Bilbao. The cluster is designed for high throughput and redundancy. We utilize a mix of compute and storage nodes.
| Server Role | Server Name | CPU | RAM | Storage |
|---|---|---|---|---|
| Compute Node 1 | basque-ai-compute-01 | Intel Xeon Gold 6248R (24 cores) | 256 GB DDR4 ECC | 2 x 1 TB NVMe SSD (RAID 1) |
| Compute Node 2 | basque-ai-compute-02 | Intel Xeon Gold 6248R (24 cores) | 256 GB DDR4 ECC | 2 x 1 TB NVMe SSD (RAID 1) |
| Storage Node 1 | basque-ai-storage-01 | Intel Xeon Silver 4210 (10 cores) | 128 GB DDR4 ECC | 8 x 4 TB SATA HDD (RAID 6) |
| Storage Node 2 | basque-ai-storage-02 | Intel Xeon Silver 4210 (10 cores) | 128 GB DDR4 ECC | 8 x 4 TB SATA HDD (RAID 6) |
| Master Node | basque-ai-master | Intel Xeon E-2288G (8 cores) | 64 GB DDR4 ECC | 1 x 500 GB NVMe SSD |
The master node manages the cluster using Kubernetes. All data is backed up nightly to an offsite location, utilizing rsync and a secure VPN connection. Power redundancy is provided by a UPS system with battery backup for at least 30 minutes. See also Disaster Recovery Plan.
Software Stack
The software stack is built around a Linux foundation and utilizes various open-source tools for AI development and data management.
| Component | Version | Description |
|---|---|---|
| Operating System | Ubuntu Server 22.04 LTS | Provides the base operating system for all servers. |
| Container Orchestration | Kubernetes 1.27 | Manages the deployment and scaling of containerized applications. |
| Programming Language | Python 3.10 | The primary language used for AI model development. See Python Best Practices. |
| AI Framework | TensorFlow 2.12 | Used for building and training deep learning models. |
| Data Storage | PostgreSQL 15 | Stores metadata and processed data. See Database Schema. |
| Message Queue | RabbitMQ 3.9 | Facilitates asynchronous communication between services. |
| Monitoring | Prometheus & Grafana | Monitors server performance and application metrics. |
All software is managed using Ansible for automated configuration and deployment. Version control is handled using Git and hosted on a private GitLab instance. Regular security audits are conducted to ensure the system is protected against vulnerabilities. Refer to Security Protocols.
Networking Configuration
The server cluster is connected to the internet via a dedicated 1 Gbps fiber optic connection. Internal networking is handled by a private VLAN. Firewalls are configured to restrict access to only necessary ports.
| Network Interface | IP Address | Subnet Mask | Gateway |
|---|---|---|---|
| eth0 (External) | 192.0.2.100 | 255.255.255.0 | 192.0.2.1 |
| eth1 (Internal) | 10.0.0.10 | 255.255.255.0 | 10.0.0.1 |
| eth2 (Storage) | 10.0.1.10 | 255.255.255.0 | 10.0.1.1 |
DNS is managed internally using Bind9. All communication between servers is encrypted using TLS/SSL. Access to the servers is restricted to authorized personnel via SSH with key-based authentication. See Network Diagram for a visual representation of the network topology. The network is segmented using VLANs to improve security.
Security Considerations
Security is paramount to the success of the project. Several layers of security are implemented to protect the data and infrastructure.
- **Firewall:** A strict firewall policy is enforced to block all incoming traffic except for explicitly allowed ports.
- **Intrusion Detection System (IDS):** An IDS is deployed to monitor for malicious activity.
- **Regular Security Audits:** Regular security audits are conducted to identify and address vulnerabilities.
- **Data Encryption:** All sensitive data is encrypted at rest and in transit.
- **Access Control:** Access to the servers is restricted to authorized personnel via SSH with key-based authentication.
- **VPN:** A VPN is used for remote access to the servers. See VPN Configuration.
- **Two-Factor Authentication:** Two-factor authentication is required for all administrative accounts. See Two-Factor Authentication Guide.
Future Enhancements
Future enhancements include upgrading to faster network interfaces (10 Gbps), increasing storage capacity, and exploring the use of GPUs for accelerated AI model training. We are also planning to implement a more robust monitoring system with automated alerting. See Roadmap for a detailed plan of future developments.
Data Pipelines
API Documentation
Kubernetes Configuration
PostgreSQL Administration
Ansible Playbooks
Git Workflow
Security Policies
Network Security
Monitoring System
Backup Procedures
Troubleshooting Guide
AI Model Training
Data Analysis Tools
Project Team
Contact Information
Intel-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Core i7-6700K/7700 Server | 64 GB DDR4, NVMe SSD 2 x 512 GB | CPU Benchmark: 8046 |
| Core i7-8700 Server | 64 GB DDR4, NVMe SSD 2x1 TB | CPU Benchmark: 13124 |
| Core i9-9900K Server | 128 GB DDR4, NVMe SSD 2 x 1 TB | CPU Benchmark: 49969 |
| Core i9-13900 Server (64GB) | 64 GB RAM, 2x2 TB NVMe SSD | |
| Core i9-13900 Server (128GB) | 128 GB RAM, 2x2 TB NVMe SSD | |
| Core i5-13500 Server (64GB) | 64 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Server (128GB) | 128 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Workstation | 64 GB DDR5 RAM, 2 NVMe SSD, NVIDIA RTX 4000 |
AMD-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Ryzen 5 3600 Server | 64 GB RAM, 2x480 GB NVMe | CPU Benchmark: 17849 |
| Ryzen 7 7700 Server | 64 GB DDR5 RAM, 2x1 TB NVMe | CPU Benchmark: 35224 |
| Ryzen 9 5950X Server | 128 GB RAM, 2x4 TB NVMe | CPU Benchmark: 46045 |
| Ryzen 9 7950X Server | 128 GB DDR5 ECC, 2x2 TB NVMe | CPU Benchmark: 63561 |
| EPYC 7502P Server (128GB/1TB) | 128 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/2TB) | 128 GB RAM, 2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/4TB) | 128 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/1TB) | 256 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/4TB) | 256 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 9454P Server | 256 GB RAM, 2x2 TB NVMe |
Order Your Dedicated Server
Configure and order your ideal server configuration
Need Assistance?
- Telegram: @powervps Servers at a discounted price
⚠️ *Note: All benchmark scores are approximate and may vary based on configuration. Server availability subject to stock.* ⚠️