AI in Basque Country
AI in Basque Country: Server Configuration
This article details the server configuration supporting Artificial Intelligence (AI) initiatives within the Basque Country. It’s aimed at newcomers to our MediaWiki site and provides a technical overview of the infrastructure. Understanding this setup is crucial for anyone contributing to or utilizing AI services hosted here. We will cover hardware, software, networking, and security considerations.
Overview
The Basque Country is investing heavily in AI research and development, necessitating a robust and scalable server infrastructure. This infrastructure is designed to support a variety of AI workloads, including Machine learning, Deep learning, Natural language processing, and Computer vision. The core of the system resides within a dedicated data center located in Bilbao. We prioritize redundancy, security, and performance. The system is designed for both research purposes and eventual deployment of AI-powered services to citizens and businesses. This document details the current (as of October 26, 2023) configuration.
Hardware Specifications
The server infrastructure comprises a cluster of high-performance servers. The following table details the key hardware components:
| Component | Specification | Quantity |
|---|---|---|
| CPU | AMD EPYC 7763 (64-core) | 24 |
| RAM | 256 GB DDR4 ECC Registered | 24 |
| Storage (Primary) | 4TB NVMe PCIe Gen4 SSD | 24 |
| Storage (Secondary) | 16TB SAS HDD (RAID 6) | 8 |
| GPU | NVIDIA A100 (80GB) | 12 |
| Network Interface | 100Gbps Ethernet | 24 |
| Power Supply | 2000W Redundant | 24 |
These servers are housed in standard 19-inch racks, with provisions for future expansion. Power and cooling are managed by a dedicated infrastructure, ensuring high uptime and reliability. See also Data Center Cooling.
Software Stack
The software stack is built on a foundation of Linux, specifically Ubuntu Server 22.04 LTS. This provides a stable and secure operating system. Key software components include:
- Containerization: Docker and Kubernetes are used for application deployment and orchestration, allowing for scalability and portability.
- AI Frameworks: TensorFlow, PyTorch, and Scikit-learn are the primary machine learning frameworks supported.
- Database: PostgreSQL is used for storing metadata and model parameters.
- Message Queue: RabbitMQ facilitates communication between different services.
- Monitoring: Prometheus and Grafana are used for system monitoring and alerting.
- Version Control: All code is managed using Git and hosted on a private GitLab instance.
- Firewall: A robust firewall protects the network from unauthorized access.
- Intrusion Detection System (IDS): An IDS monitors network traffic for malicious activity.
- Regular Security Audits: Periodic security audits are conducted to identify and address vulnerabilities.
- Data Encryption: Data at rest and in transit is encrypted using industry-standard encryption algorithms. See Encryption Standards.
- Access Control: Strict access control policies are enforced, limiting access to sensitive data and systems. We use Role-Based Access Control.
- Vulnerability Scanning: Automated vulnerability scanning is performed regularly.
- Telegram: @powervps Servers at a discounted price
The following table outlines the software versions currently in use:
| Software | Version |
|---|---|
| Ubuntu Server | 22.04 LTS |
| Docker | 20.10.14 |
| Kubernetes | 1.24.3 |
| TensorFlow | 2.9.1 |
| PyTorch | 1.12.1 |
| Scikit-learn | 1.1.3 |
| PostgreSQL | 14.5 |
| RabbitMQ | 3.9.7 |
| Prometheus | 2.36.2 |
| Grafana | 8.4.6 |
Network Configuration
The server infrastructure is connected to the internet via a redundant 10Gbps fiber connection. Internal networking utilizes a dedicated VLAN for AI-related traffic, isolating it from other network segments. The following table details the network addressing scheme:
| Network Segment | IP Range | Subnet Mask | Gateway |
|---|---|---|---|
| Management Network | 192.168.1.0/24 | 255.255.255.0 | 192.168.1.1 |
| AI Cluster Network | 10.0.0.0/16 | 255.255.0.0 | 10.0.0.1 |
| Public Facing Services | 203.0.113.0/24 | 255.255.255.0 | 203.0.113.1 |
Firewall rules are configured to restrict access to the AI cluster, allowing only authorized personnel and services to connect. We employ Network Segmentation best practices.
Security Considerations
Security is paramount. The following measures are in place to protect the AI infrastructure:
Future Expansion
Plans are underway to expand the AI infrastructure with additional GPUs and storage capacity. We are also exploring the use of Federated learning to enable collaborative AI development across different organizations in the Basque Country. We anticipate incorporating more specialized hardware, like TPUs, as AI workloads evolve. Further details on planned upgrades can be found on the Roadmap page.
Main Page AI Ethics Data Privacy Machine Learning Algorithms Deep Neural Networks Docker Configuration Kubernetes Deployment PostgreSQL Administration Security Best Practices Network Troubleshooting Server Monitoring Data Backup and Recovery Disaster Recovery Plan System Documentation Contact Support Glossary of Terms
Intel-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Core i7-6700K/7700 Server | 64 GB DDR4, NVMe SSD 2 x 512 GB | CPU Benchmark: 8046 |
| Core i7-8700 Server | 64 GB DDR4, NVMe SSD 2x1 TB | CPU Benchmark: 13124 |
| Core i9-9900K Server | 128 GB DDR4, NVMe SSD 2 x 1 TB | CPU Benchmark: 49969 |
| Core i9-13900 Server (64GB) | 64 GB RAM, 2x2 TB NVMe SSD | |
| Core i9-13900 Server (128GB) | 128 GB RAM, 2x2 TB NVMe SSD | |
| Core i5-13500 Server (64GB) | 64 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Server (128GB) | 128 GB RAM, 2x500 GB NVMe SSD | |
| Core i5-13500 Workstation | 64 GB DDR5 RAM, 2 NVMe SSD, NVIDIA RTX 4000 |
AMD-Based Server Configurations
| Configuration | Specifications | Benchmark |
|---|---|---|
| Ryzen 5 3600 Server | 64 GB RAM, 2x480 GB NVMe | CPU Benchmark: 17849 |
| Ryzen 7 7700 Server | 64 GB DDR5 RAM, 2x1 TB NVMe | CPU Benchmark: 35224 |
| Ryzen 9 5950X Server | 128 GB RAM, 2x4 TB NVMe | CPU Benchmark: 46045 |
| Ryzen 9 7950X Server | 128 GB DDR5 ECC, 2x2 TB NVMe | CPU Benchmark: 63561 |
| EPYC 7502P Server (128GB/1TB) | 128 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/2TB) | 128 GB RAM, 2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (128GB/4TB) | 128 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/1TB) | 256 GB RAM, 1 TB NVMe | CPU Benchmark: 48021 |
| EPYC 7502P Server (256GB/4TB) | 256 GB RAM, 2x2 TB NVMe | CPU Benchmark: 48021 |
| EPYC 9454P Server | 256 GB RAM, 2x2 TB NVMe |
Order Your Dedicated Server
Configure and order your ideal server configurationNeed Assistance?
⚠️ *Note: All benchmark scores are approximate and may vary based on configuration. Server availability subject to stock.* ⚠️