Update README with live fleet stats and current infrastructure counts

Reflects actual fleet state: 44 Ollama models, 173 TCP ports, 5/5 nodes,
stats API, analytics system, all websites pulling live data.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

RoadChain-SHA2048: fa7bff19fa8dbb3b
RoadChain-Identity: alexa@sovereign
RoadChain-Full: fa7bff19fa8dbb3b342cc14b1fab336102acdcf9125a71a7b272ed71984bed138241ed78fa4412f5349f17569558e9d3fea08fcfc8d8b14339e79aca5ed6f6c5bf541558f8536c4624d0125bc9768179e824f9124b9274ebc065464669aebf22c049d5aa3607cd5b0750b759223d985549427814305d16715cbdd86d81df7f8798df0f4dc1ea8296edeeecc2d6fb7399c89e2351213315c5b273a33d0bf111832b78f20c059e864e80937461af2a121b55a4c900d1d241c59759d63fc5c1309c3b37beb43242bcce1db2d35d249ec690e696558d77e76117060c442fabe14098e789953f0e1c1f4a3798668b762831530474aa9cb9a853dca0996b902cfd0901
This commit is contained in:
2026-03-13 17:06:50 -05:00
parent 892fa26f6d
commit 8843fe8e25

View File

@@ -1,56 +1,85 @@
# BlackRoad OS # BlackRoad OS
Self-hosted edge AI operating system running 52 TOPS of inference on Raspberry Pi clusters. Self-hosted edge AI operating system running 52 TOPS of inference across a 5-node Raspberry Pi cluster.
## What is BlackRoad OS? ## What is BlackRoad OS?
BlackRoad OS is a sovereign computing platform that runs AI inference, networking, and automation entirely on hardware you own. No cloud dependencies. No API keys expiring at 2am. Five Raspberry Pi 5 nodes connected by a WireGuard mesh network, accelerated by dual Hailo-8 NPUs, running 16 local models through Ollama. BlackRoad OS is a sovereign computing platform that runs AI inference, networking, and automation entirely on hardware you own. No cloud dependencies. No API keys expiring at 2am. Five Raspberry Pi 5 nodes connected by a WireGuard mesh network, accelerated by dual Hailo-8 NPUs, running 44 local models through Ollama.
The fleet self-heals. Cron-driven watchdogs monitor every service, restart what dies, and log what broke. Cloudflare tunnels route 48+ domains through the cluster. Docker Swarm orchestrates containers across nodes. Gitea hosts 200+ repositories on a 1TB NVMe. The fleet self-heals. Cron-driven watchdogs monitor every service, restart what dies, and log what broke. A stats API collects live telemetry from every node every 5 minutes — CPU temp, RAM, disk, services, model counts — and serves it to all BlackRoad websites in real time. Cloudflare tunnels route 48+ domains through the cluster. Docker Swarm orchestrates containers across nodes. Gitea hosts 207 repositories on a 1TB NVMe.
This is infrastructure that runs in a closet and serves production traffic. This is infrastructure that runs in a closet and serves production traffic.
## Infrastructure ## Live Fleet Status
| Node | Role | Hardware | Real-time data from the stats API (updated every 5 minutes):
|------|------|----------|
| **Alice** | Gateway, DNS, ingress | Pi 400, Pi-hole, PostgreSQL, Qdrant, 65+ tunnel routes |
| **Cecilia** | AI inference, TTS | Pi 5, Hailo-8 (26 TOPS), 16 Ollama models, MinIO |
| **Octavia** | Git, orchestration | Pi 5, Hailo-8 (26 TOPS), 1TB NVMe, Gitea, Docker Swarm leader |
| **Aria** | Container management | Pi 5, Portainer, Headscale |
| **Lucidia** | Apps, CI/CD | Pi 5, GitHub Actions runner, FastAPI, 334 web apps |
**Network:** WireGuard mesh (10.8.0.x) with Anastasia (DigitalOcean) as hub. RoadNet WiFi overlay across all nodes. | Node | Role | Hardware | Key Services |
|------|------|----------|-------------|
| **Alice** | Gateway, DNS, ingress | Pi 400 | Pi-hole, PostgreSQL, Qdrant, Nginx, 65+ tunnel routes |
| **Cecilia** | AI inference, TTS | Pi 5, Hailo-8 (26 TOPS) | 15 Ollama models, CECE API, TTS, MinIO, PostgreSQL |
| **Octavia** | Git, orchestration, AI | Pi 5, Hailo-8 (26 TOPS), 1TB NVMe | 11 Ollama models, Gitea, Docker Swarm, NATS |
| **Aria** | Container management | Pi 5 | 6 Ollama models, Portainer, Headscale |
| **Lucidia** | Apps, CI/CD | Pi 5, 238GB SD | 6 Ollama models, GitHub Actions, FastAPI, CarPool, PowerDNS |
**Network:** WireGuard mesh (10.8.0.x) with Anastasia (DigitalOcean NYC) as hub. RoadNet WiFi overlay (5 APs, dedicated subnets).
## By the Numbers
| Metric | Count |
|--------|-------|
| Edge nodes | 5 Raspberry Pis |
| AI compute | 52 TOPS (2x Hailo-8) |
| Ollama models | 44 across fleet |
| TCP listening ports | 173 |
| Cloudflare tunnels | 18 (100 hostnames) |
| Custom domains | 48+ |
| Pages sites | 95 |
| D1 databases | 8 |
| KV namespaces | 40 |
| R2 buckets | 10 |
| Gitea repos | 207 |
| GitHub repos | 115 (non-fork) |
| SQLite databases | 228 |
| Shell scripts | 92 |
| Cron jobs | 13 automated tasks |
## Stack ## Stack
| Component | What it does | | Component | What it does |
|-----------|-------------| |-----------|-------------|
| **Hailo-8** | 52 TOPS combined neural network inference (2x 26 TOPS) | | **Hailo-8** | 52 TOPS combined neural network inference (2x 26 TOPS) |
| **Ollama** | 16 local LLMs including 4 custom CECE models | | **Ollama** | 44 local LLMs including custom CECE models |
| **WireGuard** | Encrypted mesh VPN across all nodes + cloud | | **WireGuard** | Encrypted mesh VPN across all nodes + cloud |
| **Pi-hole** | Fleet-wide DNS filtering and custom zones | | **Pi-hole** | Fleet-wide DNS filtering (76,456 blocked domains) |
| **Docker Swarm** | Container orchestration across the cluster | | **Docker Swarm** | Container orchestration across the cluster |
| **Gitea** | Self-hosted Git with 207 repositories | | **Gitea** | Self-hosted Git with 207 repositories across 7 orgs |
| **NATS** | Lightweight messaging between services | | **NATS** | Lightweight messaging between services |
| **RoadC** | Custom programming language with Python-style indentation | | **RoadC** | Custom programming language with Python-style indentation |
| **Cloudflare** | 18 tunnels, 48+ domains, D1/KV/R2 storage | | **Cloudflare** | 18 tunnels, 95 Pages, D1/KV/R2 storage, Workers |
| **Stats API** | Live fleet telemetry via Cloudflare Worker + KV |
| **Analytics** | Sovereign, cookie-free event capture via Worker + D1 |
## Read More ## Observability
Articles on building and running this infrastructure: Every BlackRoad website pulls live data from the stats API — no hardcoded numbers. The collector script SSHes into all 5 nodes every 5 minutes and pushes:
- [Self-Healing Infrastructure in Production](https://blackroad.io/blog/self-healing-infrastructure) — How the fleet detects, diagnoses, and fixes issues without human intervention - CPU temperature, usage, RAM, disk
- [Building with Local AI Models](https://blackroad.io/blog/building-with-local-ai) — Running 16 Ollama models on sovereign hardware with Hailo-8 acceleration - Ollama model counts and service status
- [Why We Chose Cloudflare + Raspberry Pi](https://blackroad.io/blog/why-we-chose-cloudflare-railway) — Edge architecture decisions for a self-hosted platform - Docker container counts and TCP port inventory
- [PS-SHA: Quantum-Resistant Memory](https://blackroad.io/blog/ps-sha-infinity) — Cryptographic hash function for persistent memory integrity - Service health (SSH, DNS, Ollama, Nginx, PostgreSQL, MinIO, Gitea, NATS, etc.)
- [Lessons from Scaling Autonomous Systems](https://blackroad.io/blog/building-30k-agents) — What broke and what held when pushing distributed agents to production
## Links Websites auto-refresh every 60 seconds. When a node goes down, every dashboard reflects it within 5 minutes.
- **[blackroad.io](https://blackroad.io)** — Main site ## Sites
- **[blackroad.io/blog](https://blackroad.io/blog)** — Technical blog
- **[git.blackroad.io](https://git.blackroad.io)** — Self-hosted Gitea | Site | Purpose |
|------|---------|
| **[blackroad.io](https://blackroad.io)** | Main platform |
| **[blackroad.network](https://blackroad.network)** | Live mesh topology dashboard |
| **[blackroad.systems](https://blackroad.systems)** | Infrastructure status page |
| **[backlog.blackroad.io](https://backlog.blackroad.io)** | Engineering journal (35 articles) |
| **[git.blackroad.io](https://git.blackroad.io)** | Self-hosted Gitea |
## License ## License
@@ -60,9 +89,10 @@ Copyright 2026 BlackRoad OS, Inc. — Alexa Amundson. All rights reserved.
| Project | Description | | Project | Description |
|---------|-------------| |---------|-------------|
| [BlackRoad AI Dashboard](https://github.com/blackboxprogramming/blackroad-ai-dashboard) | Real-time AI fleet monitoring dashboard |
| [BlackRoad Desktop App](https://github.com/blackboxprogramming/blackroad-desktop-app) | Electron app for fleet management |
| [BlackRoad Chrome Extension](https://github.com/blackboxprogramming/blackroad-chrome-extension) | Browser extension for fleet monitoring |
| [Fleet Heartbeat](https://github.com/blackboxprogramming/fleet-heartbeat) | Distributed health monitoring system |
| [Lucidia](https://github.com/blackboxprogramming/lucidia) | Autonomous AI agent with persistent memory | | [Lucidia](https://github.com/blackboxprogramming/lucidia) | Autonomous AI agent with persistent memory |
| [RoadC](https://github.com/blackboxprogramming/roadc) | Custom programming language with indentation-based syntax |
| [Quantum Math Lab](https://github.com/blackboxprogramming/quantum-math-lab) | Mathematical proofs and quantum computing research |
| [Hailo Vision](https://github.com/blackboxprogramming/hailo-vision) | Computer vision with Hailo-8 AI accelerators | | [Hailo Vision](https://github.com/blackboxprogramming/hailo-vision) | Computer vision with Hailo-8 AI accelerators |
| [Fleet Heartbeat](https://github.com/blackboxprogramming/fleet-heartbeat) | Distributed health monitoring system |
| [BlackRoad API SDKs](https://github.com/blackboxprogramming/blackroad-api-sdks) | Python, Go, TypeScript SDKs for the BlackRoad API |
| [BlackRoad KPIs](https://github.com/blackboxprogramming/blackroad-os-kpis) | Daily fleet metrics collection and reporting |