Self-hosting provides a hands-on way to learn modern infrastructure, covering essential skills such as deployment, networking, storage, monitoring, and system reliability.
1. **Awesome Selfhosted**: A curated list of open-source applications across various service categories.
2. **Coolify**: An open-source PaaS for deploying apps, databases, and services on your own servers.
3. **n8n**: A visual workflow automation platform for connecting APIs and services.
4. **Uptime Kuma**: A monitoring system for tracking service uptime, status dashboards, and alerts.
5. **Nextcloud Server**: A private cloud platform for file synchronization, storage, and collaboration.
6. **Immich**: A self-hosted photo and video management and backup platform.
7. **Memos**: A lightweight Markdown note-taking tool with a timeline interface.
8. **Proxmox VE Helper Scripts**: Community scripts for managing LXC containers and VMs on Proxmox VE.
9. **Awesome Tunneling**: A curated list of tools for secure remote access to local services via tunneling.
10. **Self-Hosting Guide**: A comprehensive reference guide covering hardware, software, and infrastructure concepts.
1. **Awesome Selfhosted**: A curated list of open-source applications across various service categories.
2. **Coolify**: An open-source PaaS for deploying apps, databases, and services on your own servers.
3. **n8n**: A visual workflow automation platform for connecting APIs and services.
4. **Uptime Kuma**: A monitoring system for tracking service uptime, status dashboards, and alerts.
5. **Nextcloud Server**: A private cloud platform for file synchronization, storage, and collaboration.
6. **Immich**: A self-hosted photo and video management and backup platform.
7. **Memos**: A lightweight Markdown note-taking tool with a timeline interface.
8. **Proxmox VE Helper Scripts**: Community scripts for managing LXC containers and VMs on Proxmox VE.
9. **Awesome Tunneling**: A curated list of tools for secure remote access to local services via tunneling.
10. **Self-Hosting Guide**: A comprehensive reference guide covering hardware, software, and infrastructure concepts.
1. **Retrieval-Augmented Generation (RAG):** Ground responses in trusted, retrieved data instead of relying on the model's memory.
2. **Require Citations:** Demand sources for factual claims; retract claims without support.
3. **Tool Calling:** Use LLMs to route requests to verified systems of record (databases, APIs) rather than generating facts directly.
4. **Post-Generation Verification:** Employ a "judge" model to evaluate and score responses for factual accuracy, regenerating or refusing low-scoring outputs. Chain-of-Verification (CoVe) is highlighted.
5. **Bias Toward Quoting:** Prioritize direct quotes over paraphrasing to reduce factual drift.
6. **Calibrate Uncertainty:** Design for safe failure by incorporating confidence scoring, thresholds, and fallback responses.
7. **Continuous Evaluation & Monitoring:** Track hallucination rates and other key metrics to identify and address performance degradation. User feedback loops are critical.
2. **Require Citations:** Demand sources for factual claims; retract claims without support.
3. **Tool Calling:** Use LLMs to route requests to verified systems of record (databases, APIs) rather than generating facts directly.
4. **Post-Generation Verification:** Employ a "judge" model to evaluate and score responses for factual accuracy, regenerating or refusing low-scoring outputs. Chain-of-Verification (CoVe) is highlighted.
5. **Bias Toward Quoting:** Prioritize direct quotes over paraphrasing to reduce factual drift.
6. **Calibrate Uncertainty:** Design for safe failure by incorporating confidence scoring, thresholds, and fallback responses.
7. **Continuous Evaluation & Monitoring:** Track hallucination rates and other key metrics to identify and address performance degradation. User feedback loops are critical.
"Prove AI is a self-hosted solution designed to accelerate GenAI performance monitoring. It allows AI engineers to capture, customize, and monitor GenAI metrics on their own terms, without vendor lock-in. Built on OpenTelemetry, Prove AI connects to existing OpenTelemetry pipelines and surfaces meaningful metrics quickly.
Key features include a unified web-based interface for consolidating performance metrics like token throughput, latency distributions, and service health. It enables faster debugging, improved time-to-metric, and better measurement of GenAI ROI. The platform is open-source, free to deploy, and offers full control over telemetry data."
Key features include a unified web-based interface for consolidating performance metrics like token throughput, latency distributions, and service health. It enables faster debugging, improved time-to-metric, and better measurement of GenAI ROI. The platform is open-source, free to deploy, and offers full control over telemetry data."
This article details building end-to-end observability for LLM applications using FastAPI and OpenTelemetry. It emphasizes a code-first approach, manually designing traces, spans, and semantic attributes to capture the full lifecycle of LLM-powered requests. The guide advocates for a structured approach to tracing RAG workflows, focusing on clear span boundaries, safe metadata capture (hashing prompts/responses), token usage tracking, and integration with observability backends like Jaeger, Grafana Tempo, or specialized LLM platforms. It highlights the importance of understanding LLM behavior beyond traditional infrastructure metrics.
A single developer built a powerful search and monitoring tool for the web using a simple SQLite database and a clever bot, highlighting the potential of individual creators to tackle complex problems.
Stridetastic is an open-source monitoring and observability framework for Meshtastic® LoRa mesh networks. It helps operators capture, inject, and visualize mesh network data.
A Raspberry Pi 5 can transform a home network into a faster, safer, and easier-to-manage system by consolidating DNS, VPN, and monitoring tools into a single, low-power machine.The author implemented Pi-hole (ad blocking & DNS), Unbound (recursive DNS resolver for privacy & speed), and WireGuard (secure VPN for remote access). For monitoring, tools Uptime Kuma, Netdata, or Prometheus with Grafana provide real-time insights into network performance and security.
Grafana and GitLab have released a new open-source solution that links GitLab CI/CD events into Grafana's observability stack via a serverless architecture, enabling real-time visibility and correlation between deploy events and performance metrics.
A step-by-step guide to catching real anomalies without drowning in false alerts.
This article details how the author created a dashboard to manage their self-hosted applications, focusing on the use of Homepage and its benefits for organization and access to service information.
