klotz: self-hosting*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. Rich Edmonds writes about transitioning from subscription-based smart home services like Ring to a self-hosted local NVR system using Frigate. By moving video storage and AI detection onto his own hardware instead of relying on third-party clouds, he eliminated annual fees while gaining greater control over privacy and data retention.

    - The author saved $85 per year by ditching Reolink ($35) and Ring ($50) subscriptions.
    - A self-hosted setup using an old PC with Frigate can provide much longer video retention than cloud services.
    - Building a custom NVR is not entirely free; the author's dedicated server consumes about 160 watts of power.
    - Home Assistant integration allows for advanced features like Alarmo and LLM vision analysis via local models.
  2. Ayush Pande writes about how his Proxmox server became more useful after he stopped treating LXCs as Docker containers. Coming from a Docker-only background, he initially tried to manage LXCs as ephemeral, single-app environments, but realized they are fundamentally system containers that run a full userland (systemd, SSH, cron) and require managing the underlying OS just like a lightweight VM. Once he shifted his approach, his home lab's utility improved significantly.
    - LXCs are system containers running a full userland, unlike Docker's single-process application containers
    - Proxmox developers do not recommend Docker-in-LXC; live migration can break nested container environments
    - VMs are the preferred Docker hosts from a security standpoint
    - On low-spec hardware (e.g., a decade-old laptop), Docker-in-LXC can still make the box usable for experimental services
  3. Ayush Pande writes about utilizing a cheap Poco M6 Pro as a portable Docker host via Podroid, running four containers—IT-Tools, Omni-Tools, ConvertX, and BentoPDF—that provide developer utilities, everyday productivity tools, universal file conversion, and local PDF editing. The setup gives him on-the-move access to tools his home lab servers can't reach when he's away from them.

    - Containers relying on system ports won't work on unrooted phones
    - Jellyfin, Nextcloud, and Calibre-web are suggested as heavier alternatives for those without a home lab
    - ConvertX handles videos, 3D models, and phone contacts in addition to documents and images
    - Tailscale provides remote access to his dedicated x86 server rigs
  4. Anurag Singh describes how he integrated a self-hosted large language model into his home server monitoring workflow to bridge the gap between simple uptime checks and deep troubleshooting. By granting a dedicated service account access to systemd journals via n8n, the LLM can interpret complex error logs when an automated alert is triggered, providing specific context on why a service failed rather than just noting that it is down.

    - The LLM uses tools exposed by n8n to check service status, memory, storage, and listening ports without having general terminal access.
    - To maintain security, container logs are routed through the system journal so they can be inspected via restricted log tools.
    - Troubleshooting and actual remediation (like restarts) are kept in separate workflows to prevent the model from making unauthorized changes.
  5. Bryan Cockfield writes about the Kiwix open-source project, which started as an offline backup for Wikipedia and now includes other sites like StackExchange.To preserve and serve information from personal hardware, ensuring survival through internet outages and website disappearances, Kiwix is available on Linux (Docker compatible), Windows, Android, and Apple platforms.

    - A separate tool called Zimit is required to generate the .zim archive files that Kiwix serves.
    The Kiwix organization hosts pre-downloaded .zim files of common sites, sparing users from crawling Wikipedia themselves, a task that could take months on limited consumer hardware.
    - The article points to a prior piece on building an "armageddon-proof" Raspberry Pi briefcase as suggested hosting hardware.
  6. Ayush Pande writes that he repurposed an old Poco M6 Pro into a portable self-hosted server using Podroid instead of rooting, running an Alpine Linux VM with Docker and Podman to host FOSS apps on the go while avoiding the limitations of Termux and PRoot. He accepts caveats like no privileged ports under 1024, making services like Pi-hole unusable, but can otherwise run containers such as ConvertX, BentoPDF, n8n and BeaverHabits from his phone.

    - Podroid runs a full Alpine Linux VM with Docker, Podman and LXCs preinstalled
    - Port forwarding requires `podroid-forward add android_port vm_port` as system ports are blocked
    - Phone is Poco M6 Pro 4G with MediaTek chipset and no actively maintained custom ROMs
    - Rooting avoided via Shizuku + Canta for debloating to prevent bricking
    - VM uses 2-4 GB RAM and 4 CPU cores with USB passthrough, SSH, shared Downloads folder, X11 desktop and backup facility
  7. The author examines the trade-offs between running large language models via Ollama versus llama.cpp's WebUI. While Ollama is celebrated for its user-friendly interface and effortless model management, it introduces a small performance overhead by acting as an abstraction layer over the inference engine. In contrast, llama.cpp provides faster generation speeds and highly granular control over hardware offloading and sampling parameters. Although llama.cpp requires more manual effort to launch and switch models, it is preferred for users seeking maximum performance and technical customization.

    * Performance comparison of local LLM inference
    * Comparison of user experience versus technical control
    * Evaluation of abstraction overhead in AI tools
    2026-07-12 Tags: , , , , , by klotz
  8. Google's release of Gemma 4 marks a major turning point for open-source AI, offering a versatile family of multimodal models under a permissive Apache 2.0 license. Built using Gemini 3 technology, these models demonstrate massive leaps in math and coding performance, rivaling much larger proprietary systems while remaining efficient enough to run on local hardware ranging from smartphones to high-end GPUs. This release positions Google as a formidable competitor in the open-weights ecosystem, prioritizing user ownership and deployment efficiency.

    * Apache 2.0 license
    * Multimodal intelligence
    * Local hardware deployment
    * Massive benchmark leaps
    * Efficient MoE architecture

    **Models**
    * E2B: Mobile efficiency
    * E4B: Edge specialist
    * 26B MoE: Speed meets intelligence
    * 31B Dense: Top-tier performance
  9. This article explores how to integrate local Large Language Models (LLMs) with Docker environments using the Model Context Protocol (MCP). By setting up an MCP server, users can enable LLMs to execute container management tasks such as monitoring health, listing volumes, and deploying new services through natural language prompts. The author demonstrates how a high-end MoE model can handle complex instructions, even troubleshooting configuration errors autonomously.
    Main points:
    - Model Context Protocol (MCP) functions as a bridge between LLMs and external tools.
    - Implementation details for the mcp-server-docker package.
    - Hardware and model specifications (Qwen3.6-35B-A3B on RTX 3080 Ti).
    - Examples of automated deployments for n8n and BentoPDF.
    - Security measures for restricting dangerous LLM actions.
  10. The author examines the practical benefits of self-hosting large language models locally on powerful hardware like an NVIDIA RTX 5090 rather than subscribing to cloud services such as Claude or Codex. Through testing, it was found that running Qwen 3.6 27B provides a capable coding assistant for tasks like bug detection and data parsing while maintaining complete data privacy and avoiding recurring subscription fees or changing API pricing models.
    * Privacy advantages of keeping all processing on-device
    * Cost efficiency through one-time hardware investment versus monthly cloud subscriptions
    * Performance parity between local Qwen 3.6 and frontier models like Claude Opus for coding tasks
    2026-06-26 Tags: , , , , by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: self-hosting

About - Propulsed by SemanticScuttle