This article details 7 lessons the author learned while self-hosting Large Language Models (LLMs), covering topics like the importance of memory bandwidth, quantization, electricity costs, hardware choices beyond Nvidia, prompt engineering, Mixture of Experts models, and starting with simpler tools like LM Studio.
Gotify is a notification server that pulls alerts from other applications and pushes them to its neat UI. It's a useful addition to a home lab setup, especially for monitoring self-hosted services like Uptime Kuma, TrueNAS Scale, and Proxmox.
The article discusses Apple Container, a new tool for running Linux containers on macOS, comparing its performance and efficiency to Docker Desktop. It highlights its ease of setup on Silicon Macs, compatibility with Dockerfiles, and potential as a lightweight alternative for home lab enthusiasts.
The author details their switch from Google Docs to Outline, a free and open-source collaborative editor, highlighting its simplicity, Slack integration, privacy features, and sufficient functionality for their needs, despite some missing features like advanced table creation and detailed version history.
This article details how to host a personal website using Docker, Nginx Proxy Manager, and Ghost, offering a self-hosted alternative to paid hosting services.
Huginn is presented as a robust, open-source alternative to IFTTT, offering greater customization, privacy through self-hosting, and the ability to handle complex workflows with API integrations. While it requires more technical expertise than IFTTT, it provides significantly more power and control.
Dusk OS is a 32-bit Forth operating system designed for simplicity and resilience in a post-collapse scenario, prioritizing 'power density' and hackability. It's self-hosting, boots from minimal resources, and features an 'almost C' compiler.
