TextGen is an open-source desktop application designed for running large language models locally with complete privacy and zero telemetry. It provides a user interface and API that supports text, vision, tool-calling, and web search functionality. The software allows users to switch between multiple backends such as llama.cpp, Transformers, ExLlamaV3, and TensorRT-LLM without restarting the application.
Main topics:
Multimodal support for visual understanding via image attachments
OpenAI/Anthropic compatible API with tool-calling capabilities
Fine-tuning functionality for LoRAs on chat or raw text datasets
Integrated image generation using diffusers models
Support for various installation methods including portable builds and Docker
SearXNG is a free and open-source metasearch engine designed to prioritize user privacy. It aggregates results from over 250 search services without tracking or profiling users. It can be used directly through public instances like those listed on searx.space, or self-hosted for complete control.
Key features include optional script and cookie handling, secure encrypted connections, and a robust development process with CI/QA and automated UI testing. The project is community-driven, welcoming contributions of all kinds, from translation improvements to bug reports and code contributions. SearXNG originated as a fork of the Searx project in mid-2021.
OpenCode is an open source agent that helps you write code in your terminal, IDE, or desktop.
It features LSP enabled, multi-session support, shareable links, GitHub Copilot and ChatGPT Plus/Pro integration, support for 75+ LLM providers, and availability as a terminal interface, desktop app, and IDE extension.
With over 120,000 GitHub stars, 800 contributors, and over 5,000,000 monthly developers, OpenCode prioritizes privacy by not storing user code or context data.
It also offers Zen, a curated set of AI models optimized for coding agents.
AsteroidOS 2.0, a Linux-based open-source smartwatch operating system, has been released with features like always-on display, heart rate monitoring, and support for approximately 30 devices. It aims to provide a privacy-focused and environmentally responsible alternative for smartwatches.
The article discusses the growing trend of running Large Language Models (LLMs) locally on personal machines, exploring the motivations behind this shift โ including privacy concerns, cost savings, and a desire for technological sovereignty โ as well as the hardware and software advancements making it increasingly feasible.