OpenClaw is an open-source project that allows you to turn a Raspberry Pi into a capable AI agent. It provides a framework for connecting large language models (LLMs) to physical sensors and actuators, enabling the Pi to interact with the real world. This article details how to set up OpenClaw, including installing the necessary software, configuring the LLM, and connecting sensors like a microphone and camera. It also explores potential applications, such as home automation, robotics, and environmental monitoring.
OpenClaw is an open-source project that allows you to turn a Raspberry Pi into an AI agent capable of interacting with the world through a microphone and speaker. It uses Whisper for speech-to-text, OpenAI's GPT for reasoning, and Coqui TTS for text-to-speech. This setup enables the Pi to respond to voice commands and perform tasks, offering a customizable and privacy-focused alternative to closed AI assistants.
This article details a $30 ESP32-based room mapper built with a Time-of-Flight sensor and IMU. It features 64-zone 3D visualization, real-time orientation tracking, temporal filtering, plane fitting, and a mapping mode. The project is breadboard-based and doesn't require soldering, but relies on an IMU for heading, which can cause inaccuracies if the device is moved.
Build a voice-controlled AI assistant using an ESP32, Xiaozhi and MCP. This project focuses on safe hardware and software automation through the Model Context Protocol.
Pixlpal is a hackable, ESP32-S3-based desktop device with an 11.25-inch LED matrix, high-fidelity audio, and Home Assistant integration, designed to be a smart AIoT desktop companion.
An introduction to the ESP32 microcontroller for IoT projects, covering MicroPython and Arduino IDE programming.
The series of articles by Adam Conway discusses how the author replaced cloud-based smart assistants like Alexa with a local large language model (LLM) integrated into Home Assistant, enabling more complex and private home automations.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
Smart plugs are an affordable and easy way to automate your home. Here's why they're the most useful smart home device you can buy.
This article explains how MQTT (Message Queuing Telemetry Transport) can be used to create a more streamlined and organized smart home by enabling local communication between devices, reducing reliance on cloud services, and simplifying automation.
Moondream transforms the humble Raspberry Pi into a context-aware visual interpreter, capable of answering nuanced questions about images in plain English. This guide explores its potential for home automation, security analysis, and more.