An exploration of using Claude Code to develop a Google Nest Hub-like device with an ESP32-P4, highlighting the challenges and limitations of AI-assisted development for niche hardware.
Pixlpal is a hackable, ESP32-S3-based desktop device with an 11.25-inch LED matrix, high-fidelity audio, and Home Assistant integration, designed to be a smart AIoT desktop companion.
This article details 7 ESPHome projects that enhance smart home functionality, including washing machine state detection, water leak detection, presence detection, Bluetooth proxy, custom smart speakers, cheap yellow displays, and ePaper dashboards.
The author details their journey from commercial smart speakers like Google Nest and Amazon Echo to building custom open-source voice assistants using ESP32-based hardware, ESPHome, and Home Assistant, highlighting benefits like privacy, control, and cost savings.
The series of articles by Adam Conway discusses how the author replaced cloud-based smart assistants like Alexa with a local large language model (LLM) integrated into Home Assistant, enabling more complex and private home automations.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
AI-On-The-Edge-Cam is an ESP32-S3 board with a 2MP camera, microSD card, WiFi, BLE, and PoE Ethernet connectivity designed to digitize legacy utility meters such as water meters, gas meters, or electricity meters that require manual onsite reading. It supports Tensorflow Lite, has a web interface, and integrates with Home Assistant.
