A voice-controlled AI chatbot powered by an ESP32 is housed inside a toy astronaut, offering a cute and displayable design.
This article details 7 ESPHome projects that enhance smart home functionality, including washing machine state detection, water leak detection, presence detection, Bluetooth proxy, custom smart speakers, cheap yellow displays, and ePaper dashboards.
The author details their journey from commercial smart speakers like Google Nest and Amazon Echo to building custom open-source voice assistants using ESP32-based hardware, ESPHome, and Home Assistant, highlighting benefits like privacy, control, and cost savings.
The series of articles by Adam Conway discusses how the author replaced cloud-based smart assistants like Alexa with a local large language model (LLM) integrated into Home Assistant, enabling more complex and private home automations.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
