This article explains how to set up a Home Assistant voice assistant that mimics GLaDOS's voice and personality, using add-ons like Whisper and Piper for speech synthesis and recognition.
This article details how to set up a custom voice pipeline in Home Assistant using free self-hosted tools like Whisper and Piper, replacing cloud-based services for full control over speech-to-text and text-to-speech processing.
The series of articles by Adam Conway discusses how the author replaced cloud-based smart assistants like Alexa with a local large language model (LLM) integrated into Home Assistant, enabling more complex and private home automations.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
1. **Use a Local LLM**: Set up an LLM (like Qwen) locally using tools such as Ollama and OpenWeb UI.
2. **Integrate with Home Assistant**:
- Enable Ollama integration in Home Assistant.
- Configure the IP and port of the LLM server.
- Select the desired model for use within Home Assistant.
3. **Voice Processing Tools**:
- Use **Whisper** for speech-to-text transcription.
- Use **Piper** for text-to-speech synthesis.
4. **Smart Home Automation**:
- Automate complex tasks like turning off lights and smart plugs with voice commands.
- Use data from IP cameras (via Frigate) to control external lighting based on presence.
5. **Hardware Recommendations**:
- Use Home Assistant Voice Preview speaker or DIY alternatives using ESP32 or repurposed microphones.
Stream Assist is a Home Assistant integration that allows users to turn almost any camera and speaker into a local voice assistant, offering privacy and customization benefits over commercial solutions like Alexa or Nest. It uses components like Stream, Assist pipeline, openWakeWord, Whisper, and Piper to process voice commands and control smart home devices.
The author details their transition from Google Home to Home Assistant with a local LLM, highlighting the benefits of increased control, customization, and functionality. They discuss using Home Assistant's 'Okay Nabu' voice control, experimenting with display solutions like tablets and ESP32 devices, and the advantages of integrating a local LLM for more contextual and powerful interactions.
