This is an automated archive made by the Lemmit Bot.

The original was posted on /r/homeassistant by /u/netixc1 on 2025-02-28 19:18:42+00:00.

I’ve integrated an open-source LLM with my Home Assistant setup and am curious what models others are using. What have you found works best for handling smart home commands?

Are there any models you’ve had particularly good or bad experiences with? Any recommendations for ones that understand natural language commands well?

Looking forward to your insights!

Update: for those who want to know my current setup

I have a Proxmox server with an LXC container running Docker. Inside, I have the following installed:

Text-to-Speech (TTS)

Kokoro-FastAPI – used for TTS.

• Model: Kokoro
• Voices: af_bella or a combination of af_bella+af_heart

Speech-to-Text (STT)

Speaches – used for STT.

• Model: Systran/faster-whisper-medium

Local LLM

Ollama – used for running a local LLM.

• Current model: qwen2.5coder-32B

Home Assistant Integration

Installed via HACS:

• TTS: OpenAI TTS Speech Service
• STT: OpenAI Whisper API
• LLM: Ollama Integration

Home Assistant Configuration

Add the following to configuration.yaml:

yamlCopyEditstt:
  - platform: openai_stt
    api_key: YOUR_API_KEY
    # Optional parameters
    api_url: https://192.168.xx.xx:8000/v1
    model: Systran/faster-whisper-medium
    prompt: ""
    temperature: 0