homeassistant

15814 readers

6 users here now

Home Assistant is open source home automation that puts local control and privacy first.
Powered by a worldwide community of tinkerers and DIY enthusiasts.

Home Assistant can be self-installed on ProxMox, Raspberry Pi, or even purchased pre-installed: Home Assistant: Installation

Discussion of Home-Assistant adjacent topics is absolutely fine, within reason.
If you're not sure, DM @GreatAlbatross@feddit.uk

founded 2 years ago

MODERATORS

GreatAlbatross@feddit.uk

greatalbatross@lemmy.world

Can Ollama integration also search the web? (lemmy.thewooskeys.com)

submitted 2 weeks ago by mike_wooskey@lemmy.thewooskeys.com to c/homeassistant@lemmy.world

4 comments fedilink hide all child comments

I recently integrated self-hosted Ollama with Home Assistant and it's pretty cool.

I'd like to also be able to ask the Home Assistant Assist things like "What movies are playing in MyCity?" and have the model in Ollama search the web and summarize the results. I use Open-WebUI as a frontend for Ollama and it can do that, but I can't see how configure HA's Assist to do it.

Has anyone done this?

Another example would be to ask "what's the weather today?", and I realize that HA has a weather integration built in and thus I wouldn't need Ollama to search the web for results. Is there a web search integration for HA, so that any question (like "what movies are playing") could be passed to it?

My ultimate goal is to be able to ask questions about the world (i.e., search the web and summarize the results) and control Home Assistant devices. It doesn't have to be HA's Assist, but if I were to use Open-WebUI* for example, I'd have to come up with a way to link my audio-listening devices to it. It also doesn't have to be one "entity", but it should "feel like" one entity to the user (i.e., I don't want to have to speak to a different device or have a different wakeword to ask about the world than I do to control Home Assistant).

*Open-WebUI has integrations to control Home Assistant.

you are viewing a single comment's thread
view the rest of the comments

[–] mike_wooskey@lemmy.thewooskeys.com 1 points 2 weeks ago

Thanks for the explanations, @Scrubbles@poptalk.scrubbles.tech.

I introduced myself to tools/functions in Open-WebUI: there is a community library of tools/functions and you can essentially copy/paste them into Open-WebUI and then they're available there. If I understand correctly, tools add functionality to models and functions add functionality to Open-WebUI.

I'm still confused, though: if I add a web search tool to Open-WebUI (some do exist), I would guess that it could only ever add functionality to the model if I access the model through Open-WebUI - but HA is accessing the model directly through Ollama.