this post was submitted on 16 Apr 2024
82 points (95.6% liked)
Apple
20410 readers
1 users here now
Welcome
to the largest Apple community on Lemmy. This is the place where we talk about everything Apple, from iOS to the exciting upcoming Apple Vision Pro. Feel free to join the discussion!
Rules:
- No NSFW Content
- No Hate Speech or Personal Attacks
- No Ads / Spamming
Self promotion is only allowed in the pinned monthly thread
Communities of Interest:
Apple Hardware
Apple TV
Apple Watch
iPad
iPhone
Mac
Vintage Apple
Apple Software
iOS
iPadOS
macOS
tvOS
watchOS
Shortcuts
Xcode
Community banner courtesy of u/Antsomnia.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That's what they all say. But a lot of these so called AI features require power more than what a phone has. Offloading to a server is sometimes a must.
Quantised models can be surprisingly small. And if Apple aren’t targeting LLMs for local use, more specific/tailored models absolutely can run on device.
That said, given the precedent sent by Siri, their next progression of Siri into an LLM will absolutely require network connection and be executed server side.
Samsung's version on One UI 6.1 lets you toggle between running the local models on the phone's NPU versus connecting to their servers.
The local version is slightly slower and produces worse results, but can be used for privacy or without the internet. The remote version is what you'd expect.
The thing is, these AI features are just features already present in some way or another, just emphasizing content generation and slapping AI branding.
Sure if you're running large models like gpt, smaller models tailored to specific use cases can absolutely run on phones. Whether or not they get there implementation down right is a different story though