this post was submitted on 23 Jul 2024
3 points (63.6% liked)
Virtual Reality
1966 readers
2 users here now
Virtual Reality - Quest, PCVR, PSVR2, Pico, Mixed Reality, ect. Open discussion of all VR platforms, games, and apps.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
If you happen to have an iPhone and want to get a sense of how difficult to run are LLM on a mobile device, there’s a free app https://apps.apple.com/app/id6497060890 that allows just that. If your device has at least 8gb of memory then it will even show the most basic version of LLaMa (just text there), and since everything is done on device, you can even try it in airplane mode. Less meaningful would be running it on a computer, for that I suggest https://lmstudio.ai/ that is very easy to use.