n7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 10 months agoMeta AIimage.nostr.buildimagemessage-square10fedilinkarrow-up148arrow-down10
arrow-up148arrow-down1imageMeta AIimage.nostr.buildn7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 10 months agomessage-square10fedilink
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up1arrow-down1·edit-210 months agoThe quantized model you can run locally works decently and they can’t read any of it, which is nice. I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
minus-squarenialv7@lemmy.worldlinkfedilinkarrow-up0·10 months agoPretty sure LM studio is not open source
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up1·10 months agoYou’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.
The quantized model you can run locally works decently and they can’t read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
Pretty sure LM studio is not open source
You’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.