LocalLLaMA

localllama@sh.itjust.works

PostsComments

noneabove1182@sh.itjust.worksMEnglish · 1 year ago

Beginner questions thread

0

2

Beginner questions thread

noneabove1182@sh.itjust.worksMEnglish · 1 year ago

0

llama@lemmy.dbzer0.comEnglish · 18 hours ago

How to run LLaMA (and other LLMs) on Android.

32

How to run LLaMA (and other LLMs) on Android.

llama@lemmy.dbzer0.comEnglish · 18 hours ago

OmegaLemmy@discuss.onlineEnglish · 3 days ago

What is a good model that runs on 6GB Vram?

11

What is a good model that runs on 6GB Vram?

OmegaLemmy@discuss.onlineEnglish · 3 days ago

ikt@aussie.zoneEnglish · 4 days ago

Mistral Small 3 (24B) released

1

5

Mistral Small 3 (24B) released

ikt@aussie.zoneEnglish · 4 days ago

1

artificialfish@programming.devEnglish · 4 days ago

Has anyone applied tree of thought prompting to r1 yet?

0

3

Has anyone applied tree of thought prompting to r1 yet?

artificialfish@programming.devEnglish · 4 days ago

0

ikt@aussie.zoneEnglish · 7 days ago

Did DeepSeek R1 just pop nvidias bubble?

www.youtube.com

0

1

Did DeepSeek R1 just pop nvidias bubble?

www.youtube.com

ikt@aussie.zoneEnglish · 7 days ago

0

Smokeydope@lemmy.worldEnglish · 8 days ago

Why llms are suprisingly good at math, and what it means to process language.

3

0

Why llms are suprisingly good at math, and what it means to process language.

Smokeydope@lemmy.worldEnglish · 8 days ago

3

Smokeydope@lemmy.worldEnglish · 10 days ago

Thoughts on new deepseek R1 distill models

0

1

Thoughts on new deepseek R1 distill models

Smokeydope@lemmy.worldEnglish · 10 days ago

0

brokenlcd@feddit.itEnglish · 23 days ago

unsure on how to quantize model

0

1

unsure on how to quantize model

brokenlcd@feddit.itEnglish · 23 days ago

0

🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.eeEnglish · 24 days ago

How much gpu do i need to run a 90b model

0

1

How much gpu do i need to run a 90b model

🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.eeEnglish · 24 days ago

0

Smokeydope@lemmy.worldEnglish · 25 days ago

Nvidia Digits AI Supercomputer just announced

0

1

Nvidia Digits AI Supercomputer just announced

Smokeydope@lemmy.worldEnglish · 25 days ago

0

Halo@lemmy.worldEnglish · 1 month ago

Go toolchain error - Does anyone know what's going on here?

0

1

Go toolchain error - Does anyone know what's going on here?

Halo@lemmy.worldEnglish · 1 month ago

0

hendrik@palaver.p3x.deEnglish · 1 month ago

(New) papers by Meta: Large Concept Models and BLT

0

1

(New) papers by Meta: Large Concept Models and BLT

hendrik@palaver.p3x.deEnglish · 1 month ago

0

BB84@mander.xyzEnglish · 1 month ago

New open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmark

0

0

New open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmark

BB84@mander.xyzEnglish · 1 month ago

0

hok@lemmy.dbzer0.comEnglish · 2 months ago

Can you fine-tune on localized steering of an LLM?

0

1

Can you fine-tune on localized steering of an LLM?

hok@lemmy.dbzer0.comEnglish · 2 months ago

0

mapumbaa@lemmy.zipEnglish · 2 months ago

Questions about HW for local LLM.

0

1

Questions about HW for local LLM.

mapumbaa@lemmy.zipEnglish · 2 months ago

0

HumanPerson@sh.itjust.worksEnglish · 2 months ago

Fixed it

sh.itjust.works

0

1

Fixed it

sh.itjust.works

HumanPerson@sh.itjust.worksEnglish · 2 months ago

0

hok@lemmy.dbzer0.comEnglish · 2 months ago

Llama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?

0

1

Llama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?

hok@lemmy.dbzer0.comEnglish · 2 months ago

0

projectmoon@lemm.eeEnglish · 2 months ago

OpenWebUI OpenStreetMap Tool 2.1.0

0

1

OpenWebUI OpenStreetMap Tool 2.1.0

projectmoon@lemm.eeEnglish · 2 months ago

0

lynx@sh.itjust.worksEnglish · 2 months ago

Qwen2.5-Coder-7B

0

1

Qwen2.5-Coder-7B

lynx@sh.itjust.worksEnglish · 2 months ago

0

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

34 users / day
93 users / week
95 users / month
95 users / 6 months
1 local subscriber
2.5K subscribers
51 Posts
31 Comments
Modlog

sh.itjust.works

A bilingual (EN/FR) general-purpose instance located in eastern Canada! Powered by 99% renewable energy! Everyone is welcome eh.

Useful Links

Rules:

Be respectful. Everyone should feel welcome here.
No bigotry - including racism, sexism, ableism, homophobia, transphobia, or xenophobia.
No Ads / Spamming.
No pornography.

Règles :

Soyez respectueux. Tout le monde doit se sentir le bienvenu ici.
Pas de bigoterie - y compris le racisme, le sexisme, le capacitisme, l’homophobie, la transphobie ou la xénophobie.
Pas de publicités / Pas de spam.
Pas de pornographie.

Fediseer

Other UI options (more to come)

Monitoring Services
lemmy-meter.info