🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to

LocalLLaMA@sh.itjust.worksEnglish · 2 months ago

How much gpu do i need to run a 90b model

13

How much gpu do i need to run a 90b model

🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to

LocalLLaMA@sh.itjust.worksEnglish · 2 months ago

Do i need industry grade gpu’s or can i scrape by getring decent tps with a consumer level gpu.

Chat

ALERT@sh.itjust.works
link
fedilink
English
arrow-up
3·
2 months ago
all of it

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
93 users / week
262 users / month
420 users / 6 months
4 local subscribers
2.62K subscribers
79 Posts
211 Comments
Modlog