Wilshire@lemmy.world to Technology@lemmy.worldEnglish · 2 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square61fedilinkarrow-up1213arrow-down117cross-posted to: tech@programming.dev
arrow-up1196arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comWilshire@lemmy.world to Technology@lemmy.worldEnglish · 2 months agomessage-square61fedilinkcross-posted to: tech@programming.dev
minus-squareobbeellinkfedilinkEnglisharrow-up2·1 month agoAccording to huggingface, you can run a 34B model using 22.4GBs of RAM max. That’s a RTX 3090 Ti.
According to huggingface, you can run a 34B model using 22.4GBs of RAM max. That’s a RTX 3090 Ti.