• obbeel
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 months ago

    According to huggingface, you can run a 34B model using 22.4GBs of RAM max. That’s a RTX 3090 Ti.