Technology fan, Linux user, gamer, 3D animation hobbyist

Also at:

linuxfan@tube.tchncs.de

linuxfan@cheeseburger.social

  • 15 Posts
  • 78 Comments
Joined 11 months ago
cake
Cake day: July 24th, 2023

help-circle


  • At least the article points out that this is a Wall Street valuation, meaning it’s meaningless in reality, the company doesn’t have that much money, nor is it actually worth that much. In reality, Nvidia’s tangible book value (plant, equipment, brands, logos, patents, etc.) is $37,436,000,000.

    $37,436,000,000 / 29,600 employees = $1,264,729.73 per employee

    Which isn’t bad considering the median salary at Nvidia is $266,939 (up 17% from last year).










  • Probably better to ask on !localllama@sh.itjust.works. Ollama should be able to give you a decent LLM, and RAG (Retrieval Augmented Generation) will let it reference your dataset.

    The only issue is that you asked for a smart model, which usually means a larger one, plus the RAG portion consumes even more memory, which may be more than a typical laptop can handle. Smaller models have a higher tendency to hallucinate - produce incorrect answers.

    Short answer - yes, you can do it. It’s just a matter of how much RAM you have available and how long you’re willing to wait for an answer.