FLOSS virtualization hacker, occasional brewer

  • 0 Posts
  • 4 Comments
Joined 3 years ago
cake
Cake day: June 9th, 2023

help-circle


  • I don’t doubt that locally hostable models will be important for agentic tasks but I suspect they are still going to be bigger than most can comfortably host for time being. I still think there will be a place for the super large models for more complex reasoning although how much will be due to the intrinsic knowledge in the weights and how much due to the plumbing around them remains too be seen.

    And if course LLM’s are not going to be the end point of the search for AGI. Whatever their architecture they will still need copious amounts of compute.