People are forgetting the AI hype train is reliant on the fact that businesses and individuals can’t host the AI themselves, which is rapidly changing.
All that insane power that OpenAI and Anthropic have harnessed is suddenly completely useless when you can just spin up a competing model at home, with HF hosting a crap ton of finetuned models like uncensored/abliterated to do whatever you want with it.
Even Deepseek released their full size models if you happen to have 400Gb (or 1.5Tb) of VRAM lying around.
When the bubble (hopefully) pops, AI will just continue to be a tool that devs use where applicable, and likely not on a massive data center cloud as it migrates into consumer electronics.
While that’s true, there’s a pretty good chance that it will be negatively useful for many programmers even after the AI bubble burst.
Also e-mail is much easier and cheaper to self-host than an LLM, yet most people relying on 3rd parties. Even some big pushers of yOU cAn JuST seLf-HosT cHiNEse lLM MoDels use corpo e-mail accounts.
Email is NOT easier to self-host than an LLM lol, it’s like multiple orders of magnitude more difficult. Set something up slightly wrong and your emails will never not be marked as spam because your server will be used to forward spam. An LLM for internal company usage you could just set up on a private network and never have to worry about someone else burning your GPU time.
People are forgetting the AI hype train is reliant on the fact that businesses and individuals can’t host the AI themselves, which is rapidly changing.
All that insane power that OpenAI and Anthropic have harnessed is suddenly completely useless when you can just spin up a competing model at home, with HF hosting a crap ton of finetuned models like uncensored/abliterated to do whatever you want with it.
Even Deepseek released their full size models if you happen to have 400Gb (or 1.5Tb) of VRAM lying around.
When the bubble (hopefully) pops, AI will just continue to be a tool that devs use where applicable, and likely not on a massive data center cloud as it migrates into consumer electronics.
While that’s true, there’s a pretty good chance that it will be negatively useful for many programmers even after the AI bubble burst.
Also e-mail is much easier and cheaper to self-host than an LLM, yet most people relying on 3rd parties. Even some big pushers of yOU cAn JuST seLf-HosT cHiNEse lLM MoDels use corpo e-mail accounts.
Email is NOT easier to self-host than an LLM lol, it’s like multiple orders of magnitude more difficult. Set something up slightly wrong and your emails will never not be marked as spam because your server will be used to forward spam. An LLM for internal company usage you could just set up on a private network and never have to worry about someone else burning your GPU time.
A humorous talk on the topic of self-hosting email, it’s pretty fun.
Getting SPF, DMARC, and DKIM working is such a pain. And that is only part of the mail security these days.
This is, like, one of a dozen major problems with LLM’s.
Are the other dozen “AI is awesome!!!” with varying number of exclamation marks at the end? 🤔
I think this is a much more sensible attitude than the pitchfork wavers declaring mandatory zero-tolerance or you’re evil.