8·
16 days agohttps://github.com/AtomicBot-ai/atomic-llama-cpp-turboquant
I’m running gwen 3.6 with 131k context window on a 3090, it’s fast enough and about as good as pay to play Claude at work.
- 1 Post
- 3 Comments
Joined 3 years ago
Cake day: July 3rd, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
No wonder it’s such shit.
I plan to once there is a version with turboquant and MTP as that huge context window is key.