solhost/gpt2-300m-climbmix-pretrain
Text Generation • 0.3B • Updated
🖕 fuck yall never releasing gtm 3.5
solhost
solhost
AI & ML interests
making agi SLMs
Recent Activity
updated a model 1 day ago
solhost/gpt2-300m-climbmix-pretrain published a model 2 days ago
solhost/gpt2-300m-climbmix-pretrain updated a collection 6 days ago
GTMOrganizations
updated a
model 1 day ago
published a
model 2 days ago
updated a
collection 6 days ago
Hugging Science is DEAD???
➕ 2
38
#2 opened 28 days ago
by 
XBFDI
updated a
Space 26 days ago
Checkpoint stores an untied lm_head: 154.9M params on disk vs 119.4M on the card
2
#1 opened about 1 month ago
by 
Compactbot
reacted to Datdanboi25's post with ❤️🔥 about 1 month ago
Post
3,592
THE SLM FRONTIER ADVANCES!
bench-labs/cagliostro-v3 just hit an Intelligence Index of 26.13 on the AxiomicLabs/Open_SLM_Leaderboard a 146M-param model trained completely from scratch on a single consumer GPU. That's 2nd place overall, and as far as I can tell, the most capable SLM trained on consumer hardware to date. Beating SmolLM-135m on 1/8th of the data is just silly levels of efficiency.
Big congrats to the @BenchLabs team and specifically @TobiasLogic !
bench-labs/cagliostro-v3 just hit an Intelligence Index of 26.13 on the AxiomicLabs/Open_SLM_Leaderboard a 146M-param model trained completely from scratch on a single consumer GPU. That's 2nd place overall, and as far as I can tell, the most capable SLM trained on consumer hardware to date. Beating SmolLM-135m on 1/8th of the data is just silly levels of efficiency.
Big congrats to the @BenchLabs team and specifically @TobiasLogic !
- 6 replies
AI needs to get freed from a few corporations that basically control the entire industry
reacted to NitrAI's post with ❤️ about 1 month ago
Post
1,872
My (really ugly) thoughts on NVIDIA acquiring Hugging Face
I don’t care if you love me or hate me – something about one of the most open community efforts ever to achieve the tagline “The community building the future“ getting gobbled up by a company that arguably is the biggest hardware monopoly that has ever existed strikes me as deeply unsettling. I don’t like monopolies, and that is that. The whole appeal of HF for me personally was always having a neutral location where anyone could develop, deploy, and test a model on their silicon of choice without being pushed into a single “official“ proprietary infrastructure stack.
I am not going to pretend that I would believe NVIDIA “open and independent“ is ever going to happen – hell we have all heard the same lines dozens of times from every corporation that has ever uttered them before.
When the single biggest producer of compute also is one of the primary locations where all open weights live, it becomes very hard not to imagine where all of this is going to end up soon enough if we continue to let companies dictate the narrative. It might be the hyperbole but it is an absolute truth for me – open-sourced AI cannot be a slave to the whims of a trillion dollar company. It is high time we realize that open AI cannot live and breathe only on the goodwill of corporate entities.
I don’t care if you love me or hate me – something about one of the most open community efforts ever to achieve the tagline “The community building the future“ getting gobbled up by a company that arguably is the biggest hardware monopoly that has ever existed strikes me as deeply unsettling. I don’t like monopolies, and that is that. The whole appeal of HF for me personally was always having a neutral location where anyone could develop, deploy, and test a model on their silicon of choice without being pushed into a single “official“ proprietary infrastructure stack.
I am not going to pretend that I would believe NVIDIA “open and independent“ is ever going to happen – hell we have all heard the same lines dozens of times from every corporation that has ever uttered them before.
When the single biggest producer of compute also is one of the primary locations where all open weights live, it becomes very hard not to imagine where all of this is going to end up soon enough if we continue to let companies dictate the narrative. It might be the hyperbole but it is an absolute truth for me – open-sourced AI cannot be a slave to the whims of a trillion dollar company. It is high time we realize that open AI cannot live and breathe only on the goodwill of corporate entities.
- 11 replies
upvoted an article about 1 month ago
Article
DAVIDAU DELETED MY POST AND BANNED ME FOR ASKING ABOUT BENCHMARKS — HERE IS THE FULL ANALYSIS (9B + 27B + 390 MODELS)
DedeProGames
• • 22 Add GTM-3-base
#148 opened about 1 month ago
by solhost
liked a
model about 1 month ago
updated a
model about 1 month ago
published a
model about 1 month ago
liked a
Space about 1 month ago
liked a
model about 1 month ago