DISCOVERED IN HACKER NEWS
Litgpt
Litgpt: a product linked in Hacker News recommendation discussions.
Artificial intelligence
1Recommendation signals
1Sources
2024-03-08Latest mention
Why does HN talk about it?
Automatically selected excerpts in their original language. Read the full discussion for context.
Lit-GPT is what I have been using to pretrain models at home: https://github.com/Lightning-AI/litgpt https://github.com/Lightning-AI/litgpt Using the openwebtext example, I can train a 700M param model to 2.6 loss in a few days on dual 4090s.Read the full discussion