1推荐信号
1讨论来源
2024-03-08最近提及
为什么 HN 用户提到它？
自动整理的讨论摘录，保留原始英文。阅读原文了解完整语境。
Lit-GPT is what I have been using to pretrain models at home: https://github.com/Lightning-AI/litgpt https://github.com/Lightning-AI/litgpt Using the openwebtext example, I can train a 700M param model to 2.6 loss in a few days on dual 4090s.阅读完整讨论