MegaTrain Full Precision Training of 100B+ Parameter LLMs on a Single GPU

1 points | by adulau 10 hours ago