Extending Raschka's GPT-2: an MoE trained from scratch on an RTX 3090

1 points | by gpjt 7 hours ago