Show HN: GPT-2 inference in pure C#, 0 bytes allocated per token

2 comments

• binyang_qiu 5 hours ago

  For me, the interesting part here isn't GPT-2, it's the memory discipline. I feel like most inference runtimes slowly leak allocations everywhere as features pile up.

• grelikt 12 hours ago

  [dead]