Spanda: Sub-microsecond LLM epistemic uncertainty in Rust

7 comments

• yoiamrocking 8 hours ago

  1.5 ms latency is really great!

  [-]
  • liquidngas 8 hours ago

    [dead]

• amanasmeen 9 hours ago

  great work!!!

• ‍ 9 hours ago
  [deleted]
• liquidngas 9 hours ago

  [dead]

  [-]
  • Bhupennayak 9 hours ago

    [dead]

• liquidngas 9 hours ago

  [dead]