vLLM-iOS: 88% Faster Multi-Agent Inference on iOS

4 comments

• mips_avatar 11 hours ago

  Direct link to the repo on github: https://github.com/jonready/vllm-ios

• maestroquirk 11 hours ago

  super cool project! bravo!

  [-]
  • mips_avatar 11 hours ago

    Thanks! It was really cool to work a layer deeper in the stack

• ‍ 11 hours ago
  [deleted]