Zest is a UI that bundles Lemonade server (which installs llama.cpp and whatever backends are needed) and the Pi agent to provide a friendly interface for people who don't want to be messing around with command-line servers and parameters.
It comes and all the functionality needed for a new user without getting in the way. Just download an appimage, go through the start tour, and you're set up and ready to go. There are sane defaults baked in (like 128k context) and model recommendations (all tried and tested on 10GB VRAM to 26GB).
r/LocalLLaMA - Introducing Zest: model server + agent + friendly GUI
It comes with helpful docs, links to places to understand more about the subject - in short, everything needed for a new user. Model recommendations are based on my own testing on multiple machines with consumer GPUs - an old Xeon with two Radeon VIIs, a rig with a 4080 Super + a 3080, a rig with a venerable 1080. The goal is to present good choices for most hardware.
Entirely open-source, of course. If you have anyone you want to introduce to the world of local AI, please see if this is useful. And if you have ideas, suggestions - please open an issue, send a PR, and so on.
Why lemonade and Pi?
Lemonade: because it does a great job of handling backends and providing a server.
Pi: because it's a simple, elegant agent
Both are very easy to package in something like this and bring together. And because I'm lazy: both projects are receiving steady updates, because I don't want to write yet another inference server from scratch
What it isn't:
It's not for advanced users. There are jobs, but no subagents, for instance: in this case the Pi philosophy really helped.
In fact, I myself use Strata and Opencode, so for advanced users, it recommends those in the Help section
How is this different from Unsloth desktop / Atomic chat etc?
It isn't. It just tries to be a lot more lightweight and user-friendly: I decided to do this after getting said friend to download and set up llama.cpp, Unsloth Desktop, Opencode etc . . .
I noticed that at some point both choice paralysis and confusion with options just took over, and there was no easy way for them as a newcomer to figure out what x thing was really for. Every setting in Zest is explained. Including what inference engines do, the works.
Everything is explained at basic levels - what a model is, how it works, and so on. I've kept the lemonade + pi analogy while trying to make sure the interface was intuitive.
Hello, everyone. A friend of mine wanted to get into running local models, and so (with the liberal use of Claude), I built them Zest.
https://github.com/yudhanjaya/Zest
What it is:
Zest is a UI that bundles Lemonade server (which installs llama.cpp and whatever backends are needed) and the Pi agent to provide a friendly interface for people who don't want to be messing around with command-line servers and parameters.
It comes and all the functionality needed for a new user without getting in the way. Just download an appimage, go through the start tour, and you're set up and ready to go. There are sane defaults baked in (like 128k context) and model recommendations (all tried and tested on 10GB VRAM to 26GB).
r/LocalLLaMA - Introducing Zest: model server + agent + friendly GUI It comes with helpful docs, links to places to understand more about the subject - in short, everything needed for a new user. Model recommendations are based on my own testing on multiple machines with consumer GPUs - an old Xeon with two Radeon VIIs, a rig with a 4080 Super + a 3080, a rig with a venerable 1080. The goal is to present good choices for most hardware.
Entirely open-source, of course. If you have anyone you want to introduce to the world of local AI, please see if this is useful. And if you have ideas, suggestions - please open an issue, send a PR, and so on.
Why lemonade and Pi?
Lemonade: because it does a great job of handling backends and providing a server.
Pi: because it's a simple, elegant agent
Both are very easy to package in something like this and bring together. And because I'm lazy: both projects are receiving steady updates, because I don't want to write yet another inference server from scratch
What it isn't:
It's not for advanced users. There are jobs, but no subagents, for instance: in this case the Pi philosophy really helped.
In fact, I myself use Strata and Opencode, so for advanced users, it recommends those in the Help section
How is this different from Unsloth desktop / Atomic chat etc?
It isn't. It just tries to be a lot more lightweight and user-friendly: I decided to do this after getting said friend to download and set up llama.cpp, Unsloth Desktop, Opencode etc . . .
I noticed that at some point both choice paralysis and confusion with options just took over, and there was no easy way for them as a newcomer to figure out what x thing was really for. Every setting in Zest is explained. Including what inference engines do, the works.
Everything is explained at basic levels - what a model is, how it works, and so on. I've kept the lemonade + pi analogy while trying to make sure the interface was intuitive.