I have spent the past few months working on a project I call phntm-one. Its a Raspberry Pi5 running a 4B LLM model installed into a 10 inch touchscreen. I created an app for the LLM to run within. You can chat with it, talk to it and it talks back. The context I was able to get is around 9K out of the 4B model. I also added RAG and persistent memory. The appliance will even repair itself and learn from the fixes for future use and avoidance. Please check out my website for a full list of features and what it can do. I have spent a lot of time building this and am proud of my end product. I still have a lot of work to do but the device is just about fully autonomous.
half a grand for a tablet with a PI as the core running a weak LLM seems ... bad. Maybe I'm missing the point, but this doesn't seem like a useful product to me.
"Self healing" doesn't sound like a feature to me. It sounds like the product so regularly borks itself it needed nasty safegaurds put in to not, and it was done in a weird way that's annoying to diagnose and fix. Your most stand out feature being it doesn't break it self isn't great. Otherwise, it's what? Fancy on-prem Alexa? Why wouldn't I just setup Home Assistant Voice?
I suspect normal HN readers aren't your target market, but I don't really see who is?
I have spent the past few months working on a project I call phntm-one. Its a Raspberry Pi5 running a 4B LLM model installed into a 10 inch touchscreen. I created an app for the LLM to run within. You can chat with it, talk to it and it talks back. The context I was able to get is around 9K out of the 4B model. I also added RAG and persistent memory. The appliance will even repair itself and learn from the fixes for future use and avoidance. Please check out my website for a full list of features and what it can do. I have spent a lot of time building this and am proud of my end product. I still have a lot of work to do but the device is just about fully autonomous.
half a grand for a tablet with a PI as the core running a weak LLM seems ... bad. Maybe I'm missing the point, but this doesn't seem like a useful product to me.
"Self healing" doesn't sound like a feature to me. It sounds like the product so regularly borks itself it needed nasty safegaurds put in to not, and it was done in a weird way that's annoying to diagnose and fix. Your most stand out feature being it doesn't break it self isn't great. Otherwise, it's what? Fancy on-prem Alexa? Why wouldn't I just setup Home Assistant Voice?
I suspect normal HN readers aren't your target market, but I don't really see who is?