> For those just getting started, developers who are enrolled in the App Store Small Business Program and have fewer than two million first-time App Store downloads can access the Apple Foundation Models running on Private Cloud Compute with no cloud API cost.*
> Where Apple Intelligence is available, eligible developers can use PCC in their apps distributed on the App Store, and test PCC features via TestFlight or ad hoc distribution. Installs during testing are not counted as first-time app downloads.
Is this free tokens? This sounds like free tokens?
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
I have my firewall events get reviewed by the local model on my mac studio. I had to stop sending the full event because the model would refuse some requests.
I just realized that claude has also support App Attest for months [1]. Not sure if that is being used widely. Firebase was the most practicle option to call llms directly from ios apps without having fancy setups. I am surprised Anthropic not promoting this more.
I have been using Foundation Models in Noodle for a while and have liked working with it. One part I have not explored yet is Apple Private Cloud Compute but it is on my list. I think I need special entitlements that are only available to Siri desktop app for now - need to check.
Even the stronger Private Cloud Compute model struggled with the coding task I gave it (build a web-based side-scrolling platformer). I used this and pointed Cursor at it to test: https://github.com/littlebobert/pcc-server-example
> For those just getting started, developers who are enrolled in the App Store Small Business Program and have fewer than two million first-time App Store downloads can access the Apple Foundation Models running on Private Cloud Compute with no cloud API cost.*
https://developer.apple.com/private-cloud-compute/
> Where Apple Intelligence is available, eligible developers can use PCC in their apps distributed on the App Store, and test PCC features via TestFlight or ad hoc distribution. Installs during testing are not counted as first-time app downloads.
Is this free tokens? This sounds like free tokens?
I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt
Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
Yeah I found the safety restrictions really aggressive. Enough that I just gave up and used Gemma instead.
I have my firewall events get reviewed by the local model on my mac studio. I had to stop sending the full event because the model would refuse some requests.
I just realized that claude has also support App Attest for months [1]. Not sure if that is being used widely. Firebase was the most practicle option to call llms directly from ios apps without having fancy setups. I am surprised Anthropic not promoting this more.
[1] https://github.com/anthropics/ClaudeForFoundationModels#auth...
Why is this up front on HN? Did it get an update?
Discussed last year when it was announced https://news.ycombinator.com/item?id=44226978
There have been a few published rumors of Apple getting ready to release a new set of local models.
Where did you see these rumors?
I have been using Foundation Models in Noodle for a while and have liked working with it. One part I have not explored yet is Apple Private Cloud Compute but it is on my list. I think I need special entitlements that are only available to Siri desktop app for now - need to check.
This is the repo if you are interested https://github.com/pdparchitect/noodle
Curious if it’s possible to use a non-API plan for Claude/ChatGPT with this? It could actually be pretty useful.
Can the local model code at all? Eg as the predictor in Zed?
Even the stronger Private Cloud Compute model struggled with the coding task I gave it (build a web-based side-scrolling platformer). I used this and pointed Cursor at it to test: https://github.com/littlebobert/pcc-server-example
I'll ask my LLM to build me a framework, thank you.
Why would you do that, assuming that you're not coding yourself/using the framework?