Short answer: PocketPal AI is the established free option for GGUF models on both platforms. Locally AI is the best-rated choice on iPhone. Private LLM suits Siri and Shortcuts users. opchat is the option to pick if you want on-device models and cloud models with your own API keys in one app on iPhone and Android.
How they compare
| App | Platforms | Where models come from | Cloud models too? |
|---|---|---|---|
| opchat | iOS 17+, Android | Recommended picks and Hugging Face search (GGUF, LiteRT, MLX on iPhone) | Yes, with your keys |
| PocketPal AI | iOS 15.1+, Android | Hugging Face search (GGUF) | Not listed |
| Locally AI | iOS 18.1+ | Apple MLX | Not listed |
| Private LLM | iOS 17+ | Curated list | Not listed |
| Google AI Edge Gallery | iOS 17+, Android | Google’s LiteRT models | Not listed |
| Layla | iOS 16.4+, Android | On-device, see listing | Not listed |
Which one to choose
You want the most freedom over models. Pick an app that searches Hugging Face, such as PocketPal AI or opchat. Both let you go beyond a fixed list.
You have an iPhone and want the best-rated app. Locally AI has by far the most ratings of the group, and its listing says it runs on Apple MLX.
You live in Siri and Shortcuts. Private LLM lists Siri and Shortcuts integration and is a one-time purchase.
You want to try Google’s models. Google AI Edge Gallery comes from Google and focuses on its own on-device models.
You want one app for local and cloud. opchat runs models on the phone and also connects to OpenAI, Claude, Gemini, DeepSeek, OpenRouter, Ollama and OpenAI-compatible servers. It is a newer app with very few ratings so far, so weigh that.
What to know before you download
- Storage: a capable small model is usually 2 to 5 GB. Gemma 4 E2B in GGUF format is about 3.1 GB on Hugging Face.
- Memory: the model must fit in RAM. If an app crashes on load, try a smaller model.
- Quality: phone-sized models make more mistakes than large cloud models. Check anything important.
Ready to try it? Follow the setup guide for iPhone or Android.