Mobile LLM Server
Run local LLMs with Android. llama.cpp & LiteRT-LM
What is Mobile LLM Server?
AI Node brings local LLM inference to Android with llama.cpp and GGUF model support. It turns your phone into a private AI server with OpenAI-compatible API endpoints. Unlike cloud-based AI apps, all models run fully on-device for privacy and low latency.
Screenshots
?
No comments yet. Be the first!
Real conversations about Mobile LLM Server on X
Post on X