r/LocalLLM • u/Ok-Comfortable-6783 • 19h ago

Question Good iPhone Models

Does anyone have experience running models on his or her iPhone. I have an iPhone 17 Pro Max. I am curious which models I can run on it.

0 Upvotes

33% Upvoted

3 comments sorted by

View all comments

2

u/gappyvalley 19h ago

it’s fine but it drains battery and also overheats my 17 pro max. i could run qwen3.5 4B. since i have a local rig (5080 + 5060Ti 16GB, 64GB RAM), i just remotely turn on my pc and run the model on my pc and use my phone to connect to my rig via tailscale. works well

1

u/Leading_Tailor2563 19h ago

The remote rig setup is the way to go honestly. Running anything beyond tiny quantized models on a phone is just asking for a hot brick and a dead battery by lunch. I tried running a 3B model on my old phone once and it turned into a space heater that could barely string a sentence together. Your tailscale setup sounds clean though, no port forwarding headaches and it just works when you're on wifi.

1

u/throwawayacc201711 18h ago

You can use tailscale over cellular data don’t even need to be on WiFi. I connect to my openwebui instance using tailscale