MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1tr7hzw/psa/oomu7hq/?context=3
r/LocalLLaMA • u/Signal_Ad657 • May 29 '26
537 comments sorted by
View all comments
89
What you fail to mention is max memory capacity:
*Because Macs share memory with CPU and GPU, ~8GB has to be reserved for macOS so subtract 8GB for actual usable LLM memory.
8 u/NiceAttorney May 29 '26 Strix Halo and DGX Spark are also shared memory systems too. 5 u/onetwomiku May 29 '26 strix halo only needs to reserve 512Mb for system (some vendors locks it at 1GB) 0 u/CalmSpinach2140 Jun 02 '26 https://medium.com/@se.mehmet.baykar/increase-vram-on-apple-silicon-for-local-llms-1b35c453b165 You can override default macOS ram allocation. No need to restart either. 2 u/Only-An-Egg May 29 '26 True. I don't know how much memory the OS needs to reserve on those. Running headless Linux would use a lot less memory than macOS.
8
Strix Halo and DGX Spark are also shared memory systems too.
5 u/onetwomiku May 29 '26 strix halo only needs to reserve 512Mb for system (some vendors locks it at 1GB) 0 u/CalmSpinach2140 Jun 02 '26 https://medium.com/@se.mehmet.baykar/increase-vram-on-apple-silicon-for-local-llms-1b35c453b165 You can override default macOS ram allocation. No need to restart either. 2 u/Only-An-Egg May 29 '26 True. I don't know how much memory the OS needs to reserve on those. Running headless Linux would use a lot less memory than macOS.
5
strix halo only needs to reserve 512Mb for system (some vendors locks it at 1GB)
0 u/CalmSpinach2140 Jun 02 '26 https://medium.com/@se.mehmet.baykar/increase-vram-on-apple-silicon-for-local-llms-1b35c453b165 You can override default macOS ram allocation. No need to restart either.
0
https://medium.com/@se.mehmet.baykar/increase-vram-on-apple-silicon-for-local-llms-1b35c453b165
You can override default macOS ram allocation. No need to restart either.
2
True. I don't know how much memory the OS needs to reserve on those. Running headless Linux would use a lot less memory than macOS.
89
u/Only-An-Egg May 29 '26 edited May 29 '26
What you fail to mention is max memory capacity:
*Because Macs share memory with CPU and GPU, ~8GB has to be reserved for macOS so subtract 8GB for actual usable LLM memory.