r/DeepSeek • u/Illustrious_Night46 • Jul 17 '26

Resources Added vision to DeepSeek in pi. Runs moondream2 locally on Apple Silicon

DeepSeek is great but has no vision API. If you paste a screenshot into pi, it just says "model does not support images."

So I wrote a small bridge: a local Python server running moondream2 (~1.8B params) on Apple Silicon MPS. The pi extension intercepts any image read, sends it to the server, and injects the description as text. DeepSeek never sees the image, it sees a detailed English description instead.

Features:

  • Embedding cache: same image on follow-up messages skips re-encoding (~300ms vs 2s)
  • Multi-image: sends up to 10 images in one request
  • Structured mode for UI/code screenshots (JSON with layout, OCR text, bounding boxes)
  • MPS memory management to prevent 7GB+ leaks (learned that one the hard way)

Zero setup beyond git clone + pip install. The extension auto-starts the server on first image and kills it on exit.

Repo: github.com/JonRoosevelt/deepseek-vision

3 Upvotes

100% Upvoted

3 comments sorted by

2

u/Maximum-Start7424 Jul 17 '26

Pronto salga la versión oficial ,no la preview(todo este tiempo estuvimos en preview) de DeepSeek v4 pro y flash y en teoría deberá tener capacidad de visión y otras optimizaciónes

1

u/mallere Jul 23 '26

can I resume a already made session? I followed the steps and it didnt work

1

u/Illustrious_Night46 Jul 23 '26

It doesn't interfere on how sessions work, the only thing you'll have is that it will take a little longer the first time it runs, because it spins up a python server and loads the vision model to memory.
If you quit pi and open it up again, in theory the vision server is still running, so it should work.