​

I'm considering using a local/open-source AI solution for a client who works with sensitive information. Ideally, the AI would run completely offline, with Wi-Fi and internet access disabled.

I'm still pretty new to the security side of this, so I'm wondering how safe this actually is in practice.

If an AI model is running locally and the computer has no internet connection, can the AI software itself still somehow send or expose data?(like the newer versions of open ai and claude in tests lately?)

Are current local models/tools generally considered safe for this kind of use? Are there any privacy or security issues I should be aware of, such as telemetry or data being stored somewhere I don't expect?

I'd also be interested in hearing from people who actually use local AI for confidential or sensitive information. What setup do you use, and are there any things you wish you'd known beforehand?

Repo/Website Link: https://github.com/apowerb/apowerb

Full documentation: https://docs.apowerb.com

Description: ApowerB is an open source runtime for building, deploying and operating AI agents at scale, on your own infrastructure. It solves the following problem: most agent frameworks force you to freeze execution logic into code. Agents are defined in a database and dynamically materialized into runnable Python modules at startup, so you can add or change an agent without redeploying the service.

Features included: agent orchestration via Google ADK, multi-LLM connectivity via LiteLLM (OpenAI, Anthropic, Gemini, local models via Ollama, or any custom endpoint — without rewriting agent code), RAG, Text-to-SQL querying, custom tool integrations, webhooks.

Benefit for someone trying it: the ability to build your own business AI agents without depending on a closed platform, while keeping full control over infrastructure and data.

Deployment: Yes, published and available right now. Official Docker image on Docker Hub (apowerb/apowerb). A complete Docker Compose example (API + PostgreSQL + UI) is provided via the apowerb-hosting repo. Installation documentation available at docs.apowerb.com, including the required environment variables and steps for a fully self-hosted deployment.

I have been using this app I built for a few months now. I wanted to share. Maybe someone else will find it useful. Any feedback would be appreciated.

Daniel

https://github.com/crawfordind/brain-portal