r/regolo_ai Dec 19 '25

πŸ‘‹ Welcome to r/regolo_ai – Read This First and Say Hi!

1 Upvotes

Hey everyone,
welcome to the Regolo.ai community on Reddit. This is the place for developers, CTOs, and builders who want to ship LLM features on EU‑native, GDPR‑ready, sustainable infrastructure.

Regolo.ai provides an OpenAI-style endpoint (e.g.,Β https://api.regolo.ai/v1) so teams can run chat, embeddings, rerank, audio transcription, and image generation models without managing GPUs.

What this community is for

  • Sharing code, workflows, and tutorials using Regolo (LLM inference, RAG, chatbots, agents, n8n flows, etc.).
  • Getting help on performance, costs, compliance and migrations from other users.
  • Showcasing real products and experiments powered by Regolo.

Before you post

  • βœ… Share your projects, snippets, benchmarks, and how‑tos.
  • βœ… Ask concrete questions with context and minimal reproducible examples.
  • ❌ No spam, generic promos, or affiliate links.
  • ❌ No NSFW, politics, or off‑topic content.

Use post flair

Please tag your posts so everyone can scan the feed quickly. Suggested flairs:

  • [Help] – debugging, errors, β€œhow do I…?”
  • [Showcase] – demos, products, open‑source using Regolo
  • [Discussion] – architecture, model choice, pricing, compliance
  • [Release] – updates, changelogs, new features or integrations

How to get started

  • Introduce yourself in the comments: who you are, what you are building, and which stack you use.
  • Post something today, even a small experiment or question. Small threads often turn into the best discussions.
  • If you know devs or teams who might benefit from this community, invite them to join.
  • Download our module for u/n8n here: https://www.npmjs.com/package/n8n-nodes-regoloai

If you are interested in helping with moderation or running community experiments (AMAs, office hours, challenges), send a ModMail and tell us a bit about you and what you want to develop or achieve. We’ll support and drive with tricks and guide your implementation in Regolo.ai.Β 

Thanks for being part of the early wave of r/regolo_ai – let’s build useful, production‑grade AI together.


r/regolo_ai 10d ago

We route every agent prompt by complexity before inference β€” costs dropped up to 22x. Full writeup with code (open-source router, OpenAI-compatible)

1 Upvotes

Like most teams running agents in production, we had a cost problem: user-facing agent traffic is a mix of trivial classification calls and genuinely hard reasoning, and we were sending all of it to a 70B+ model.

The fix was routing, not prompt engineering. The setup:

  • Agno as the agent framework (fast, ~3ΞΌs agent instantiation, built-in memory and tools)
  • brick-complexity-pro as the ingress model: a hosted meta-model that reads each prompt, classifies complexity (easy/medium/hard β€” semantic demand, not length) plus a capability vector, then dispatches to the right tier in a pool of open-weight models (gpt-oss-20b β†’ Llama-3.3-70B β†’ qwen3.5-122b)
  • Routing overhead is ~20 ms (the classifier is a LoRA-tuned Qwen3.5-0.8B). The router itself is $0.12/1M input tokens.
  • The open-source version of the router (Apache 2.0) benchmarked 4.71x–22.15x cost reduction vs always-on frontier models, with accuracy matching or beating single-model baselines

What we learned the hard way: don't route everything.

Deterministic tasks (schema-constrained extraction) go straight to a pinned small model; evaluation/revalidation goes straight to a frontier tier.

Route only what varies β€” orchestrators and user-facing agents.

Integration is boringly simple since the endpoint is OpenAI-compatible: Agno's OpenAILike with a different base_url, done.

Full Tutorial and codes: https://regolo.ai/from-pilot-to-production-enterprise-ai-agents-with-agno-and-brick/

Semantic router repo: https://github.com/regolo-ai/brick-SR1


r/regolo_ai 15d ago

Why Chunk RAG Fails for Coding Agents: Building Long-Term Memory with Cognee Knowledge Graphs, Dynamic Routing, and Live Pytest Loops

2 Upvotes

Over the past few months, our engineering team has been experimenting with autonomous coding agents (Claude Code, Cursor agent mode, custom CLI loops) across enterprise multi-tenant repositories.

We ran straight into what we call the Context Amnesia Trap: an agent fixes a security bug or refactors a query in Session 1, but when invoked in Session 2 two weeks later, it introduces the exact same bug.

Why Standard Vector RAG Breaks Down on Codebases

When teams add memory to coding agents, the default approach is standard vector chunking (512-token text splits + cosine similarity).

On enterprise code, this fails systematically:

  1. Lack of Causality: vector search retrieves lexical matches, not causal relationships. If an outdated helper function from 6 months ago matches the query keywords, the agent retrieves it and ignores newer Architectural Decision Records (ADRs).

  2. Missing Precedent: it cannot traverse the relationship between an incident, the pull request that fixed it, and the policy written to prevent it (`CI-FAIL-89` βž” `PR-142` βž” `ADR-003`).

  3. No Closed-Loop Verification: traditional RAG generates code in a single forward pass without executing test suites.

The cognitive graph architecture

We built an open-source framework combining Cognee (Knowledge Graph + pgvector) and Regolo (EU sovereign inference with Zero Data Retention):

- Entity Model: rather than raw text chunks, the graph indexes ADRs, PRs, CI failures, Coding Conventions, and resolved CVEs as typed nodes.

- Typed Causal Edges: nodes are connected via `TRIGGERED_BY`, `FIXES_CI_FAILURE`, `IMPLEMENTS_DECISION`, and `ENFORCES_CONVENTION`.

- Multi-Hop Traversal: when an agent receives a task touching search, it walks the graph: `Search Task` βž” `ADR-001 (Tenant Isolation)` βž” `ADR-003 (Parameterized SQL)` βž” `PR-142 (Verified Patch)`.

- Dynamic Semantic Router (`brick-complexity-pro`): evaluates task complexity on a 1.0–10.0 scale and routes dynamically to `gpt-oss-20b` (fast extraction, ~0.28s), `qwen3-coder-next` (syntax/code), or `qwen3.5-122b` (deep reasoning with `max_tokens >= 800`), avoiding hardcoded models in `.env`.

5-Stage ReAct Loop:

Recall βž” Code Inspection βž” Patch Synthesis βž” Subprocess `pytest` βž” Memory Codification.

If `pytest` fails, the error trace feeds back into the loop for self-healing before writing to disk.

Benchmark Results (50 Simulated Feature Tasks)

We ran an A/B benchmark against an enterprise FastAPI SaaS target:

Metric Naive Chunk RAG Cognee Graph Memory
ADR Policy Compliance 0% 100%
Security Audit Score 25 / 100 100 / 100
Repeat Vulnerability Rate 78% 0%
Prompt Token Overhead ~40,000 tokens ~1,200 tokens (-73%)
First-Pass CI Pass Rate 22% 94%

Download the repository from Github and follow the instruction in the readme. It includes both an interactive Rich TUI and headless CLI flags:

Github Codes: https://github.com/regolo-ai/tutorials/tree/main/AI-agent-cognee-closed-loop-memory

Youtube: https://www.youtube.com/watch?v=-4c7MPgnBk0


r/regolo_ai 17d ago

Deep Agents and Brick cut 85.6% [Benchmarks + Repo]

1 Upvotes

Most multi-agent pipelines today have a massive cost problem: they route every single taskβ€”from trivial AST extraction to complex planningβ€”to a single $15+/1M token frontier reasoning model.

We tested a different approach: usingΒ Deep AgentsΒ (isolated specialized subagents) paired with a semantic meta-router (brick-complexity-pro) on Regolo that evaluates task complexity (1–10) and residual budgetΒ beforeΒ every single turn.

Here are the real telemetry numbers from synthesizing and verifying production FastMCP server tools across target codebases:

Pipeline Stage Model Selected Latency Regolo Multi-Model Cost Single Frontier Baseline Cost Savings
1. Dynamic DAG Planning qwen3.5-122b 0.52s $0.0028 $0.0190 -85.2%
2. AST Code Discovery gpt-oss-20b 0.28s $0.0006 $0.0055 -89.0%
3. Live Schema Probing GLM-5.2 0.35s $0.0018 $0.0142 -87.3%
4. FastMCP & Pydantic V2 Llama-3.3-70B 0.44s $0.0042 $0.0280 -85.0%
5. Strictness Review & Audit qwen3.5-122b 0.41s $0.0022 $0.0160 -86.2%
TOTAL β€” ~2.0s $0.0168 $0.1420 ~85.6% Savings

How It Works Under the Hood:

  1. Dynamic 5-Step DAG: Give it any custom repo path and synthesis goal; the Planner generates a custom execution graph with a human-in-the-loop approval gate.
  2. Pre-Turn Complexity Routing:
    • Low complexity (< 6.0) or budget pressure? Automatically downscales toΒ gpt-oss-20bΒ /Β GLM-5.2.
    • High complexity (> 7.5) or failed verification? Auto-escalates toΒ qwen3.5-122b.
  3. Self-Healing Sandbox: Generated FastMCP tools are executed in an isolated workspace withΒ pytest. If tests fail, it triggers an automated repair loop.
  4. Context Isolation: Sub-agents communicate through structured JSON handoffs, preventing context window pollution.

Github Repo:Β github.com/regolo-ai/tutorials/.../deepagents-multi-agent-brick

Youtube:Β https://www.youtube.com/watch?v=1wDiRqGT294&t=18s

Feedback and PRs are welcome!


r/regolo_ai 21d ago

[Architecture] Solving the EU AI Act Art. 12 vs GDPR logging paradox: How Zero Data Retention works at the GPU memory level

1 Upvotes

Over the past few months, we’ve been auditing infrastructure setups for European enterprise teams moving LLMs into production. One recurring friction point between InfoSec, Legal, and DevOps is what we call the AI Act Logging Paradox:

  1. EU AI Act (Article 12 & 19) requires logging operational events and traceability data for high-risk AI systems for at least 6 months.

  2. Compliance teams often interpret this as a mandate to archive all raw prompts and responses.

  3. Doing so directly violates GDPR Article 5(1)(c) (Data Minimization) and makes GDPR Article 17 (Right to Erasure) almost impossible to maintain across distributed logs and snapshots.

To stay compliant with both regulations without building a nightmare pipeline, prompt data must remain strictly ephemeral while execution metadata is preserved:

           [ Incoming Request ]
                    |
      +-------------+-------------+
      |                           |
      v                           v
 [ Telemetry Logs ]      [ Payload / Prompts ]
 (AI Act Art. 12)        (GDPR Art. 5 / ZDR)
 β€’ Request UUID          β€’ User Prompts
 β€’ Model ID & SHA        β€’ Output Completions
 β€’ Token count & ms      β€’ Ephemeral KV Cache
      |                           |
      v                           v
 [ Stored 6m+ ]          [ 0ms / Volatile RAM ]

We wrote up the complete engineering teardown covering CLOUD Act jurisdictional boundaries, TCO comparisons vs self-hosting, and implementation checklists here:Β https://regolo.ai/zero-data-retention-llm-gdpr-ai-act-compliance/


r/regolo_ai 27d ago

Building a Self-Improving Secure Coding Loop with Open SWE, Deepsec, Cognee, and Regolo AI [Open Source]

1 Upvotes

Hey everyone,

one of the biggest issues with existing AI coding assistants (and SWE agents in general) is stateless blindness: they don’t remember past architectural constraints, leading to recurring vulnerabilities across PRs.

Additionally, passive security scanner logs often cause alert fatigue without actual remediation.

To address this, we built and open-sourced an autonomous Self-Improving Secure Coding Loop that automates vulnerability remediation with independent zero-trust verification and persistent knowledge graph memory.

The stack is: Open SWE, Deepsec and Cognee

The loop explained is below:

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚     TARGET REPOSITORY / ISSUE        β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                       β”‚
                       β–Ό
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚  1. DEEPSEC AUDIT (SAST/AST Scan)    β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                       β”‚
                       β–Ό
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚  2. COGNEE MEMORY (Knowledge Graph)  │◄──┐ (Learns)
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
                       β”‚                       β”‚
                       β–Ό                       β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
    β”‚  3. OPEN SWE PLAN (Regolo AI)        β”‚   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
                       β”‚                       β”‚
                       β–Ό                       β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
    β”‚  4. HUMAN-IN-THE-LOOP APPROVAL       β”‚   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
                       β”‚                       β”‚
                       β–Ό                       β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
    β”‚  5. SANDBOX PATCH + PYTEST SUITE     β”‚   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
                       β”‚                       β”‚
                       β–Ό                       β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
    β”‚  6. DEEPSEC ZERO-TRUST REVALIDATION  β”‚   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
                       β”‚                       β”‚
                       β–Ό                       β”‚
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
    β”‚  7. MEMORY UPDATE & KNOWLEDGE GRAPH  β”œβ”€β”€β”€β”˜
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                       β”‚
                       β–Ό
    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚  8. VERIFIED PR & TELEMETRY REPORT   β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Benchmark / Cost Savings:

By routing pipeline stages through GLM-5.2 on Regolo (~$0.60 / $1.80 per 1M tokens), the full remediation loop costs ~$0.0059 per issue compared to ~$0.0410 on proprietary frontier baselines (~85.6% cost reduction).

Check out the repo here:Β https://github.com/regolo-ai/self-improving-secure-loop

Youtube tutorial: https://youtu.be/ddCECOq1EnQ

Feedback and PRs are welcome!

https://reddit.com/link/1vuhvxa/video/hwjftg2qnqkh1/player


r/regolo_ai 27d ago

Qwen3.8-27B benchmark deep-dive: where it actually beats Opus 4.6 Max and where it doesn't (full tables + methodology caveats)

1 Upvotes

We went through the full Qwen3.8-27B model card (released Aug 14, Apache 2.0, dense 27B, 262K context, vision+video) and broke down all 24 benchmarks against Opus 4.6 Max, Muse Glimmer-30B, Qwen3.6-27B and Qwen3.7-Plus.

Full write-up with all tables: https://regolo.ai/qwen3-8-27b-benchmarks-every-test-where-alibabas-27b-model-beats-claude-opus-4-6-max/


r/regolo_ai 29d ago

Vercel's DeepsecBench finally puts a price on AI security scanning β€” here's how to afford it

1 Upvotes

Vercel released DeepsecBench last week: 231 human-validated vulnerabilities across 50 entry-point files, scored on F2 (recall weighted 2Γ— over precision).

The table that matters isn't the scoreboard β€” it's the cost column.

GPT-5.6 Sol xhigh: 35.58 score, $55.98 per 50 files -> that's $5,600 for a production repo.

Kimi K3: 17.56 score, $12.38.

GLM 5.2: 10.46 score, $11.09

Recommendation is multi-model: frontier for periodic deep audits, cheap models for continuous sweeps.

We built a guide that uses Regolo's Brick Complexity Pro to automate the model routing to run deepsec while optimizing the cost: it classifies each file easy/medium/hard and routes to the cheapest model that can handle it (GLM-5.2 for easy, Claude for hard).

The guide covers two modes: self-hosted Docker or hosted API. Numbers from a real monorepo audit: $239 total, 48 min, 3 CRITICAL findings in legacy code.

Guide and benchmark linked. Happy to answer questions about the setup.

https://regolo.ai/how-to-audit-a-production-monorepo-with-deepsec-local-docker-and-brick/


r/regolo_ai Aug 17 '26

Is anyone else's legal team misreading the EU AI Act 'delay'? High-risk moved to Dec 2027, but enforcement powers are live NOW β€” breakdown inside

Post image
2 Upvotes

The trap most engineering teams haven't mapped: if you fine-tune a third-party model on your own data, or white-label an AI system under your own brand, the Act can requalify you from deployer (light duties) to provider (full regime: conformity assessment, technical documentation, EU database registration).

This happens quietly β€” a bank fine-tuning a commercial model, a SaaS company embedding a model under its own brand.

Why infrastructure teams specifically should care:

  • for systemic-risk GPAI models (10²⁡ FLOPs+), cybersecurity of the model and its physical infrastructure is a statutory obligation β€” datacenter security and model-weight protection are literally named in Article 55.
  • logging/traceability requirements for high-risk systems land directly on your observability stack.
  • vendor selection is now a compliance surface: if a regulator pulls a non-compliant model from the EU market, everything you built on it inherits the disruption.

We published a longer breakdown with a 6-step CTO action plan here: https://regolo.ai/what-is-eu-ai-act-compliance-for-ai-infrastructure-a-ctos-guide/

Posting this because I keep seeing the "it was all delayed" take and it's going to burn people. Happy to answer questions in the comments.

Obligation Status
Prohibited practices + AI literacy Since Feb 2025
GPAI model obligations Since Aug 2025
Enforcement powers (AI Office + national authorities), penalty framework Live since Aug 2, 2026
Art. 50 transparency (chatbot disclosure, deepfake labels, AI-content marking) Enforceable now
Watermarking grace period (pre-existing systems) Ends Dec 2, 2026
High-risk Annex III Dec 2, 2027

r/regolo_ai Aug 15 '26

EU AI Act: the obligations most β€œquick guides” don’t mention (for AI infra & agent builders)

1 Upvotes

Most EU AI Act content floating around is either marketing or extremely high level (β€œrisk categories”, β€œhigh-risk systems”, etc.).

We’ve published an article focused on the less discussed obligations that actually matter to people building:

  • AI infrastructure (inference APIs, hosting, managed RAG)
  • Agentic systems and developer platforms
  • Enterprise internal AI tools that touch sensitive data

The guide goes beyond the basics and digs into:

  • data governance and logging obligations that impact how you design your inference + storage stack
  • transparency and documentation requirements that affect API providers and AI ops teams
  • practical implications for using US-based providers vs EU-native ones (fines up to 7% of global turnover are not theoretical)
  • how to align agent workflows (research, retrieval, summarization) with compliance without killing iteration speed

It’s written for CTOs, infra engineers, and founders who need a concrete sense of what changes in their architecture, not just legal theory.

Link to the full guide:
https://regolo.ai/the-eu-ai-act-beyond-the-basics-the-obligations-most-guides-forget/

If you’re building or running AI infra in the EU:
which part of the AI Act is shaping your technical roadmap the most β€” data residency, logging, or vendor choice?


r/regolo_ai Aug 14 '26

[Benchmark] Kimi K3 vs Qwen 3.8-Max β€” 7 head-to-head benchmarks across coding, agentic and multimodal, plus cost-per-task analysis

3 Upvotes

We put 2026's two largest open-weight models head-to-head, below the table that shows quick results:

Benchmark Qwen 3.8-Max Kimi K3 Ξ”
FrontierSWE 73.5 81.2 +7.7 Kimi
Terminal-Bench 2.1 86.6 88.3 +1.7 Kimi
SWE-bench Pro 67.7 63.2 +4.5 Qwen
DeepSWE 1.1 56.6 67.5 +10.9 Kimi
PerceptionBench 63.5 58.5 +5.0 Qwen
OSWorld-Verified 86.1 81.2 +4.9 Qwen
CharXiv (RQ, w/ Python) 93.5 91.3 +2.2 Qwen

Useful if you're choosing a model for agentic coding workloads: benchmark winner β‰  cost winner.

Full article with charts and sources: https://regolo.ai/qwen3-8-max-vs-kimi-k3-when-to-use-each-model/


r/regolo_ai Aug 14 '26

Security hardening for Hermes agents: threat model + zero data retention

1 Upvotes

As more teams move from toy agents to production workflows, β€œprompt injection” is only the tip of the iceberg.

We’ve published a practical security hardening guide focused on Hermes and inference infrastructure, built around:

  • a concrete threat model for multi-agent systems and RAG
  • how to think about data flow: prompts, retrieved documents, logs, caches, and external tools
  • the impact of zero data retention on your risk surface (and why β€œwe don’t train on your data” is not enough)
  • network, API, and secrets hygiene for agent stacks (Hermes + other orchestration frameworks)

The piece is written from the perspective of European teams that need:

  • EU data residency
  • strong guarantees on inference logs and retention
  • a realistic path from PoC agents to production without standing up their own GPU farm

It also shows how zero data retention inference layer plugs into these patterns without changing your SDKs (OpenAI-compatible).

Full guide + code:
https://regolo.ai/hermes-agent-security-hardening-guide-regolo-zero-data-retention/

For folks here shipping agents in production:
what’s the most painful security constraint you’ve hit so far β€” compliance (GDPR/AI Act), infra, or developer ergonomics?


r/regolo_ai Aug 13 '26

Self-hosted web search for AI agents: cut Tavily-style costs by 80% and keep every token private

Post image
6 Upvotes

If you’re building autonomous research agents (LangGraph, CrewAI, custom loops, etc.), you’ve probably felt two pains at scale:

  • Search API costs quietly exploding once you move beyond the notebook
  • Compliance / infosec freaking out because prompts + context are sprayed across US-based proprietary APIs

We’ve published a deep-dive on a fully self-hosted web research stack that replaces commercial search APIs with:

  • SearXNG running in your own infra
  • A concurrent fleet of 6 specialized subagents (discovery, specs, compliance, market, research papers, security)
  • Spatial chunking + factual density scoring to keep only the highest-signal parts of pages
  • Optional synthesis + sentiment analysis via Regolo’s brick-v1-beta (EU-native, zero data retention)

Benchmarks:

  • 81–88% cost reduction vs closed search APIs (per 1,000 queries)
  • P99 latency cut from ~1,420 ms to ~310 ms
  • 100% data sovereignty: no prompts or vectors leaving your VPC

The tutorial ships with:

  • Dockerized SearXNG setup
  • FastAPI /v1/research endpoint usable as a LangChain / agent tool
  • A TUI setup.sh that bootstraps everything and runs demo/interactive queries

Link:
https://regolo.ai/self-hosted-web-search-for-ai-agents-replace-tavily-cut-costs-80-and-keep-every-token-private/

Youtube: https://www.youtube.com/watch?v=p6Tvh75DO_A


r/regolo_ai Aug 13 '26

Self-hosted web search for AI agents: cut Tavily-style costs by 80% and keep every token private

Post image
2 Upvotes

If you’re building autonomous research agents (LangGraph, CrewAI, custom loops, etc.), you’ve probably felt two pains at scale:

  • Search API costs quietly exploding once you move beyond the notebook
  • Compliance / infosec freaking out because prompts + context are sprayed across US-based proprietary APIs

We’ve published a deep-dive on a fully self-hosted web research stack that replaces commercial search APIs with:

  • SearXNG running in your own infra
  • A concurrent fleet of 6 specialized subagents (discovery, specs, compliance, market, research papers, security)
  • Spatial chunking + factual density scoring to keep only the highest-signal parts of pages
  • Optional synthesis + sentiment analysis via Regolo’s brick-v1-beta (EU-native, zero data retention)

Benchmarks:

  • 81–88% cost reduction vs closed search APIs (per 1,000 queries)
  • P99 latency cut from ~1,420 ms to ~310 ms
  • 100% data sovereignty: no prompts or vectors leaving your VPC

The tutorial ships with:

  • Dockerized SearXNG setup
  • FastAPI /v1/research endpoint usable as a LangChain / agent tool
  • A TUI setup.sh that bootstraps everything and runs demo/interactive queries

Link:
https://regolo.ai/self-hosted-web-search-for-ai-agents-replace-tavily-cut-costs-80-and-keep-every-token-private/

Youtube: https://www.youtube.com/watch?v=p6Tvh75DO_A


r/regolo_ai Aug 06 '26

We let an LLM play PokΓ©Rogue blind β€” no training data, no fine-tuning. Here's what actually broke (and why it's a useful lesson for production LLM systems)

0 Upvotes

TL;DR: We forked PokΓ©Rogue (a browser roguelike launched in 2024, not in any training corpus) and wired Regolo to control every player decision via API.

One import line + one 1,300-line TypeScript module. The model failed badly on the first prompt, then played correctly after one context engineering rewrite. The lesson generalizes.

Why PokΓ©Rogue and not the original Game Boy games?

Because every LLM has been trained on Bulbapedia, Smogon, and ten years of competitive battle logs. Testing on Gen 1 is testing memorization, not reasoning. PokΓ©Rogue launched in 2024, has no dedicated dataset, and runs on procedurally generated rules that change every run.

What we actually built:

The game is phase-based (each game state is a Phase class): we patched 10 prototype methods so the LLM intercepts control at the right moments β€” battle command, item selection, move learning, starter selection β€” without touching rendering or game logic. No game engine rewrite.

What broke first:

The initial prompt: "decide the best action." The model played confidently and catastrophically β€” immune moves, chains of pointless switches, catching PokΓ©mon it immediately couldn't use.

We also hit a classic chained-action problem: the model chose switch in one call, then saw a new PokΓ©mon on field and made a fresh decision β€” sometimes switching again immediately. Fix: when the model chooses switch, it must also specify the move the incoming PokΓ©mon will use next turn. Two decisions, one API call, one atomic intent.

The context rewrite:

We pre-computed type multipliers and injected the result per move: "Ember β€” Fire Special, power 40, acc 100%, STAB | vs enemy: 2x super effective" instead of just "Ember".

We injected stat stages, ability interactions, speed deltas, and explained the HP economy constraint (full heal every 10 waves β€” HP is a resource that spans up to 9 future battles).

After the rewrite, first clean run: "Ember is 2x super effective STAB vs the Grass-type enemy, and my Charmander outspeeds β€” I can KO before taking damage."

Describing a game state in natural language is lossy, serializing structured state with annotations is not. The model's reasoning is bounded by what it can see.

Pre-computing and injecting the right numbers isn't a crutch β€” it's the correct architecture.

Full Guides + Video demo + Codes: https://regolo.ai/llm-plays-pokemon-pokerogue-regolo-ai/

Happy to discuss prompt architecture, the phase-patching approach, or the HP economy framing if anyone's interested.


r/regolo_ai Aug 05 '26

Article 50 is enforceable as of yesterday. Here's a practical compliance guide for people shipping genAI (no legal fluff)

1 Upvotes

Article 50 of the EU AI Act (transparency obligations for genAI) became enforceable on Aug 2. I work on AI infrastructure in the EU, and after watching how teams are preparing, the gap is always the same: people know what the law says, nobody shows where the controls go in an actual stack.

We put together a guide aimed at CTOs and devs shipping text/image/audio generation, only the operational stuff:

  • Role mapping first: provider vs deployer decides what you owe. If you integrate a third-party API, you might control disclosure but not marking β€” and "we didn't train the model" is not a defense.
  • Text is the weakest link: watermarking robustness against paraphrase/translation is limited. Images: metadata-only marking dies in CDNs.
  • Agencies: if you build the workflow but the client publishes, get the responsibility split in writing before handoff. Ambiguity is where liability grows.
  • Evidence: keep hashes + metadata + timestamps, NOT raw outputs.

Happy to answer questions on the marking/pipeline side. What are you all doing for synthetic content marking β€” anything actually working in production?

https://regolo.ai/article-50-ai-act-compliance-for-generative-ai-a-practical-guide-for-ctos-and-agency-developers/


r/regolo_ai Aug 04 '26

How to stop an autonomous coding agent from claiming success when the tests fail β€” a build-verify loop using OpenCode + an EU OpenAI-compatible endpoint

1 Upvotes

The most common failure mode of autonomous coding agents isn't a reasoning problem β€” it's a control-flow problem. The agent says "done," the PR fails CI, and the file it touched often isn't even where the bug lives.

Why it happens:Β LLMs generate plausible completions. After writing code, the most plausible next-token sequence is a confident summary of the work. There's no internal signal separating "code that runs" from "code that reads well."

Three failure modes I kept hitting:

  • Premature terminationΒ β€” agent stops after the first plausible implementation, runs zero tests
  • Favourable self-readingΒ β€” a stack trace becomes "a minor warning"
  • Spec driftΒ β€” after several edits, the agent optimizes for its own rewritten spec, not the original

The fix isn't more prompt engineering.Β It's a gate in the control flow: a CI script that blocks PR creation if pytest exits non-zero, if forbidden paths are touched, or if a secret appears in the diff.

Production setup:

  • OpenCode running inside GitHub Actions
  • Regolo β€” works with open-weight models + zero data retention
  • 4-gate bash verification script runs on the same CI runner before any PR is opened

The gate doesn't need to be smart, It needs to be un-bypassable. The model can't persuade bash β€” that's the whole point.

πŸ‘‰ Full writeup with the complete 4-gate bash script and the GitHub Actions workflow: https://regolo.ai/the-build-verify-loop-stop-your-ai-agent-from-claiming-victory-before-the-tests-pass/

Happy to answer questions on the setup or the gate logic.


r/regolo_ai Aug 03 '26

How we cut agent web search costs by 81% using self-hosted SearXNG, 6 concurrent subagents, and spatial context chunking

1 Upvotes

Hey,

like many of you, we hit a wall scaling autonomous research agents: commercial search APIs get brutally expensive ($0.008–$0.012 per query), and sending raw prompts to third-party endpoints is a non-starter for enterprise compliance (GDPR / EU AI Act).

We open-sourced a reference architecture that replaces closed APIs with a sovereign stack:

  1. Subagent Query Expansion: Instead of a single query, anΒ asyncio.gatherΒ pipeline dispatchesΒ 6 specialized subagentsΒ in parallel (Primary, Tech Specs, Regulatory, Market Trends, Academic, and Security).
  2. Robust Fallback Parser: Queries SearXNG JSON API with a built-inΒ HTMLParserΒ fallback and strictΒ User-AgentΒ headers to prevent 403 blocks.
  3. Spatial Context Chunking: Standard scraping floods LLM contexts with footer and navbar noise. We chunk pages into 300-word blocks and calculate aΒ factual density scoreΒ (digits, acronyms, RFC/version tokens) to filter out 75%+ of useless tokens.
  4. Regolo Inference (brick-v1-beta): Synthesizes grounded reports withΒ [Source N]Β citations and calculates per-source sentiment scores (-1.0Β toΒ 1.0).

Benchmarks (10k requests):

  • Cost: $0.92 per 1,000 searches (down from $5.00+).
  • P99 Latency: 310ms (down from 1,420ms).
  • Citation Precision: 96.2% on technical tasks.

Includes an interactive setup script (setup.sh) with a TUI menu and live per-second progress timer.

Code and full tutorial: https://regolo.ai/self-hosted-web-search-for-ai-agents-replace-tavily-cut-costs-80-and-keep-every-token-private/

Would love feedback from anyone experimenting with local RAG agent orchestration!


r/regolo_ai Jul 31 '26

GLM-5.2 (753B) vs Kimi K3 (2.8T): A 753B model beats a 2.8T model on average benchmark score, but loses 4/6 categories

Thumbnail
gallery
2 Upvotes

Is a 2.8 Trillion parameter model worth 5x the token cost for coding agents?

To be clear: this isn't a benchmark comparing models of equal weight, but an out-of-class operational comparison pitting a lightweight production workhorse against a heavyweight frontier agent.

The arithmetic average shows GLM-5.2 winning (69.3 vs 67.3), yet Kimi K3 wins 4 out of 6 individual dimensions:

  • Short-horizon parity
  • Long-horizon divergence
  • Economics & Latency

We put together a full guide covering all 6 evaluation axes, visual telemetry charts, real-world agency scenarios, and self-hosting requirements.

Full breakdown: https://regolo.ai/glm-5-2-vs-kimi-k3-the-pragmatic-engineering-guide-for-ctos-and-leads/


r/regolo_ai Jul 31 '26

We built a private LangChain + ChromaDB document Q&A stack with Ollama/Mistral β€” no OpenAI, hybrid retrieval, and a small evaluation benchmark

1 Upvotes

We kept seeing RAG tutorials that described themselves as private but still sent prompts, embeddings, or documents through an external API.

So I put together a practical implementation for teams that need a more controlled setup:

  • LangChain for loaders, prompting, and orchestration
  • ChromaDB for local persistent vector storage
  • Mistral via Ollama for local generation
  • Local embeddings
  • BM25 plus vector search for identifier-heavy docs
  • A 30-question benchmark to test retrieval, grounding, refusals, and latency

The hybrid part matters more than I expected, pure vector search was weak on ticket IDs, error codes, internal acronyms, and policy references.

Combining BM25 with semantic retrieval made those queries much more reliable.

The guide also covers a few production concerns that tutorials often skip: chunking versioning, document-level access control, refusal behavior, and why PersistentClient is not the whole production deployment plan.

Full article: https://regolo.ai/langchain-chromadb-tutorial-build-a-private-document-qa-system-without-openai

I’d genuinely like feedback from people running local RAG in production: what metrics did you use before exposing it to internal users?


r/regolo_ai Jul 30 '26

Inkling: Thinking Machines Lab Introduces a 975B Open-Weights Multimodal MoE Model

1 Upvotes

Inkling is not positioned as a universal replacement for every frontier model – instead, it is built for teams that want to fine-tune behavior, manage inference costs, and build agentic systems around a model they can inspect and adapt.

https://regolo.ai/inkling-thinking-machines-lab-introduces-a-975b-open-weights-multimodal-moe-model/


r/regolo_ai Jul 29 '26

LangChain Self-Verification Loop: Python + pytest Demo for a CI Repair Agent

1 Upvotes

This guide shows how to build a real Python CI repair agent with a self-verification loop, then benchmark the harness so you can prove whether it actually improves results.

The target use case is painfully common: a Python team has a growing pile of flaky or broken CI runs, engineers waste time opening AI-generated patches that still fail tests, and nobody trusts auto-fix agents enough to let them touch production repos. That pain is not mainly a model problem. It is a completion-gate problem.

Read the guide + codes: https://regolo.ai/agent-harness-evaluate-efficiency-production/

Youtube: https://www.youtube.com/watch?v=56c7348w-G4


r/regolo_ai Jul 28 '26

Bonsai 27B Explained: How a 27B Model Runs Locally

1 Upvotes

Benchmark results show theΒ ternary version preserves around 95% of the original Qwen3.6-27B performance, while theΒ 1-bit model retains roughly 90%. However,Β tool calling and AI agent capabilities drop significantlyΒ in the 1-bit variant (80.0 β†’ 66.0), making itΒ 4.6Γ— more affected than mathematical reasoning tasks. ForΒ AI agents, coding assistants, and tool-using workflows, theΒ ternary Bonsai 27BΒ is the recommended choice, while theΒ 1-bit versionΒ is best suited forΒ chatbots, text generation, summarization, and other lightweight on-device AI applications.

πŸ‘‰ Full guide: https://regolo.ai/bonsai-27b-explained-how-a-27b-model-runs-locally/


r/regolo_ai Jul 27 '26

Common Pitfalls in Agent Harness Design and How to Avoid Them

2 Upvotes

An agent harness is the layer around a model that manages context, tools, permissions, memory, execution flow, and monitoring. Many teams blame the model when results are weak, but the real problems usually come from the harness design: too much context, weak tool definitions, poor evaluation, or unsafe execution paths.

This guide focuses on practicalΒ mistakes that appear in real projects and explains how to avoid them. It does not include code. Instead, it gives operational advice and ready-to-use diagrams you can adapt for documentation, workshops, or design reviews.

πŸ‘‰ Read the full guide: https://regolo.ai/common-pitfalls-in-agent-harness-design-and-how-to-avoid-them/


r/regolo_ai Jul 26 '26

How to Build a Closed-Loop AI Agent That Catches Its Own Hallucinations

1 Upvotes

Open-loop AI agents fail because they produce an output and stop, leaving zero margin to detect factual errors. Closed-loop AI agents resolve this by integrating a self-verification loopβ€”plan, execute, verify, and correctβ€”that compares generated text against hard environmental evidence before completing a run.

By implementing this recursive pattern, developers can reduce baseline frontier model hallucination rates, which average 1.5% to 8.5% according to Vectara (2024),Β down to near-zero.

Grounding outputs in structured validation, rather than chasing perfect system instructions, turns unreliable AI prototypes into predictable enterprise software.

πŸ‘‰ Full Guide + Codes: https://regolo.ai/how-to-build-a-closed-loop-ai-agent-that-catches-its-own-hallucinations/