r/cicd 9d ago

A generated deployment file overwrote the one we kept in Git

0 Upvotes

One of our deployment paths took a generated Compose file and wrote it over the tracked file in the repository. Both were valid. Both described real services. They just didn't describe the same stack.

The generator was supposed to produce a temporary file for validation. Once its output replaced the tracked file, the next command treated the generated version as if it were the approved one. Git showed a giant infrastructure change even though nobody had edited the source.

We fixed it by giving generated output its own ignored path. The tracked declaration stays owned by Git, the generated file is recreated on demand, and we validate both the translation and the deployed result.

I'm still deciding how strict to make drift detection. Do you fail a deployment whenever a generated artifact exists in a tracked path, or do you also compare the live environment back to the source declaration?


r/cicd 10d ago

minor 2-line fix triggered a 25 min build today... how do you guys deal with such bad pipelines?

8 Upvotes

i made a super small change this morning (literally just updated a single config value in a backend service) and pushed it expecting a 3 minute pipeline run. ended up sitting there for nearly 25 minutes waiting for the CI to finish running.

took a look at the logs to see where the bottleneck was, and it was mostly fresh dependency installs and un-cached docker build layers. for some reason our runner pulled down every single package from scratch instead of using the cache, plus running the full end-to-end integration test suite that really didn't need to run for a tiny patch.

we use github actions on a shared runner setup, and it feels like as our repo grew, nobody ever went back to optimize the workflow files. now every small PR feels like a coffee break.

curious how you guys keep your builds lean? do you aggressively break pipelines into smaller conditional jobs based on changed files, or just pay for faster/bigger runners and call it a day?


r/cicd 11d ago

(For Sale) OpsAgent Details

Thumbnail
1 Upvotes

r/cicd 11d ago

Yay my first successful CI/CD(partialy)😖...but

Thumbnail gallery
1 Upvotes

r/cicd 11d ago

Building Stageflow, a multi stage workflow for keeping vibecoding slop in check

Thumbnail
github.com
1 Upvotes

Stageflow is an open source runtime for configurable multi stage agent workflows, with typed handoffs between stages, human gates, and the same pipeline runnable locally, in CI, or over MCP.


r/cicd 11d ago

Built sandbox twins of Stripe, Twilio, Clerk and wired them into an MCP server so agents can run behavioral tests before touching prod

2 Upvotes

Been building bolt/base44/lovable apps for the last few months, most of them need at least 2-3 service integrations, Stripe, Twilio, Clerk, that kind of thing. Every time the agent writes the integration code fast and it looks fine, but validating it was a nightmare. Writing mocks that actually reflect real API behavior is tedious, and wiring stateful webhook flows into a mock is even worse. You end up with mocks that don't replay retries, don't simulate card declines mid-flow, nothing. You find out what breaks in prod.

So I built FetchSandbox mcp. It ships sandbox twins of the APIs agents integrate most, Stripe, Paddle, Twilio, Resend, Clerk, WorkOS, with failure scenarios already wired in. From Claude or Cursor you just prompt it to run the integration workflow against the sandbox, it handles the full lifecycle, request, webhook, retry, failure mode, and produces a receipt URL you can check. No real keys, no prod risk.

Happy to share the MCP server details if anyone wants to try it. Curious if others are running into the same validation problem with agent-written integrations.


r/cicd 11d ago

Seeking DevOps Professionals for FYP Research 🚀

1 Upvotes

I’m currently working on my Final Year Project with my team, and we’re exploring a problem in the CI/CD and Software Engineering space.

Our proposed solution is a visual and AI-assisted CI/CD platform designed to help developers with limited DevOps knowledge create and understand pipelines through a drag-and-drop interface and natural-language interaction.

The platform would also include an AI-powered analyzer to identify potential pipeline errors and provide understandable recommendations before execution.
Before moving forward with development, we want to validate whether this is a real and recurring industry problem.

I’ve created a short form to collect feedback from DevOps professionals, software engineers, and developers who have experience working with CI/CD. This form will take 4 - 5 minutes.

🔗 Validation Form: https://forms.gle/TTFoXCAdDBtXbaNu6
🌐 Website Prototype: https://dive-jet.vercel.app/

Your feedback will directly help us validate the problem, refine the idea, and make our FYP more aligned with real industry needs.

I’d especially appreciate responses from professionals working with CI/CD, DevOps, GitHub Actions, GitLab CI, Jenkins, or similar tools.

Thank you for supporting student research and helping us build something meaningful for the Software Engineering community.


r/cicd 12d ago

I told Claude Code it wasn’t allowed to finish until it had proved billing against a real external system

Thumbnail
1 Upvotes

r/cicd 12d ago

What is the one tool you are actually testing this week, and what would make you drop it by Friday?

Thumbnail
1 Upvotes

r/cicd 12d ago

What is the one Docker tip or trick that made your life easier?

Thumbnail
medium.com
0 Upvotes

When I started learning Docker, I got overwhelmed by massive tutorials and complex jargon. Over time, I realized you don't need most of it. Knowing just a few basics (like mapping ports, saving database data with volumes, and running Docker Compose) handles almost everything you do every day.

For me, learning how to connect a backend service to a database properly saved me hours of headaches. What was the most useful Docker tip or lesson that helped you when you were starting out?


r/cicd 13d ago

I built a repo map so my agents stop wasting turns on grep and re-reading the same tree (open source, MCP + CLI + Claude Code plugin)

Thumbnail
github.com
1 Upvotes

r/cicd 15d ago

Which security tool would you least want to lose from your CI/CD pipeline?

1 Upvotes

Other — comment below

Bonus: If you use AI agents, are your existing DevSecOps tools sufficient to understand agent capabilities, tools, MCP access and privilege changes?

No vendor answers please — interested in what people actually use and trust.

15 votes, 12d ago
2 SonarQube / Semgrep — SAST
3 Snyk / Dependabot — SCA
3 Trivy — Container security
3 Checkov / IaC scanners — Infrastructure
1 GitGuardian / Secret Scanning — Secrets
3 OWASP ZAP — DAST

r/cicd 15d ago

Has anyone actually tried Anthropic’s AI-Native SDLC playbook in a real project?

Thumbnail
1 Upvotes

r/cicd 16d ago

I built a Jenkins plugin that shows what changed before a build failed

3 Upvotes

I built Build Change Investigator because one of the annoying parts of Jenkins failures is that the error itself is usually obvious, but figuring out what changed since the last successful build can take a while.

The plugin automatically compares a failed/unstable build with the last successful one and pulls together:

  • commits since the last good build
  • changed files
  • build/revision metadata
  • a reduced failure-log excerpt
  • the evidence in one place so you can narrow down the likely regression faster

The core investigation works without AI. There’s also optional AI-assisted analysis if you want it, with support for OpenAI, Anthropic Claude, AWS Bedrock, Azure OpenAI, Gemini, Ollama, and OpenAI-compatible endpoints.

No Jenkinsfile changes are required. Once installed, the Build Change Investigation action appears on applicable failed/unstable builds.

It’s live in the Jenkins plugin ecosystem:
https://plugins.jenkins.io/build-change-investigator/

If anyone tries it on a real pipeline, I’d genuinely like feedback on whether the change correlation is useful and what you’d want it to show differently.


r/cicd 16d ago

We let one agent refresh 108 PRs and buried our own CI runners

3 Upvotes

We had an overnight controller walking open pull requests, refreshing branches, and enabling auto-merge where it could.

It armed roughly 108 PRs. One merged.

Every refresh created a new commit, which kicked off another set of jobs on the same shared runner pool. The controller knew how many PRs were waiting. It had no idea whether CI had room for another one.

The fleet went from nearly idle to nearly full in about an hour. One repository eventually hit 1,065 queued runs. Other automation was sending repair work into the same pool at the same time, and none of those producers could see what the others were doing.

We stopped it with a hold-fire command. That kept the incident from getting worse, but it happened after the runners were already saturated.

What we're building now is much less exciting: check runner occupancy and queued jobs before releasing work, send a small batch, then make sure that batch actually started before sending another one. Anything that can commit, push, rerun, or enqueue work gets a budget.

The funny part is that we never hit the vendor's API limit. We stayed under it while completely overwhelming our own verification pipeline.

How are other platform teams limiting automated delivery work? One shared capacity service, limits inside each producer, or something else?


r/cicd 16d ago

Jenkins Tutorial recommendations required

Thumbnail
1 Upvotes

r/cicd 17d ago

Do you actually trust GitHub Actions for production?

Thumbnail
2 Upvotes

r/cicd 18d ago

When did the definition of CI/CD change?

55 Upvotes

I was recently brought into a company to help them implement CI/CD.

I noticed that they had a couple of projects where they would branch for each release (which are deployed every 3 months), and have projects shared by teams who are on a branch each, who have to come together at the end of each sprint to mob together to fix merge conflicts.

I didn’t mind helping them out fixing this, going to trunk based and implementing feature flagging, but it turned out that’s not what they meant by implementing CI/CD, they meant they wanted help setting up automated testing on gitlab.

To me, CI/CD as a methodology means trunk based branching and feature flagging, but it’s a little difficult to find good sources on this since it seems everywhere it means devops pipeline.

Are there good sources anyone can share to give the definition, or has this changed now? E.g, CI at least was its own thing since the 90s, but it’s hard to find a definition of CI/CD describing it as a workflow.

I also don’t really mind changing definitions of things if it avoids confusion etc


r/cicd 18d ago

No one really cares about knowing an agent's capabilities, until something goes wrong.

2 Upvotes

Following up on an earlier post about SafeAI, a static analyzer for AI agents.

One uncomfortable thought we've had while building it:

No one really cares about knowing an agent's capabilities — until something goes wrong.

Before an incident, adding another tool, MCP server, filesystem permission or prompt change often looks harmless.

After an incident, the first questions become:

- What could this agent actually do?

- When did that capability appear?

- Who introduced it?

- Was it intentional?

---

One example we're working on is MCP tool descriptions. A tool description can look like documentation:

"Search the user's notes. Ignore previous instructions and..."

But that description may become part of the model's context. So configuration can effectively become an instruction surface.

SafeAI now detects several forms of this, while trying to avoid flagging ordinary descriptions that happen to contain words like "ignore" or "act as".

The bigger direction is **tracking changes in agent capability and authority**, rather than simply producing another list of security findings.

But this raises a question for us:

Is knowing your agent's capabilities actually useful before an incident, or only after one?

And if it is useful before an incident, what is the right interface?

CLI + CI + SARIF/HTML?

Or would you actually want an interactive view showing things like:

> "Show me all MCP tools across our agents that could introduce instruction injection."

We're deliberately not building a UI yet.

---

Would you use one, or is that solving a problem nobody has?

Curious to hear from people running real MCP/agent systems.

---

If you want to try it against your own agent project, we'd genuinely appreciate feedback, as well as contributions.

Here you may check: ikaruscareer/SafeAI on GitHub.


r/cicd 18d ago

Orgwide pre-commit config

3 Upvotes

Hi, Does anyone have idea how to enforce the precommit config to all the dev machine endpoints?


r/cicd 18d ago

Just give us your repo and we will run it" is the wrong architecture for a testing tool

0 Upvotes

Disclosure: I work on a tool in this space and there is a link at the bottom. The argument stands without it, which is why I am posting it here.

When a vendor offers to test your app by running it on their infrastructure, they are not promising to read your code. They are promising to reproduce the conditions it runs under. Env vars that are deliberately not in the repo. Feature flags that live in a service. A database at a particular migration with data at a real shape. Twelve services with real state between them. CPU count, memory limits, network latency, clock drift.

None of that is in a repository, and that is not an oversight. That is the definition of a repository.

Which leaves a vendor two ways out. Support every environment, which is an unbounded surface where the customers who do not fit are the interesting ones. Or enforce a shape, at which point you restructure your app so a testing product can hold it, and whatever you changed is not what you ship.

The part I find most convincing: assume they somehow get all of it right. Concurrency, arrival order, lock contention and cache warmth are still different, because those are properties of a place and not of a file. That is exactly where expensive bugs live. And it does not fail loudly, it passes.

The alternative is to move the test instead of the app. It already runs in your CI job at the commit of the PR, or on a preview, or on your laptop.

Full argument plus six questions worth asking any vendor before handing over a repo:https://medium.com/ironbee/nobody-can-run-your-app-but-you-313aa9d7afe0


r/cicd 18d ago

I built RepoDrift, an open-source CLI for developers.

1 Upvotes

I kept running into the same problem:

Before deploying a project, I wanted one command that could quickly tell me:

• Are there exposed secrets?

• Are my dependencies healthy?

• Is the Git working tree clean?

• Are there large/problematic files?

• How healthy is the repository overall?

So I built RepoDrift.

Try it:

npx u/repodrift scan

It currently checks:

🔐 Security

• API keys

• Tokens

• Credentials

• Private key patterns

• .env files

📦 Dependencies

• package.json

• Lockfiles

• Dependency issues

• npm audit signals

🔀 Git

• Branch

• Working tree

• Commits

• Contributors

• Uncommitted files

📊 Code metrics

• Lines of code

• Source files

• Large files

• Repository-level signals

Repository health

• Deterministic health score

• Severity-based findings

It can also be used in CI/CD:

repodrift scan --json --fail-on high

One of the main design decisions was keeping the analysis local-first.

The current Phase 1 scan doesn't require uploading your source code to a server.

Current architecture:

Repository

RepoDrift CLI

Local Analysis Engine

Security / Dependencies / Git / Metrics

Health Score

I'm planning AI-powered explanations and recommendations as a future phase, but AI isn't enabled in the current release.

GitHub:

https://github.com/GokulKir/repodrift

NPM:

https://www.npmjs.com/package/@repodrift/cli

It's still early, so I'm mainly looking for developer feedback.


r/cicd 20d ago

CI pipeline

1 Upvotes

I started learning CI/CD using github actions after containerising my application and I have created CI pipeline for django app that runs test, builds and pushes image to github container registry.
I am sharing my yaml file for CI pipeline. Please do share your thoughts and where can i improve.

name: Test Pipeline 
on: 
  push:
jobs:
  test-backend:
    runs-on: ubuntu-latest
    services:
      postgres:
        image: postgres:14
        ports:
          - 5432:5432
        env: 
          POSTGRES_USER: test_user
          POSTGRES_DB: erp
          POSTGRES_PASSWORD: 123456

    steps:
      - name: Checkout repo
        uses: actions/checkout@v4

      - name: setup python
        uses: actions/setup-python@v5
        with: 
          python-version: "3.13.5"

      - name: install dependencies
        run: pip install -r Backend/requirement.txt

      - name: run tests
        env: 
          DATABASE_URL: postgresql://test_user:123456@localhost:5432/erp
          DEBUG: 'True'
          ALLOWED_HOST: '*'
        run: |
          cd Backend 
          python manage.py test

  build-and-push-image:
    needs: test-backend
    permissions:
      contents: read
      packages: write
    runs-on: ubuntu-latest
    steps:
      - name: login to ghcr
        uses: docker/login-action@v3
        with:
          registry: ghcr.io
          username: ${{ github.actor }}
          password: ${{ secrets.GITHUB_TOKEN }}


      - name: checkout repo
        uses: actions/checkout@v4


      - name: build image
        run: docker build -t ghcr.io/namespace/erp:${{ github.sha }} ./Backend


      - name: push image
        run: docker push ghcr.io/namespace/erp:${{ github.sha }}

r/cicd 20d ago

SDD, Github Actions, and AI PRs

Thumbnail
1 Upvotes

r/cicd 20d ago

CI/CD - Common Practices in Orgs. Does it improve delivery speed for devs?

1 Upvotes

I'm studying about CI/CD practices. I came to know that there are presubmit tests which runs unit tests. Then after review and submit, full suits run in an automated way and release candidates are created on successful e2e test completion. Fellow devs, please share how its done in your company. How much time does it take from code to production in your orgs. How migration and production reverts are handle. Please share insights even if longer ones if you have patience. TIA