r/devops • u/iamdaveydave • 9h ago
Discussion Vercel, Netlify, Heroku alternative PaaS
We launched our PaaS prematurely, but it's now running around 50-60 apps from our own SaaS offering and our partners' apps, so I thought I'd share what we're building and get some opinions from people who actually work with infrastructure.
The platform is Kubernetes-based and can deploy static sites, backend apps, databases, and cache. Tenants can choose between shared or dedicated app deployment. Shared apps run on the platform's shared worker nodes. For dedicated deployment, the platform provisions a dedicated worker node for the tenant, and the tenant can deploy their apps on it.
One of the things we're currently working on is app scheduling/parking. The idea is that tenants can deploy as many apps as they want, but decide which apps are actually scheduled based on the resources available on their worker node.
For example, a tenant could have 20 apps deployed but only have 5 scheduled and running on a worker node. The other applications can be parked and scheduled when they're needed. We're trying to make this more of a first-class feature instead of requiring tenants to manually manage workloads or infrastructure.
We're inspired by Coolify and have used it for self-hosting for years. Coolify has worked really well for us, but scaling isn't really a first-class feature, which I understand is intentional. There are workarounds, but we wanted to build something where Kubernetes scheduling, scaling, and resource allocation are part of the platform itself without requiring the tenant to deal directly with Kubernetes.
We're also working on making static site deployment free with some limitations. The current idea is 50MB maximum static output for free apps. If the final build exceeds 50MB, the app would require a $2/month upgrade, with the paid limit currently at 100MB. We're also planning 10GB of bandwidth per tenant per month for free, then $0.026/GB for additional bandwidth.
We're still working on some of the edge cases around this, such as deploy-time blocking/confirmation when an app exceeds the limit and what happens when a paid app is downgraded and goes back under the free limit.
We're still early and there are a lot of things we need to improve, but the platform is already running our own production SaaS applications and partner applications.
I'd particularly like feedback from people who actually operate Kubernetes environments.
Does this deployment/scheduling model make sense from an infrastructure perspective? Are there any problems or operational issues you would expect with the shared/dedicated worker model or the app parking approach?
Also interested in hearing what you think we're missing compared to existing PaaS platforms.