Azure Kubernetes Service or Azure Container Apps for OpenWebUI Deployment?
Hi everyone,
I’m currently working on deploying OpenWebUI (a ChatGPT clone) in an enterprise environment. The application has multiple components:
- The application itself
- Various supporting services
- A database
Right now, everything runs on a single VM as Docker containers. However, for better scalability and zero-downtime deployments, we need a more robust solution.
We’re considering two options in Azure: Azure Kubernetes Service (AKS) or Azure Container Apps (ACA).
Some additional context:
- We already have Helm templates and Kubernetes manifests for the app.
- We have experience managing Kubernetes clusters, but mostly with on-premises vanilla Kubernetes.
- There are 2 DevOps engineers available to manage this deployment.
Questions:
- Is the effort required to manage AKS reasonable for a team of 2 DevOps engineers?
- How much less operational overhead does AKS have compared to an on-premises vanilla Kubernetes cluster?
- Would Azure Container Apps be a better choice given its more "hands-off" nature, or would it limit flexibility for an app like OpenWebUI?
Looking forward to hearing your thoughts and experiences!
Thanks in advance!