service-catalog/manifests/helm/openmetadata-dependencies/1.12.1/charts/airflow

Helm Chart for Apache Airflow

Apache Airflow is a platform to programmatically author, schedule and monitor workflows.

Introduction

This chart will bootstrap an Airflow deployment on a Kubernetes cluster using the Helm package manager.

Requirements

• Kubernetes 1.30+ cluster
• Helm 3.0+
• PV provisioner support in the underlying infrastructure (optionally)

Features

• Supported executors (all Airflow versions): LocalExecutor, CeleryExecutor, KubernetesExecutor
• Supported executors (Airflow version 2.X.X): LocalKubernetesExecutor, CeleryKubernetesExecutor
• Supported AWS executors with AWS provider version 8.21.0+:
  • airflow.providers.amazon.aws.executors.batch.AwsBatchExecutor
  • airflow.providers.amazon.aws.executors.ecs.AwsEcsExecutor
• Supported Edge executor with edge3 provider version 1.0.0+:
  • airflow.providers.edge3.executors.EdgeExecutor
• Supported Airflow version: 1.10+, 2.0+, 3.0+
• Supported database backend: PostgreSQL, MySQL
• Autoscaling for CeleryExecutor provided by KEDA
• PostgreSQL and PgBouncer with a battle-tested configuration
• Monitoring:
  • StatsD/Prometheus metrics for Airflow
  • Prometheus metrics for PgBouncer
  • Flower
• Automatic database migration after a new deployment
• Administrator account creation during deployment
• Kerberos secure configuration
• One-command deployment for any type of executor. You don't need to provide other services e.g. Redis/Database to test the Airflow.

Documentation

Full documentation for Helm Chart (latest stable release) lives on the website.

Note: If you're looking for documentation for main branch (latest development branch): you can find it on s.apache.org/airflow-docs/. Source code for documentation is in ../docs/helm-chart

Contributing

Want to help build Apache Airflow? Check out our contributing documentation.