How Razorpay Moved 2,500 DAGs to Airflow 3, One DAG at a Time

Airflow, the scheduler behind Razorpay’s batch data pipelines, now runs on version 3.3, and we led the move from 2.10. It runs more than 2,700 DAGs and about 11,000 task runs a day, and we got there without a big-bang cutover. The official upgrade guide is the place to start for code changes. This post is about what happened when we ran Airflow 3 at that scale: the architecture change behind most…

This is an excerpt. The full article continues at Razorpay.