Category Airflow

XCom Sending Data Between Airflow Tasks

Introduction In this article we will walk through the most commonly used method to sharing data between airflow tasks with example. In airflow XCom use to communicate small message between tasks and a good way to passing large data between…

Read More

How to create SUBDAG in airflow ?

We can put many tasks(operators) in one subdag. We can keep our dag clean by using subdag. By clicking on the subdag which is section-1 here, we can see the tasks under it. Which is look like as below, We…

Read More

Airflow Installation

Below are given steps to install airflow on ubuntu system after update command lets upgrade create python virtual environment after successfully created virtual environment lets install airflow create user for airflow run below command once user created start webserver open…

Read More