Using a custom operator for transfer data between dags in apache airflow
Using Cross Task Communication (XComs) in apache airflow
After having to much of theory, we will not start with the coding of our own dags. We will be focusing on on airflow 1.x
We will take a detail view in the airflow ui
I am starting a series of content regarding Apache Airflow. In the first part we will be looking on the basics.
An overview about Apache Spark and hints with debugging it in case your code is not working