Spark advanced, Apache Airflow intermediate Experience Prior experience and enough knowledge of the Beam SDK to build reusable Beam libraries and components in the areas of pipeline observability, alerting data controls technical metadata extraction