MINIMUM REQUIREMENTS  Lead Data Engineer with 10+ years of experience Airflow Frameworks (required) Top 3 technologies: SparkPythonShell (required) Spark experience required (pyspark required) Good knowledge of open source Strong Experience with big data tools and data processing: Hadoop, Spark, Scala, Kafka, ShellYarn cluster, Java, etc