In this role you will be responsible for,   Hands-on design and development of streaming and IoT data pipelines using Kafka, Spark, Scala and Python    Scripting with Apache Spark and data frame    Designing ETL in Apache Airflow and other dependency enforcement and scheduling tool