Experience in working with a big data implementation in production environment Experience in Spark, ScalaPython is must Experience in Unix shell scripting is must Experience in Map reduce, Hive, Impala, Kafka technologies Sounder understanding and experience in relational databases (SQL), preferably SQL server Experience in developing ingestion frameworks using Spark and Sqoop