Core Data Services is currently in process of adopting Spark as our main ETL engine and realizing the value of highly functional, performant and transparent Data Lake, all this while maintaining and streamlining existing data infrastructure and doing careful migration