 SEEKING WORK, Senior Data Engineer, London UK and remote
Software engineer with 13 years of experience. I have been doing data engineering projects for 7 years now.
Core langages : Python / Java / Scala / Bash
Core techs : Hadoop / Spark / Hbase / Airflow / Kafka / Solr / Zookeeper
I have been using AWS &amp; DigitalOcean for few users now and can easily adapt to use other cloud providers.
Exmaple of a recent project :
  - Built and productionised a workflow management solution based on Apache Airflow for a client of mine.

  - Delivered an apache airflow docker based solution running on AWS ECS cluster. I have built terraform scripts to build AWS ec2 infra and ecs services.

  - Migrated various existing pipeline (doing various stuff such as spark jobs...etc.) to airflow and setup best practises for the data engineering team.

I have worked successfully in the past remotely with startups and people on different timezone (SF).
Contact : illy2kevin at hotmail.com