Manage the end to end data pipelines that pull data from operational system and from different end points, transform and load the data to the company data lake
Current environment is set up on hadoop, but the team will be responsible to complete migration to a new Spark based environment on AWS

Qualifications:

4+ years of hands-on experience as a Data Engineer
BA/BSc in a related field such as CS, engineering, information systems, or equivalent.
High proficiency in SQL & Python
Experience working with cloud-hosted data warehouses (Hive, Snowflake)
Hands-on experience with developing end-to-end ETL/ELT processes (Spark and SQL)
Experience with the Hadoop framework and parallel computing (EMR, HIVE, Presto/Trino/Athena, Glue)
Proven experience with data warehousing, modeling paradigms, and architectures, proficient in DWH methodologies and best practices

Will be a plus:

Familiar with Kafka, Confluent, Fluentd, Spark, and Airflow
Experience with data visualization tools such as Tableau
Experience with the media or TV industry - an advantage

Soft skills:

Strong analytical skills and attention to detail
Team player
Ability to handle several tasks simultaneously
Comfortable working independently and leading projects from end to end

About the company

Globaldev Group is a team of professionals specializing in creating engineering teams for technological businesses for the Western Europe, Israel, USA. Only long-term product teams for EU with investments and a modern stack of technologies.

We set up the company in 2010 in Kharkiv. In 2017 we opened the office in Berlin. Currently, there are 220 of us and we are constantly growing.
Now in 2022 we have development hubs in Israel, Ukraine, Portugal and Poland.

If you’re interested in joining the team and taking part in decision making that will affect the product and business – let us know!