Python Developer

We are currently seeking a motivated Python Engineer to join our data pipeline initiatives. The Data Engineering team plays a crucial role in designing, building, and optimising data pipelines, integrating vendor solutions, ensuring data availability, and maintaining data security and compliance. Additionally, the team collaborates closely with the data science team to implement analytics methodologies and algorithms within these data pipelines and workflows.

In this role, you will:

• Develop and Maintain Data Pipelines: Design, build, and optimise data pipelines using Python to ensure efficient data flow and availability.

• Implement Data Science Methodologies: Work closely with the data science team to effectively integrate and operationalise analytics methodologies and algorithms within data pipelines and workflows.

• Collaborate with Cross-Functional Teams: Work closely with data scientists, analysts, and business stakeholders to gather requirements and deliver data-driven insights.

• Implement Data Quality Measures: Assist in establishing and enforcing policies for data quality, security, and compliance.

• Monitor Data Pipeline Performance: Continuously assess and improve data pipeline performance to enhance processing efficiency.

• Support Team Members: Aid and guidance to junior engineers, fostering a collaborative team environment.

• Identify Process Improvement Opportunities: Proactively seek ways to enhance data engineering processes and workflows.

What you need to have:

Experience and Education:

• 3+ years of experience in the IT industry, specifically in python engineering or related roles.

Technical Skills:

• Proficiency in Python: Strong ability to develop, debug, and analyse Python object oriented modules for data processing and pipeline development. Bonus: Pandas/Numpy
• Proficiency in SQL: Ability to develop, debug, and analyse SQL queries.
• AWS Cloud Services: Familiarity with AWS resources such as Lambda, Glue, and Step Functions.
• Database Skills: Strong technical skills in databases, particularly with Postgres.
• ETL Development: Understanding of logical mapping and data models, with experience in designing and developing ETL mappings.
• Software Development Lifecycle: Familiarity with the software development lifecycle and agile development practices, including the use of ticketing tools like Azure DevOps (ADO).

Communication and Interpersonal Skills:

• Communication Skills: Good communication and presentation skills to effectively convey technical concepts to stakeholders.
• Interpersonal Skills: Ability to demonstrate good interpersonal skills to communicate effectively with team members and all project stakeholders.
• Stakeholder Engagement: Experience working closely with business stakeholders and development teams.

Problem-Solving and Adaptability:

• Technical Support: Ability to respond to technical queries and requests from team members and customers.
• Process Improvement: Ability to identify opportunities for process improvement and adapt to change.
• Multi-tasking: Ability to manage multiple tasks and liaise with various stakeholders effectively.

Initiative and Proactivity:

• Self-Starter: Be a self-starter who takes independent responsibilities proactively.
• Continuous Learning: Demonstrate a commitment to building knowledge on emerging tools, techniques, and technologies.