Python Data Engineer
Remote in Ireland only
Company Overview:
Our client is a leading global platform for eCommerce enablement and analytics. Their innovative software solutions empower brands to grow by accelerating sales, driving profitability, and converting customers worldwide. Backed by prestigious investors, we are on a mission to revolutionize the eCommerce landscape.
Role Overview:
As a Senior Python Engineer (Data), you will play a critical role in designing, building, and optimizing data pipelines and analytics solutions for our platform. You will work closely with Software Engineers, Data Engineers, and Product Managers to develop scalable and high-performance data processing solutions. This is a hands-on role where you will contribute directly to the codebase while also influencing architectural decisions and best practices.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines, data processing systems, and analytical components.
- Implement efficient and scalable ETL processes using Python, Pandas, PySpark, or NumPy.
- Optimize data storage, retrieval, and processing performance across relational and NoSQL databases.
- Develop and maintain APIs for data access and integration, utilizing FastAPI (Django or Flask also acceptable).
- Collaborate with cross-functional teams to define data engineering best practices, ensuring reliability, scalability, and performance.
- Participate in code reviews, technical documentation, and the continuous improvement of engineering processes.
- Debug and resolve complex data-related issues in production systems, ensuring high availability and accuracy of data.
- Work with CI/CD pipelines, monitoring tools, and automation frameworks to streamline data processing workflows.
- Contribute to architecture discussions and influence the direction of data infrastructure and platform development.
Required Skills & Experience:
- 5+ years of experience as a Python Data Engineer or Software Engineer with a strong focus on data processing and analytics.
- Proven expertise in Python and data processing libraries such as Pandas, PySpark, or NumPy.
- Experience working with ETL processes and data engineering pipelines.
- Strong SQL skills and experience with both relational and NoSQL databases (MongoDB experience is desirable but not essential).
- Experience with FastAPI, Django, or Flask for building and consuming REST APIs.
- Knowledge of distributed systems, queuing mechanisms, and event-driven architectures.
- Hands-on experience with cloud platforms, particularly AWS, for data engineering workloads.
- Exposure to CI/CD pipelines and automation frameworks for data workflows.
- Ability to analyze, debug, and solve complex technical challenges efficiently.
- Excellent communication skills and ability to collaborate effectively with engineers, product managers, and other stakeholders.
Why Join Us?
- Work on cutting-edge data solutions in a fast-paced and high-impact environment.
- Collaborate with a talented and passionate team of engineers and product professionals.
- Competitive compensation, flexible work arrangements, and opportunities for professional growth.
- If you are passionate about data engineering, love working with large-scale data systems, and want to make a real impact in the eCommerce space, we’d love to hear from you!