7+ years of relevant work experience in software development or data engineering, with a strong focus on integration and event-driven systems.
Proficient in Python for building scalable, event-driven systems and APIs.
Strong experience with relational database management systems (RDBMS), including schema design, optimization, and querying.
Familiarity with distributed messaging systems like Kafka and AWS SQS.
Hands-on experience deploying and managing serverless architectures in AWS (e.g., Lambda, S3, K8s, SQS, API Gateway).
Experience with Infrastructure & Configuration as Code tools (Terraform, Ansible) and optimizing CI/CD pipelines in GitLab.
Able to create and manage CI/CD pipelines (GitLab CI/CD, GitHub Actions)
Experience designing and developing real-time data integrations using event-driven or streaming architectures.
Excellent problem-solving and debugging skills in distributed environments.
Process-oriented with strong documentation skills.
Knowledge of Agile development methodologies.
Experience with AWS Redshift and orchestration tools like Airflow, MageAI are nice-to-have.
Responsibilities Section:
Develop, test, and maintain real-time data pipelines and integrations to connect business IT systems.
Design and implement robust API and event-driven integrations with a focus on quality, scalability, and performance.
Troubleshoot and improve existing CI/CD pipelines to ensure reliable deployment of serverless applications.
Deploy and manage serverless architectures using AWS Lambda, S3, SQS, and API Gateway.
Collaborate with stakeholders to ensure seamless integration between business IT systems.
Address issues related to Infrastructure as Code (Terraform, Ansible) to enhance deployment reliability.
Write comprehensive unit, integration, and functional tests to ensure system reliability.
Document solutions, ensuring clear communication of architecture and integration processes.
Contribute to planning and designing future API deployments on Kubernetes (K8s).
Leverage Python API frameworks like FastAPI or Flask to build performant and maintainable APIs.
Design, optimize, and maintain relational database schemas and queries for integrations and data storage.
Troubleshoot issues and support the platform including team support rotations.