Data Engineer will work closely with the rest of the product team and business peers to effectively execute Data project initiatives. This person should be able to deliver in a fast-paced and deadline-driven environment. Along with development, candidate will be responsible for maintenance of the data applications and would be expected to automate the processes with no or minimal human intervention.
Development and maintenance of ELT snowflake data warehouse solutions
Collaborate with internal and external technology and business partners to implement product changes
Produce detail design and unit test documents, as required
Critically analyze business requirements, architect and implement Data solutions
Define, develop and maintain standards and processes to ensure effective ETL solution
Production maintenance
Work closely with product manager to develop and execute action plans to address gaps
Recommend innovations that enhance and/or provide a competitive advantage to the organization
Communicate effectively with both the business and technical teams
Mentor junior offshore developers to accomplish results
Build and continuously improve data engineering best practices
Min 8 years of Data engineering experience using ETL/ELT technologies
6+ years ETL/ELT experience working with IICS, Informatica, StreamSets, DBT, Python, Data bricks, Snowflake and ADF or equivalent technologies
4+ years hands on experience with Snowflake
Experience working with SSIS, SSRS, and Power BI
3+ years hands on experience working in an Azure environment.
Experience working in insurance or reinsurance industry is highly desirable
3+ years hands on experience with agile methodologies
Experience with Data warehouse/ data lake/ data hub modeling
Experience working with external data feed to enrich internal data- desired
3+ years hands on experience with data standardization/conformance/transformation process
Solid understanding of MDM and reference data
3+ years hands on experience with CI/CD process, especially in data engineering
Experience working in SOX and SOC-2 compliant environment
Experience with automated monitoring of data loads
Support of production environment
Strong understanding of technologies utilized in the industry and the ability to see their impact as well as enhancement management and product lifecycle development
Knowledge of source code version control systems such as Git including branching/merging, resolving code conflicts, and 3-way and baseless merges
Relevant experience working with 3rd party vendors to deliver results