Will need to work US (EST timezone) -9-6PM EST
Project Description:
- Our client is a US subsidiary of a global financial house working in multiple markets and asset classes.
- The client has a requirement to migrate a big number of applications/systems running on hundreds of Windows/Unix servers (prod/non-prod) and components marked as EOL (End-of-Life) - Win 2012/2014, UNIX RHEL6, SQL 2016, Java 8, etc. to modern versions.
- The scope of activities will include migration of applications (including DB/MW) and underlying infrastructure layer (OS, ESX, storage) to the latest (stable) infra stack: (Win 2012/2014 -> Win 2019, Unix RHEL6 -> Unix RHEL7), SQL 2016 -> SQL 2019, Java 8 -> Java 11. The project also involves some application technology stack modernization
- We are currently looking to build a distributed ~20 strong team of functional analysts, infrastructure and DevOps specialists, test engineers and developers led by an on-site project manager to assume full responsibility for project delivery.
- Anticipated project duration is ~ 1 year. Luxoft is proposing permanent employment, competitive salary and benefits package and possibility to move to different projects within Luxoft upon the project completion.
- The intent is to operate in WFH mode mostly, working from the office is possible upon request.
Responsibilities:
- • Deep understanding of star and snowflake schema, dimensional modelling.
- • Experience in Migration processes to Snowflake from on-premises database environment.
- • Experience in design and implementation of data pipelines and ETL processes using Snowflake.
- • Optimize data models for performance and scalability.
- • Collaborate with various technical and business stakeholders to define data requirements.
- • Ensure data quality and governance best practices are followed.
- Experience with data security and data access controls in snowflake.
- • Expertise in complex sql, python scripting and performance tuning.
- • Expertise in Snowflake concepts like setting up Resource monitors, RBAC controls, scalable virtual warehouse, SQL performance tuning, zero copy clone, time travel and automating them.
- • Experience in handling semi-structured data (JSON, XML), columnar PARQUET using the VARIANT attribute in Snowflake.
- • Experience in in re-clustering of the data in Snowflake with good understanding on Micro-Partitions. Experience in Migration processes to Snowflake from on-premises database environment.
- • Experience in designing and building manual or auto ingestion data pipeline using Snowpipe.
- • SnowSQL experience in developing stored Procedures writing Queries to analyze and transform data
- • Experience in CI/CD of the Snowflake deployments
Mandatory Skills Description:
- • Deep understanding of star and snowflake schema, dimensional modelling.
- • Experience in Migration processes to Snowflake from on-premises database environment.
- • Experience in design and implementation of data pipelines and ETL processes using Snowflake.
- • Data models optimization for performance and scalability.
- • Experience with data security and data access controls in snowflake.
- • Expertise in complex sql, python scripting and performance tuning.
- • Expertise in Snowflake concepts like setting up Resource monitors, RBAC controls, scalable virtual warehouse, SQL performance tuning, zero copy clone, time travel and automating them.
- • Experience in handling semi-structured data (JSON, XML), columnar PARQUET using the VARIANT attribute in Snowflake.
- • Experience in in re-clustering of the data in Snowflake with good understanding on Micro-Partitions. Experience in Migration processes to Snowflake from on-premises database environment.
- • Experience in designing and building manual or auto ingestion data pipeline using Snowpipe.
- • SnowSQL experience in developing stored Procedures writing Queries to analyze and transform data
- • Experience in CI/CD of the Snowflake deployments
Nice-to-Have Skills Description:
- • JIRA/Confluence
- • Control-M
- • Microsoft Message Queue (MSMQ)
- • Experience in finance/capital markets