We are looking for a seasoned, software engineer with a passion for data who has hands-on experience building and debugging SQL Server databases, data pipelines, data transformations, and APIs. The ideal candidate will play a pivotal role in shaping the future of our data analytics, business intelligence and data governance initiatives by leveraging data, visualization and data platform technologies while partnering with cross-functional teams and departments. The Software Engineer will be responsible for developing data, coding ETL solutions, using SQL to investigate data and working with the Data Product team to deliver user stories as part of the company’s data roadmap. This position requires a data-driven individual with strong technical skills, as well as the ability to communicate effectively with stakeholders.
Responsibilities
- Design new data infrastructures, including the Lakehouse, data warehouses, dataflows, data pipelines, semantic models, and reports.
- Migrate large-scale data stores from the existing on-premises SQL Server infrastructure to the new Microsoft Fabric-based infrastructure.
- Classify and organize data base on identified taxonomy structures.
- Work with the data architect to ensure that the data is of high quality and meets the organization’s requirements.
- Optimize data processing by using modern data engineering tools such as notebooks, dataflows, data pipelines, semantic models, and reports.
- Contribute to positive, trusting, inclusive culture and team-first environment.
- Provide technical expertise during the design, planning, design, development, implementation, and testing of digital solutions, often custom developed and integrating new technologies
- Understand technological systems and strategic vision and help facilitate the technical portion to produce integrated end-to-end digital solution options
- Participate in cross-project planning and release planning activities
- Serve as a stakeholder of the technical backlog: identify opportunities in our system, capturing the ideas in user stories, and meeting with other stakeholders to prioritize them
- Write and maintain concise documentation about our development process and major systems
- Build scalable, maintainable, easy-to-use software following our development best-practices and requirements laid out by the architect and the development team
- Create and maintain the build, deployment, and test automation portions of our DevOps pipeline
- Participate in team’s building and testing of the team’s applications within the sprints
- Collaborate with product owner and end-users to understand any desired business functionality and craft intuitive, responsive UIs to match
- Regularly review application logs and dashboards to proactively monitor for defects, gauge performance, and troubleshoot production problems
- Participate in the development of logical and detailed design deliverables (e.g. storyboards, activity/state diagrams, class diagrams, sequence diagrams, etc.) for each application component based on enterprise conceptual designs
- Keep up-to-date on cutting edge technology, standards, protocols and tools in areas relevant to the rapidly changing digital environment
- Troubleshoot and support user acceptance testing, rollout efforts and the team’s systems in each environment
Experience And Skills Required
- 5+ years software engineering experience with at least 3 years in C#.
- Excellent relational database skills writing SQL, analyzing, and optimizing query plans, and writing DDL scripts.
- Passion for building clean and testable code, creating unit tests, and focusing on code quality.
- Extensive knowledge and experience with Power BI or other widely used data solutions.
- 2+ years experience building solutions for any major public-cloud provider (Azure preferred)
- 3+ years’ experience with data platform technologies such as Kafka, Hadoop, or Spark but preferably those in the Azure platform such as HD Insight, Synapse, Data Lake, and Data Factory.
- Highly self-motivated and directed with strong sense of curiosity and drive to accomplish goals and lead data product team.
- Passion for data and data quality.
- Experience with API and integration concepts.
- Experience with XML, SQL, relational databases, and large data repositories.
- Exceptional verbal and written communication and collaboration skills, with the ability to interact effectively with a wide range of technical and non-technical stakeholders including executive and senior leaders.
- Experience with Agile methodologies, particularly Scrum, and a track record of successful product delivery
- Bachelors in Computer Science or related field