Senior Data Engineer (Remote)

Verified Job On Employer Career Site

Job Summary:

phData is a dynamic and innovative leader in the modern data stack, partnering with major cloud data platforms to deliver cutting-edge services and solutions. The Senior Data Engineer will design and implement data solutions while ensuring performance, security, and scalability.

Responsibilities:

• Ability to develop end-to-end technical solutions into production — and to help ensure performance, security, scalability, and robust data integration.

• Ability to multitask, prioritize, and work across multiple projects at once.

• Programming expertise in Java, Python and/or Scala, including experience with software development life cycle, including unit and integration testing.

• Core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP.

• Experience using SQL and the ability to write, debug, and optimize SQL queries.

• Client-facing written and verbal communication skills and experience.

• Create and deliver detailed presentations.

• Detailed solution documentation (e.g. including POCS and roadmaps, sequence diagrams, class hierarchies, logical system views, etc.)

Qualifications:

Required:

• 4+ years as a hands-on Data Engineer and/or Software Engineer designing and implementing data solutions

• Ability to develop end-to-end technical solutions into production — and to help ensure performance, security, scalability, and robust data integration.

• Ability to multitask, prioritize, and work across multiple projects at once.

• Programming expertise in Java, Python and/or Scala, including experience with software development life cycle, including unit and integration testing

• Core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP

• Experience using SQL and the ability to write, debug, and optimize SQL queries

• Client-facing written and verbal communication skills and experience

• Create and deliver detailed presentations

• Detailed solution documentation (e.g. including POCS and roadmaps, sequence diagrams, class hierarchies, logical system views, etc.)

• 4-year Bachelor's degree in Computer Science or a related field

Preferred:

• Production experience in core data platforms: Snowflake (including Snowflake Native Apps), AWS, Azure, GCP, Hadoop, Databricks, IICS

• Cloud and Distributed Data Storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra or other NoSQL storage systems

• Data integration technologies: Spark, Kafka, event/streaming, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services (IICS), Google DataProc or other data integration technologies

• Multiple data sources (e.g. queues, relational databases, files, search, API)

• Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment

• Automated data transformation and data curation: dbt, Spark, Spark streaming, automated pipelines

• Workflow Management and Orchestration: Airflow, AWS Managed Airflow, Luigi, NiFi

Company:

phData Premier provider of Big Data managed services and architecture, engineering, and data science consulting. Founded in 2014, the company is headquartered in Minneapolis, Minnesota, USA, with a team of 501-1000 employees. The company is currently Late Stage. phData has a track record of offering H1B sponsorships.