Primary Talent Partners has a new 12 month contract opening for a Data Engineer IV with an Energy client of ours located in Charlotte NC. Pay: $82.47 -92.47/hr; W2 contract, no PTO, no Benefits. ACA-compliant supplemental package available for enrollment.
Schedule: Hybrid but open to fully remote but they will be required to work 9 AM-5PM EST with the team.

Description:
The Enterprise Data Platforms Team is seeking a Subject Matter Expert to help develop Data Fabric as an interconnected network of data capabilities and data products designed to deliver data efficiently and at scale. Candidates should have expertise in developing and building data platforms, demonstrating experience with overcoming obstacles and avoiding pitfalls. They should also possess skills in optimizing and automating deliverables to production using the required tech stack. Additionally, candidates should be experienced and adaptable to changing demands and priorities in an Agile development environment.
We are specifically looking for individuals with at least 5+ years of experience in Data Engineering and/or Software Engineering roles who can provide knowledge and support to our existing engineers.

Important:

Candidates must complete Glider assessment: Software Engineer III (Data Products)
Must comply with DE 10 CFR Part 810
Candidates MUST be able to code- there is a coding challenge during the skills assessment.
Candidates should be able to communicate like a "consultant."
Needs to be able to talk technical with a nontechnical audience. Candidates MUST be motivated and good communicators.

EM ranked the tech stack:
1. Apache Flink
2. AWS Lake Formation
3. Kubernetes
4. Python
5. Terraform
6. AWS Glue
7. Apache Hudi
8. Apache Iceberg
9. EMR
10. AWS
11. AWS S3
12. Apache Kafka
13. SQL

Must have experience with similar platform engineering/management solutions:
• Building/optimizing Data LakeHouse with Open Table formats
• Kubernetes deployments/cluster administration
• Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS
• Distributed Systems, Microservice architecture, and containers
• Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis)

Must have experience with below tech stack:
• Git Hib and Git Hub Actions
• AWS
o IAM
o API Gateway
o Lambda
o Step Functions
o Lake formation
o EKS & Kubernetes
o Glue: Catalog, ETL, Crawler
o Athena
o Lambda
o S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc)
• Apache Hudi
• Apache Flink
• PostgreSQL and SQL
• RDS (Relational Database Services).
• Python
• Java
• Terraform Enterprise
o Must be able to explain what TF is used for
o Understand and explain basic principles (e.g. modules, providers, functions)
o Must be able to write and debug TF

Helpful tech stack experience would include:
• Helm
• Kafka and Kafka Schema Registry
• AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg
• Secrets Management Platform: Vault, AWS Secrets manager
Core Responsibilities and Soft Skills
• Provides technical direction, engage team in discussion on how to best guide/build features on key technical aspects and responsible for product tech delivery
• Works closely with the Product Owner and team to align on delivery goals and timing
• Collaborates with architects on key technical decisions for data and overall solution
• Lead design and implementation of data quality check methods
• Ensure data security and permissions solutions, including data encryption, user access controls and logging
• Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
• Self-starter mentality
o Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another
• Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process.
• Questioning and Improvement mindset
o Must be ready to ask questions about why something is currently done the way it is and suggest alternative solutions
• Customer facing skills
o Interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues they encounter with our products

_Primary Talent Partners is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.

If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at info@primarytalentpartners.com

_#PTPJobs