Job Title: Software Engineer
Location:(100% Remote)
Duration: 5 months contract with possible extension
Pay: $120 to $123.40/hr W2
Job Description:
This role involves managing petabytes of data for machine learning applications and designing and implementing new frameworks to build scalable and efficient data processing workflows and machine learning pipelines. The successful candidate will be responsible for ensuring complete data lineage and legal workflow integration while optimizing performance and scalability. You will also be responsible for monitoring the performance of the system, optimizing it for cost and efficiency, and solving any issues that arise. This is an exciting opportunity to work on cutting-edge technology and collaborate with cross-functional teams to deliver high-quality software solutions. The ideal candidate should have a strong background in software development, experience with public cloud platforms, and familiarity with distributed databases.
Qualifications: Highlighted in yellow are must haves
-10+ years of experience in software engineering with deep knowledge in computer science fundamentals.
Hands on developing experience.
Not someone who has been in management or active coding.
-Experience with ETL data pipelines
-Strong in data structures and algorithms. Must write good quality code with test cases and review ,'s in fast faced environment.
-Expert in one or more functional or object-oriented programming languages
-Fluency in Python
-Experience or knowledge in distributed data systems like Hadoop, Spark, Kafka or Flink.
-Experience or knowledge in public cloud is a big plus
-Experience building products in AWS with some Kubernetes
-Strong collaboration and communication (verbal and written) skills
-Experience in Datahub OpenSource project is a plus