Senior Software Engineer, Batch Data (Remote)

Verified Job On Employer Career Site

Job Summary:

Tecton is a company focused on solving complex data problems in production machine learning, providing a feature platform that accelerates data activation for smarter models. The Senior Engineer on the Batch Data team will be responsible for architecting and scaling core compute engines and storage architecture, along with optimizing query performance and leading significant technical projects.

Responsibilities:

• Own and lead significant technical domains starting from the problem definition and technical requirements to implementation and maintenance

• Lead projects of strategic importance to Tecton spanning cross-functional teams, including product management and other engineering teams

• Drive efforts to improve engineering practices, tooling, and processes along with mentorship for junior engineers

• Develop a deep understanding of the fundamental problems our customers face in building ML systems

• Be a generalist as needed. We’re a small, but growing engineering team, and each engineer needs to be versatile

Qualifications:

Required:

• Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)

• Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs

• Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake, and object storage (e.g. S3, GCS)

• Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations

• Experience with internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses

• Strong communication skills and ability to write detailed technical specifications

• Excitement about coaching and mentorship of junior engineers

• BSc, MS, or PhD in Computer Science or related fields

• 8+ years of experience in building product software systems

Company:

Tecton provides an enterprise-ready feature store to make machine learning accessible to every company. Founded in 2019, the company is headquartered in San Francisco, California, USA, with a team of 51-200 employees. The company is currently Growth Stage.