Staff Software Engineer - Python

Staff Software Engineer - Python

Company: Seed Stage AI Start-up

Location: Remote US

Salary: $170K - $200K

This company builds infrastructure that enables large language models (LLMs) to generate structured, schema-compliant outputs — like JSON, forms, or API calls — with reliability and precision. It acts as a compiler and runtime layer for LLMs, combining systems engineering, validation tooling, and deep integration across languages and architectures to make AI outputs usable in real-world software.

About the Role

We’re looking for an experienced software engineer with strong Python experience to help us build and maintain critical infrastructure across benchmarking, data systems, and integration pipelines.

This role sits at the intersection of high-performance systems engineering, build automation, and Python-based integration, supporting both low-level and high-level aspects of our machine learning and compiler toolchain.

What You’ll Do

• Generalist Backend Engineering work in Python to support high-performance software
• Own the build and benchmarking systems that support compiler testing and ML inference across multiple hardware environments (e.g., x86, ARM).
• Work closely with C++ interfaces and Python bindings to help integrate low-level systems into full-stack applications (e.g., AWS inference containers).
• Develop and manage internal APIs and data pipelines used for benchmarking, structured data generation, and regression testing.
• Help guide how we build, test, and deploy cross-platform code that bridges Python, C++, and possibly Rust.

What We’re Looking For

• Experience leading projects, often on ambiguous problem sets.
• A background in a data intensive domain - i.e compliers, databases, ad-tech, trading etc
• Strong programming experience in Python (ideally with backend, build, or data systems).
• An adaptable, generalist mindset — we don’t expect you to know everything, but we want someone who can learn quickly and dive into unknowns.

Nice to Have

• Familiarity with AWS and containerized inference systems (e.g., Docker).
• Experience with C++ and/or Rust

If you're interested, please apply now!