At .txt, our mission is to help AI speak the language of every application. We are the authors of outlines and outlines-core, both leading open source libraries (+10k ⭐️) for structured generation.

txt raised $11.9 million, which is fueling the efforts of our global, fully remote team to create software that goes beyond simple conversation.

We are able to support open source structured generation through our proprietary structured generation technology, dotgrammar, that extends regular expression-powered outlines to support arbitrary context-free grammars (CFGs) for structured generation.

Read more about .txt and our technology on our blog.

The Role

As a Staff Software Engineer at .txt, you will play a crucial role in developing and maintaining the backbone of our tech infrastructure. You will be immersed in a fast-paced environment where your work directly impacts the efficiency and scalability of our products and services. Your expertise in distributed systems engineering will be central to building robust backend systems. We are looking for a team player with a passion for coding and a dedication to learning and improvement.

What You Will Do

Distributed Systems Engineering: Build and maintain efficient, reliable Python code for our LLM backend systems.
Work Well With Structured Generation: Collaborate with compiler and research engineers to integrate the backend services with our methods for guided generation.
Performance Optimization: Optimize backend components for high throughput, especially with data-intensive LLM operations.
Code Quality and Best Practices: Maintain high code quality and enforce best practices through code reviews, testing, and a penchant for meaningful commit messages.

Qualifications

Open Source Contributor: You must have significant public work that we can use to demonstrate role-relevant expertise.
Python Expertise: Professional experience as a Python or Rust backend/systems developer (FastAPI, Twisted, ASGI, etc.)
API Development: You understand how web framework operate and could write your own, but prefer to use a community-supported software.
Large-Scale System Experience: Expert in large-scale distributed systems and asynchronous network programming.
Expertise in Git: You know how to properly use rebase, at a minimum, and are committed to making your changes to a code base understandable to your teammates.

Why You Should Join Us

🚀 Cutting-edge technology

Structured generation is still a nascent technology. Innovation is not the exception, it’s the rule.

⚖️ Work-life balance

We don’t expect you to spend 80 hours per week at your desk, and we won’t either. We have lives outside of work, and want you too as well. Sometimes we will all need to be all-in, but it will be the exception rather than the norm.

🌐 Remote first

Work from anywhere in the world. We have a culture of written communication, and favor infrequent organic discussions over regular large team meetings.

💸 Competitive Compensation And Benefits

We pay market rate (adjusting for seed-stage startup) + equity options, offer health and dental insurance, and have a 401k (US Only). We’ll get you a GPU if you don’t have one already.

Location