Staff Software Engineer - Generative AI / LLMs

Staff Software Engineer - Generative AI / LLMs

Location: you could either work remotely or in the company's offices in Palo Alto and New York. Some team members come 1x/week, but most people in the company work 100% remotely.

The company has raised $50 million in series B funding and is founded by industry veterans with a track record of tremendous success. The CEO/Cofounder previously cofounded a company that is publicly traded and has reached an over $20 billion market cap. The CTO/Cofounder previously was a long time engineering leader at Facebook.

The company's product involves risk assessment, fraud detection/prevention, and AI. It is already being used by many customers. Revenues are increasing rapidly.

The company has about 80 employees and 40 engineers and is growing rapidly.

The company will pay a salary up to $250k, plus equity which could be very lucrative.

I'm guessing you may not be actively seeking a new job right now, but whatever the case may be, please let me know if you or anyone you know may be open to hearing more and exploring this opportunity.

Job Responsibilities:

- Working with Python and LLMs to design and implement scalable backend services to solve business problems.

- Collaborating with cross-functional teams such as product, front end, and QA to define technical requirements and ensure the seamless integration of AI models with other platform components.

- Optimizing AI models and backend services for maximum performance, scalability, and maintainability in a distributed environment.

- Identifying and resolve bottlenecks related to AI processing and system performance, ensuring efficient resource utilization and system stability.

- Implementing best practices for deploying, monitoring, and maintaining AI models in production, including CI/CD pipelines and model versioning.

- Proactively monitoring the health and performance of AI-driven backend services, applying strategies to mitigate potential issues and ensure high availability.

Qualifications:

- A Bachelor’s or master’s degree in computer science or equivalent experience.

- At least 5 years of backend software development experience.

- Hands-on experience solving real problems using generative AI models (e.g., GPT, LLMs).

- Strong expertise in Python and AWS technologies.

- Expertise in building and operating low-latency, high-scale services in distributed environments.

- Experience deploying and optimizing AI/ML models in production environments using containerization (Docker, Kubernetes) and cloud platforms (AWS, GCP).

- Familiarity with microservices architecture, RESTful APIs, and security best practices in AI services.

- Experience with distributed data systems such as Kafka, ClickHouse, or similar technologies to manage large-scale AI workloads.

- Strong understanding of CI/CD tools (such as Jenkins, Git, Maven, Gradle) and agile development methodologies, with a focus on automating model deployment.

- Excellent problem-solving abilities, with a focus on AI model performance optimization, scalability, and system architecture.

About Skyrocket Ventures

Skyrocket Ventures is a recruiting firm for hundreds of high growth technology companies that range from industry leaders to top-tier startups. This opportunity is with one of our client companies for a full-time permanent hire. Please only apply if you are authorized to work in the U.S.

Please note that even if this job is not a perfect match, we encourage you to apply as long as it is in the ballpark. Companies are often flexible in hiring candidates who do not perfectly fit their written job description, as long as the most important qualifications are there and the candidate is good in general.

Most of the jobs we are recruiting for are not posted online, so if you would like to know of all the opportunities we have that match your interests and qualifications, then please get in touch with us.

After you apply to this job posting, we’ll consider you for this job as well as any other potential matches with our client companies. If we have any potential matches, we’ll share your resume with those companies and contact you about any interview opportunities we can get you.

Thank you, and we wish you a great job search!