Senior Software Engineer

Company Description

SQLite AI is building the next generation of AI infrastructure for edge and cloud applications. We are making SQLite the default database for AI at the edge, powering apps, IoT devices, and robots with efficient on-device inference, synchronization, and vector search. Our technology stack includes high-performance SQLite extensions (SQLite-JS, SQLite-Sync, SQLite-Vector, and SQLite-AI) and cutting-edge integrations with modern LLM frameworks.

Role Description

We are seeking a C/C++ Developer with strong experience in AI inference frameworks — particularly llama.cpp — to help us push the boundaries of efficient on-device AI. You will work on optimizing and extending our SQLite-based AI infrastructure, integrating large language models (LLMs) into lightweight, embeddable, and high-performance systems.

What You'll Do

• Develop and maintain high-performance C/C++ code for AI model execution and database extensions.
• Integrate llama.cpp, whisper.cpp, multimodal and other inference backends into SQLite extensions for real-time, edge-friendly AI applications.
• Optimize memory usage, speed, and platform compatibility (iOS, Android, Linux, macOS, Windows).
• Work on low-level performance tuning.
• Collaborate with a small, highly technical, and globally distributed team.

Qualifications

• Strong C/C++ expertise with a focus on performance-critical systems.
• Proven experience with llama.cpp (building, modifying, and optimizing inference).
• Solid understanding of AI/ML model deployment, quantization, and on-device inference.
• Experience with cross-platform development (mobile, desktop, embedded).
• Familiarity with SIMD optimizations (AVX2/NEON) is a plus.
• Experience with SQLite or database internals is a plus.
• Comfortable working in a remote-first, fast-moving startup environment.

Why Join Us

• Work on cutting-edge AI infrastructure for real-world edge applications.

• Influence the future of how LLMs run locally and interact with databases.

• Join a lean, world-class team led by experts in SQLite and AI systems.

• Fully remote, flexible hours, and a culture that values deep technical work.

If you’re passionate about AI, C/C++ performance, and pushing the boundaries of what’s possible on-device, we’d love to hear from you.