Software Engineer – Knowledge AI Team
Employment Type: Full-time/Remote
About the Role
We are looking for an experienced Software Engineer to join our Knowledge AI (KAI) team, specializing in analyzing and interpreting unstructured data using advanced NLP, large language models (LLMs), and AI technologies.
In this role, you will support the development and deployment of AI- and NLP-driven products and solutions, leveraging your expertise in Python, SQL, ETL processes, and data engineering methodologies. Experience with containerization and orchestration tools such as Docker and Kubernetes is required.
Key Responsibilities
- Deploy language models to address business challenges, such as Operations and Maintenance, to extract, process, classify, and derive insights from unstructured datasets.
- Develop, optimize, and maintain data pipelines for ingestion, cleaning, normalization, annotation, and versioning of large text and multimodal datasets.
- Build and maintain APIs and tooling to provide easy access to models and datasets for product teams.
- Optimize execution workflows, ensuring solutions can scale efficiently.
- Troubleshoot production incidents, deploy fixes, and conduct postmortems to improve system reliability.
- Write clean, efficient, and well-documented Python code.
- Optimize training and inference code for performance and cost, including distributed training, mixed precision, model parallelism, quantization, and caching.
- Perform unit testing and mock services where applicable.
Skills & Experience
- Advanced Python development skills, including libraries such as NumPy, SciPy, and FastAPI.
- Strong expertise in SQL and working with modern NLP tools (e.g., OpenAI, Hugging Face Transformers).
- Hands-on experience with Docker and Kubernetes (K8S) for containerization and orchestration at scale.
- Experience with machine learning (ML), natural language processing (NLP), and Generative AI, including LLMs and PyTorch.
- Familiarity with cloud platforms, particularly MS Azure.
- Experience with vector databases is a plus.
- Knowledge of service bus architecture and related technologies is desirable.
- Strong foundation in ETL processes and data engineering methodologies.
Why Join Us?
- Work on cutting-edge AI and NLP projects.
- Collaborate with a skilled, innovative team in a dynamic environment.
- Opportunity to deploy models that make a real impact across operations and business insights.