Principal Software Engineer

Company: Insight Global

Employment Type: Longterm W2 contract (2+ years) - not eligible for C2C or 1099 employment

Rate Range: $75-$90/hr

Exact compensation may vary based on several factors, including skills, experience, and education.

Location: Remote in the US

Requirements

• 10+ years of experience in back-end application development using Python in enterprise environment
• Hands on experience building FastAPI services/ REST APIs and backend services layer
• Strong background in MongoDB (NoSQL) and data modeling for application driven use case
• Experience with Azure Microservices Architecture (ADF, cloud-native integrations, service orchestration)
• Builds data-driven services/APIs and scalable backend logic, not just ETL pipelines
• Strong in pipeline optimization + real-time data delivery for application consumption
• AI-Driven Development / Co-Pilot adoption and utilization for day-to-day productivity optimization
• Consultant-level presence: proactive communication, accountable, high sense of urgency and proven experience delivering in fast paced, high-visibility environment
• Experienced and comfortable working with offshore/international teams

Job Description:

We are seeking a Principal Level Consultant who operates like a backend software engineer within the Databricks ecosystem. This is not a traditional data engineering role—you'll be building APIs, enabling real-time data and AI services, and delivering production-ready backend capabilities that power applications, not just pipelines.

If you thrive in fast-paced, high-visibility environments and take pride in writing clean, scalable, production-grade code—this role was built for you.

Day-to-Day Responsibilities

• Design, develop, and maintain data-driven services, APIs, and scalable backend logic within Databricks using PySpark and notebook-based development.
• Architect and optimize end-to-end ETL pipelines leveraging Azure Data Factory (ADF) for reliable, high-performance data delivery
• Drive pipeline optimization and enable real-time data delivery for downstream application consumption
• Leverage AI-driven development tools and Co-Pilot technologies to enhance day-to-day productivity and accelerate delivery
• Collaborate closely with offshore and international teams, maintaining clear communication across time zones
• Participate in daily Scrum standups, weekly grooming, and sprint planning sessions (~6 hours/week of meetings, ~34 hours/week of heads-down development)

Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location.