Mid/Senior IOS App Developer (Front end oriented, Swift) - FT - WW

Role Overview

We are seeking a skilled Senior iOS App Developer to join our team. Your primary focus will be to enhance the app’s conversational experience, contributing to a range of projects aimed at improving this feature.

Background: I lead product development for Kilowatts, a voice assistant app for Tesla drivers. Kilowatts acts as a personal driving assistant, enabling users to plan trips, order food, book parking, and more—all through voice commands. Since launching our MVP iOS app in October, we’ve gained over 1,000 users. Here's a product demo video on Reddit and the App Storelink.

https://www.reddit.com/r/teslamotors/comments/1gipbxg/i_integrated_chatgpt_with_my_tesla_and_it_can/

https://apps.apple.com/us/app/kilowatts-app/id6475490809

If you are interested in working on the app, please reply and we can discuss project specifics. Below is a a project example of what you could be working on.

Project Example:

Integrating OpenAI's Real-Time API with our assistant. The goal is to replace the current Azure Speech-to-Text (STT) and Text-to-Speech (TTS) services with OpenAI’s advanced real-time voice capabilities, enabling dynamic conversations.

Project Goal:

Success for this project is enabling users to have fluid, turn-free conversations with the AI assistant, similar to ChatGPT’s voice feature for premium users. Currently, the turn-by-turn interaction creates a clunky experience where users must wait for the assistant to finish speaking before responding. This upgrade also aims to make conversations more natural, reducing the latency between a question and an answer.

Key Responsibilities:

1. Review OpenAI Real-Time API Documentation:

Familiarize yourself with the Realtime API guide from OpenAI and the Swift / OpenAI Real time SDK.

https://platform.openai.com/docs/guides/realtime

https://github.com/m1guelpf/swift-realtime-openai

2. Develop OpenAI Send/Receive Message Service:

Implement a socket-based communication service for real-time message exchange.

3. Integrate Audio Stream with OpenAI Services:

Connect the audio stream to the OpenAI message service for seamless voice input/output.

4. Update UI Logic:

Enhance the chat interface to incorporate real-time voice interaction with a simplified interface (designs to be provided).

5. Fallback Mechanisms:

Retain Azure voice services as a fallback to ensure uninterrupted functionality during OpenAI service outages or rate limits.

Our previous front-end developer started building the feature and has completed several of the tasks below and started working on the tasks above using the aforementioned SDK. The codebase will be made available for revisions and inclusions at your discretion.

Completed Tasks:

1. Authentication: OpenAI account service integrated with the app's authentication logic, securely managing API keys.

2. Sockets Framework: Configured socket-based framework for real-time communication.

3. Audio Stream Setup: Real-time audio input capture implemented using AVFoundation.

What We’re Looking For:

An experienced front-end developer with expertise in:

1. iOS development.

2. API integrations, particularly with OpenAI or similar conversational platforms (preferred).

3. Real-time communication frameworks (e.g., Socket.io).

4. Building conversational AI experiences.

This project is ideal for someone passionate about expanding their skillset in front-end interfaces for AI voice applications and creating natural interactions for users. If this excites you, hit reply.