Computer Vision Expert (Mobile App Sketch-to-UI)

Role Overview

We are seeking a skilled Computer Vision Expert to take over and complete an in-progress project focused on transforming hand-drawn sketches into functional digital user interfaces. The project involves developing a robust system that can analyze a photo of a pen-and-paper sketch of a mobile app UI and automatically generate the corresponding front-end code.

Responsibilities

• Develop and refine a system for low-level object recognition, detecting and classifying sketch elements such as squares, rectangles, circles, lines, and handwritten text from mobile phone photos.
• Create or integrate models to accurately identify and segment these objects, with the flexibility to modify existing progress as needed.
• Combine low-level components into complex UI elements, grouping recognized objects into buttons, text input fields, radio buttons, checkboxes, image placeholders, and pull-down menus.
• Work independently with an existing codebase to deliver a finished product.

Required Skills

• Proven experience in Computer Vision, with expertise in object detection, image segmentation, and scene understanding.
• Strong preference for using open source platforms and toolchains.
• Ability to work independently and effectively on a project, handling existing codebases.

Nice to Have

• Experience with front-end technologies such as HTML, CSS, and JavaScript, although the primary focus is on computer vision and recognition aspects.