Machine Learning Engineer Specializing in Computer Vision

Role Overview

We are seeking a skilled Machine Learning Engineer with expertise in Computer Vision to automate a part of our building survey business workflow. Your role will involve developing an AI model to automate the image-to-text association process, enhancing efficiency in selecting specific photos and corresponding text snippets from a large collection.

Responsibilities

• Provide guidance on data preparation, specifically in extracting and pairing images from PDF/Word documents with pre-written text labels to form a robust training dataset that supports multi-label assignments.
• Train a custom image classification model using a cloud-based AutoML service, such as Google Cloud Vertex AI or Azure Custom Vision, capable of multi-label prediction.
• Develop a seamless workflow integration and Human-in-the-Loop (HITL) setup through Python scripting, Make, or Zapier to:
  • Process new image uploads and send them for AI analysis.
  • Retrieve and present top predicted text options with confidence scores.
  • Facilitate feedback collection for incorrect predictions to enhance future model performance.
  • Output selected text to a specified destination, such as Google Sheets or team chat.
• Advise and implement a strategy for model fine-tuning and re-training using corrected data to continually improve accuracy and performance over time.

Required Skills

• Experience in custom multi-label image classification projects.
• Proficiency with cloud AI platforms, particularly Google Cloud Vertex AI or Azure Custom Vision.
• Strong knowledge of Python and experience with integration tools like Make or Zapier for workflow automation.
• Ability to set up and utilize Human-in-the-Loop feedback mechanisms for continuous model refinement.

Nice to Have

• Familiarity with data extraction from PDF/Word documents.
• Experience in the building survey or similar industries.