Artificial Inteligence 
Consulting

5+ years experience managing data labeling projects for training datasets used in artificial intelligence models.

Experience 

Research and Development Support Team Lead - Saab Inc. 

Part-time consulting (Dec 2023 - present)

•  Manage a part-time remote US team using Teams, synchronously & asynchronously.

• Manage the setup and progress of AI annotation projects.

Machine Learning Data Operations Manager - CrowdAI 

Mix of full-time work and part-time consulting (June 2019 - Aug 2023)

•  Managed, hired, and motivated a 20-person part-time remote US team along with foreign vendors using Slack, WhatsApp & Google Meet across the world, synchronously & asynchronously.

• Managed the setup and progress of 3-9 concurrent projects with multiple program managers for contracts ranging from $10,000 – 3 million.

• Quickly ran operations for over a dozen POC models (in <1 week!); from collecting/creating data, trainings, managing progress, QC and model results. 

• Defined complex ontologies with commercial and government clients for training multi-class computer vision models, including: mapping features in satellite/areal images, classifying damage in products, and identifying change. 

• Improved scores from 93% to 98% by iteratively re-defining and prioritizing annotation classes with our machine learning scientists. 

• Worked with product and engineers to develop & debug annotation tools on the web-based platform to increase annotation quality, efficiency and worker satisfaction, and reduce RSIs, such as: intuitive shortcut keys, UX design improvements, video interpolation, and new annotation tools. 

• Worked with back-end engineers to create data and time management tools.

• Revamped our onboarding & training process to improve efficiency and scale by employing education strategies to assess learning, training tracking spreadsheets, and created practice annotation projects for all model types: classification, segmentation, detection, image and video. 

• Created online training material with video demos for each project and a 30-page manual.

• QC and individualized feedback to annotators, vendors, and clients for projects with 10,000s+ images with 100,000s+ labeled features. 

• Ran weekly online meetings and organized virtual social events.

GIS and Annotation Strategy Consultant & Annotator for AI Training Data - CrowdAI

Part-time (Sept 2018 - June 2019)

• Worked with data operations to develop annotation strategies to annotate, digitize, and label machine learning training data for computer vision models. 

• Annotated of order 10,000s of images and video (satellite, aerial, drone, cell phone images, drone videos, industry line videos) to delineate features such as buildings, solar panels, roads, trees, defect types, damage levels, etc.

• Iteratively worked with data operations and clients to define classes various feature type categories.

• Quality check and quality assurance of annotations.

• Gave feedback to remote team members.

• Wrote instruction manuals.

• Trained and onboarded annotators.

AI Language Models Tester (Expert) -  Scale AI 

Part-time (Feb 2023- June 2023)

• Helped train generative AI language models by writing, improving, and answering prompts in my area of expertise  (earth and planetary sciences).

• Provided feedback on AI responses and the tools on the online platform.