Annotation OTG

Situation

“Annotation On The Go” refers to a situation where an AI developer wants to get cases annotated by one or more radiologists.

Workflow

1. Create account on CARPL

2. Log in to CARPL

3. Create Dataset

   1. Click on Dataset Manager

   2. Click on My Datasets

   3. Create Dataset

   4. Open Dataset

   5. Add Studies

4. Create Annotation Template

   1. Click on Annotation

   2. Click on Annotation Template

   3. Create Annotation Template

   4. Define ROI level annotations - these are annotations that the user can select while creating any kind ROI on the images

   5. Create Annotation Form - these are study-level annotations in the format of a form

   6. Save Annotation Template

5. Create Annotation Project

   1. Click on Annotation

   2. Click on Annotation Project

   3. Create Annotation Project - select the appropriate annotation template (created in the previous step) and appropriate dataset

6. Assign Studies for Annotation

This step enables you to assign studies for annotation to radiologists. Note that multiple readers can annotate the same study.

7. 1. On the Project Summary on the Annotation Projects page, click the “Assign Annotation” icon at the top of the Project Summary box.

   2. The annotation assigning page will open - here, select relevant studies, and click on “Assign Annotators”. Enter the email addresses of the annotators and then click “Assign”.

   3. In case you want to assign to yourself, then click “Assign to Me”.

   4. Your cases are now ready to be annotated.

8. Start Annotation as the project creator, or as the annotator

   1. Click on Annotation Projects

   2. Click on Annotate

   3. This opens up a list of cases to be annotated

   4. Click on Annotate Study

9. The CARPL Viewer opens up

   1. Draw the appropriate ROI on the viewer

   2. Answer the questions on the right

   3. Click “Save and Complete” to move to the next case

   4. All cases can now be annotated

10. Add more cases for annotation

    1. Add cases to your dataset

    2. Assign those cases through the annotation project

    3. Request annotators to annotate!

11. Download Annotations

    1. Click on “Download Annotation” to only download the form data

    2. Click on “Download ROIs” to download the form data along with ROI coordinates for each case. Note - the data is in JSON format.