Release Notes

Fixed Issues

1. Dataset Manager: Resolved issues with associated projects in my datasets

2. Annotation project: Issue with annotation status while updating in Annotation project

3. Login: Login link on confirmation page was linked to register page

4. CARPL Viewer - AI panel: Checkbox issue - normal and abnormal issue in AI panel

5. Profile Setting: Name and photograph change not saving

6. Form builder - Issue with the Check boxes in form builder

New Features - Architecture

1. Implement compact and self-contained way for securely transmitting information between parties using JWT token in all APIs

2. REST API’s for AI developers to use the functionalities using APIs. Details of the API’s are given below

   1. Login

      • APIs for Generate auth token, Scans Left

      • Registration page up gradation

   2. Annotation project

      • APIs for Fetch assignment status, Assign annotators, Delete Annotation project, Download annotations, View Annotation status, Assign Annotation, Show Annotation project, Show annotation template, Create annotation project, Create Annotation template, Get UUID in annotation template, download annotations roi

   3. Validation Project

      • APIs for Re-run inferencing, Get Validation stats, Update Inference, Update GT, Create validation project

   4. Inference Project

      • APIs for Download Inference project, Create Inference Project, download inference result based on study ID

   5. Dataset

      • API for Download complete dataset API

      • Server side rendering while loading Dataset

   6. Optimization

      • Log time of image rendering and annotation saving

      • Creating carpl bot on slack for user registration and login alerts

      • CARPL Project Code compilation

New Features - Enhancements

1. Facilitate user to download Validation Report as a pdf

2. Provide ability to edit the findings of validation projects

3. CARPL Bug report to capture customer feedback and issues

4. Reviewer can view the feedback of individual annotators in CRAPL Viewer

5. Annotation Project - I want to perform annotation on specific dataset by CARING team

Fixed Issues

1. Fixed issue related to validation report distribution graphs

2. Bug fixed in viewer scrolling. Case - If the annotation form is very big, then the 'findings' tab is not visible

3. Fix issues in Repot bug/Feedback

4. Fix issues related to ROIs not showing in some algorithm like CEERINet

5. UI issue fixes in annotation projects: Annotation status, Annotation bar

6. Fix issues related to Check boxes in form builder

7. Fix issues related to the inverted images in validation rep

New Features - Architecture

1. Add HTTP response message to all the APIs as status to inform clients of their request’s overarching result.

2. Restructure side Panel and top panel script to make it common for application and more organized.

3. Implement ELK stack (Elasticsearch, Logstash, and Kibana). Logstash for collecting, parsing, and storing logs for future use though elasticsearch. And Kibana as a web interface to search and view the logs that Logstash has indexed

4. Create helm charts to deploy the system on Kubernetes for a quick and reliable provision container applications through easy install, update, and removal

5. Script for scheduled maintanance email to all users minimum 12 hrs before updating any instance

New Features - Enhancements

1. Annotation Project feature: Show number of annotators for a project

2. Show Patient name and patient id in the assign annotations screen

3. Show Algorithm_ID, Dataset_ID, all project_ID(s) on all the summary pages (Dataset,

4. Show mismatches into false positives and false negatives in UNG Graph

5. Integrate Bug reporter with JIRA, to generate ticket id

6. User can upload report to the dataset and enable user to view the report

New Features - Enhancements

1. Reporting template with edit features and allow user to view all the previously created reports

2. Validation page UI changes

3. Add "View Report" button on the CARPL viewer

4. Pre-deployment project - Add an algorithm text box to add algorithm in case of manual Pre-deployment project

5. Show Annotator name/ID/email should on the viewer when a case is opened in the 'review' mode

6. API to Download ROI of study in Inference project

7. Automate "run algorithm" in inference project when studies are added to the dataset

Customer Requirement

1. Annotation Platform : Reviewer can only view the annotations in case of review mode

2. Add validation to the annotation form as requested by customer for FDA study

3. If the user is logging in for the first time please make it mandatory for them to change temporary password to their personal password(Only application for specific customer)

4. If the user is logging in for the first time please make it mandatory to take confirmation from the user regarding User Manual.

New Features - Enhancements

CARPL Search:

1. CARPL Search is an extension feature assists users to search from reports.

2. User can directly upload report in CARPL Search or they can upload reports through the dataset manager by creating datasets.

3. User can create rules by creating own queries.

4. Search words will be highlighted for better visualization

5. Export all feature to export the search result.

6. Creation of dataset from reports

7. Adding selected studies to datasets

New Features - Architecture

1. For conventional project structure and high scalability and high security CARPL changed the framework from flask to Django

2. Introduction of Role-based access control (RBAC) through CARPL’s admin page

   • Admin can create , edit and assign roles to the users

   • Admin can update the permission of the roles

3. Introduction of configuration page so that admin can operate some common configurational changes from front end Ex adding or updating new modality

4. Include MinIO (cloud storage) as an object storage, to store all unstructured data such as dicoms as a single dicom storage.

New Features - Enhancement

1. Reporting Template - Boneage - Add age according to the date of examination or current date and Include GP template

2. Integration of DICOM server in CARPL platform, So that images can be pushed to CARPL from PACS and CARPL can sent back the inferencing result to the PACS.

3. Integrate reCAPTCHA during registration and login to prevent spam

4. Include annotation workflow in an inferencing /deployment project

5. CARPL Search Changes:

   1. • Show collections as cards

      • Elastic search indexing to make complex queries

      • Fix header and make body scroll

      • Load complete data when no filter is applied

Fixed Issues

1. CARPL Search isn't able to refresh number of output entries per page. Unable to show 100 entries per page;

2. validation page doesn’t show all findings

3. Inference does not start automatically on a partially uploaded dataset

4. Delete study through inferencing project API

5. "CANCEL" button in the create annotation project is creating annotation project without dataset - It shouldn’t create any project

6. Download issue with “Download Dataset” API

7. CARPL Search - Unable to get results when adding more rules after the first one

New Features - Architecture

1. Error Handler added in each module of CARPL

New Features - Enhancement

1. Ability to share Dataset between users: CARPL provide feature to share dataset with other CARPL user or non CARPL user, to create GT or to perform pre-deployment testing or to perform testing. To use and access these datasets user has to login to his/her account. Non CARPL user has to register to access these datasets.

2. Create validation project without images: On CARPL user can create a validation or pre-deployment project without a dataset with images. User can create a project with two csv files i.e., AI result and GT Result

3. Ability to upload PNGs, JPEGs, JPGs: User can upload PNGs/ JPEGs/ JPGs other than DICOM image in the dataset. This feature is only applicable for DX|CR|XC modality.

4. Include data request form in CARPL: CARPL introduced a data request form for the clients to request data using this form.

5. Add annotation template in pre-deployment project: Add a feedback template in validation or pre-deployment project to capture feedback.

6. Allow user to add comments on Validation Report: Introduced “Add comments” on pre-deployment test report to capture user comments on validation.

7. Federated validation projects: CARPL provide feature to share validation / pre-deployment test projects with other CARPL user or non CARPL user. To use and access these shared project, user has to login to his/her account. Non CARPL user has to register to access these validation projects.

8. Allow the user to choose which elements they want to see in datasets

9. CARPL Search new features:

   • Save Query: Apart from saving to a new dataset, user may simply save the query to return to it/refine it over multiple iterations

   • Case insensitive search: Search terms without worrying about looking for all possible ways of writing. "Tuberculosis" and "tuberculosis" will appear with any one keyword

   • Ignore phrases: Add phrases to the "ignore" list to prevent them from polluting search results. E.g. When searching for "consolidation", add "no focal consolidation" to the ignore list to prevent such results from showing up.

   • Exclude query: Select a saved query to exclude its results from your current search session

   • Result count: The count displayed is now accurate and accounts for ignore list as well.

10. CARPL Annotation Tracker: After reading the input image, user can check the result of reading the result on a separate screen

11. CARPL Study Mailer: Ability to send image in a google drive link in an email

12. CARPL Viewer update:

    • Ability to 'hide' patient metadata on viewer

    • Ability to turn on / off patient metadata on images on CARPL viewer

    • Ability to view keyboard shortcuts for viewer

    • Auto-popup for ROI labels on polygon, bidirectional, annotate

New Features - Architecture

1. SonarQube Configuration with Jenkins for continuous inspection of code quality to perform automatic reviews with static analysis of code to detect bugs and security vulnerabilities.

2. Fix Issues in image rendering when bulkData is returned by Orthanc server

3. Dockerize text detection algorithm

New Features - Customer Requirement

1. Show the CAD ROI result on the CARPL viewer along with the GTers view.

2. Provision to assign reviewer for an annotation project. Reviewer can see all the annotations of the annotators in a single window. Reviewer can also mark ROI. If the assigned reviewer is not registered in the system then email with annotation project detail will be sent to the reviewer with a link to register.

3. Provision to upload ROI in an existing annotation project.

4. Annotation Project - Review Mode: Reviewer can see 3D annotations of all the readers in CARPL viewer separately

New Features - Enhancement

1. CARPL viewer to open cases where metadata is not present in mongo db

2. Add modality and study description to filter a mix modality dataset while creating deployment Project.

3. Provision for the admin to "Confirm" the newly register user from admin console page.

4. Add a new permission named "Download Dataset" in admin console

5. Schedule maintenance email should go to all the active client from CARPL platform

6. Filter-Based Deployment Project: make a filter on create deployment project which filters which studies to be added in project

Fix Issues

1. UI bug fixes: When you do "show all" in the download history, the form background doesn't expand with the list

2. Fix issues when error appear with special character in finding name

3. Fix issues related to annotation project

• Annotation Template: Text selection UI issue: Please enable copy and pasting of text on CARPL

• Annotation project count is wrong on dashboard | Assigned projects are not included in the count

• Annotation Project: Disable Review button if there is no assigned studies.

• Studies didn’t come up in the annotation project with sharing dataset

New Features - Enhancement

1. CARPL Viewer -

   • Interpolation of ROI for CT studies

   • Undo and Redo functionality in the Viewer

   • Display keyboard shortcuts for viewer

   • Auto-popup for ROI labels on polygon, bidirectional, annotate

   • Ability to turn on / off metadata

   • Ability to turn on / off for ROI AI findings

   • ROI compression on freehand ROIs

   • Calculate area in Free hand ROI and display the area in the viewer

2. Deployment Project:

   • Load Large dataset (more than 10000) in the Deployment project

   • make a filter on create deployment project which filters which studies to be added in project

   • Ability to share inferencing Projects with others

   • Ability to download report as pdf and Dicom pdf

   • Capture study time for each study and display in deployment project detail page

   • Display the CTSI scores in the deployment project for selected model result

3. Annotation Project

   • Auto assign annotation project

   • Ability to Import Ground Truth Annotations into an Validation Project

   • Download study option for annotators

   • Annotation Templates:Ability to Share Annotation Templates with other users

   • Ability to search existing userbase to assign cases for annotation

   • Evaluation of the test result (case level/location level TP, TP incorrect, TN, FN, FP) within the CARPL

4. Notification Module : Introduction of notification module to capture all notifications for the system.

5. Movable column width in the CARPL Application

6. Add # of images in dataset study list

7. Pull data from PACS using study ID or any unique ID after filtering reports using search

8. Admin Console - User level and instance level Algorithms permission to view algorithm

9. Model Integration

   • ChestrAi by LTTS

   • VinDr Mammo Model

   • Medcognetics mammo model

   • Qubim - COVID Chest CT

   • Explainable Chest X-Ray (Dr. Synho Do, MGH )

New Features - Enhancement

1. To improve the viewer performance, fetch images from s3 bucket

2. Pre-deployment project - Add study date in view project details page

3. Add “Dashboard” for admin to view stats on total number of users, total number of datasets and collections, total number of projects in each module. Superadmin has the ability to configure the stats depending upon the requirement of the customer

4. Provision to update the report section on screen without uploading the csv file

5. Configure Dashboard to view image counts according to modality

6. Master Collection: Master Dataset collection with ability to search and create subset from master dataset. User can view study details with all Dicom tags or selected DICOM tags

7. Single Sign On features will help third party application to access CARPL ca without signing again on CARPL

Fix Issues

1. Fixed issues to View CAD result on viewer

2. Deployment project – Fixed encrypted hash key values in the download csv

3. CARPL Viewer: Fixed issues when using local imageID and S3 image ID

4. CARPL Viewer – Annotation Template bug in radio button