Premiere Pro

Overview

HUGS lab researchers have (limited) access to the Adobe Premiere Pro video editor. It is particularly useful for identifying  video sequences showing points of interest for labeling in DeepLabCut (DLC). While frames can be identified in the DLC GUI, it is an imprecise process as there is only a slider to advance frames. Premiere Pro lets you "surgically extract" exactly the sequences desired to label movement behaviors of interest most efficiently.

Utility of Premiere Pro in the DLC Labeling Process

Currently, most of the HUGS R1 study video (.avi files) are constructed from individual images output by the alignment tools that support processing the RGB (2D) and Depth Sensor (making 3D possible) data encoded in the .bag files generated by the RealSense camera used in the study.  See  3D Video Bag File Handling for more information on this process.

Typically, thousands of images are produced at 30 frames per second (fps), during each home infant development monitoring session conducted during HUGS. These images are unpacked into a folder which can be browsed, but the process is tedious. 

In order to be labeled using the DLC GUI, these images hey are assembled  as frames in a .avi file by ImageJ. This .avi file is then processed in DLC to extract frames that depict behaviors of interest around the key points to be identified by the neural network the DLC process produces. T

As noted in the Overview, identifying frames based on behaviors of interest in the DLC GUI is imprecise and tedious. The best practice we have identified for finding the most on-point frames is to pull the .avi file into a quality video viewer, such as Adobe Premiere Pro.


How to Use Premiere Pro to Extract Individual or Precise Series of Frames

Sample frames for labeling you would save to that folder would be:

img0002.png

img2888.png

img2889.png

Play the video at the left to find out how to extract individual frames from video.

To make sure the frames you choose are accessible to DLC, save them as:

img[frame #].png

in the DLC Project folder for the video for which the frames are being selected.

For example, the project folder containing frames to label for hugs02.4.210803.light.avi would be:

C:\Users\mmsch\OneDrive\dlc\Trackhands_v2\TrackHands_v2-mms-2022-03-19\labeled-data\hugs02.1.210604.light


There are numerous videos online that demonstrate the basic mechanics of Premiere Pro, such as loading a video file and finding the frames of interest in the video.

Premiere Pro projects by default show time in seconds. To change seconds to frame index, hover over the time code in the viewer and right click. You will get a list of options and switching from seconds to frames is among them.

See the video below for details.

https://www.youtube.com/watch?v=as4HeS53mXo


Access

Talk with or email Dr. Schladen about getting access to Premiere Pro.  You will be able to install it on your computer using Adobe Creative Cloud.