GO HUGS

Collecting Grasp Data

Framing Your Baby

• Check that the HUGS toy bar is in front of your baby and that the camera bar is behind him/her.

• You will be videoing from the back, capturing your baby's arms reaching for the bar and hands grasping it.

• See Framing the Scene.

Start the GO HUGS App (01:10)

• Click on the GO HUGS icon.

• A popup displays instructing you to click on the Intel RealSense Icon, the blue one with “RS” in big white letters.

Open the RealSense Camera App (01:51)

• Unfortunately, you lose the instructions in the popup when you do this. (Our little homemade GUI is a work in progress.)

• As you will see in a minute, clicking on GO HUGS down on the task bar will bring the message window back.

Activate the 3D Feed (02:00)

• Click the dropdown arrow before "Stereo Module."

• Check to make sure that Resolution is set to 640 x 480 and that the frame rate is set to 30 fps.

• Click “Stereo Module” ON

• What you are seeing is the feed from the depth sensor in the 3D camera.

Activate the 2D Feed (02:22)

• Next, click the dropdown arrow before "RGB Camera."

• Check to make sure that Resolution is set to 640 x 480 and that the frame rate is set to 30 fps.

• Click “RGB Camera" ON.

• This is the 2D camera feed.

Check Visualization of Your Baby (02:40)

• Use this opportunity to make sure that you can see the entire play bar in the video, and that your baby is positioned so that s/he can reach the bar.

• Positioning will change as your baby gets older and you will likely move to a different baby seat.

• Make sure your baby can reach the bar and that s/he is positioned so that grasping with one arm of the other is equally likely.

• The machine learning algorithm will work best if we can clearly see both shoulders, elbows, wrists, and hands.

• Remember that you can adjust many aspects to get the "picture" right.

  • You can move the toy frame.

  • You can swivel the camera in any direction.

  • You can move the infant seat.

  • You can reposition your baby.

• Message come back up when you click on the GO HUGS icon on the task bar.

Start Recording! (03:37)

• Now that everything looks good to record, click on the "Record" button in the camera controls.

• Now you can click OK on the message button. You don't need it anymore.

Mode Explanation (04:00)

• Now you are back in the GO HUGS dashboard.

• Note that there are 4 buttons on the display: Vibration, Sound, Light, and Stop.

• Depending on which button is clicked, HUGS will change the mode the bar uses to attract and hopefully engage your baby. It will light up, play music, or providing a mild vibration when your baby touches it.

• STOP ends the interaction in whichever mode is active.

• There is also a highlighted list above the buttons.

Randomization (04:31)

• Notice that there is a highlighted list above buttons. The order will be different every time you use the system. The idea is to randomize the order in which your baby gets the 3 modes.

• Eventually, we hope to modify the code to make this happen automatically, but right now we are relying on you to click the buttons in the order specified in the highlighted list.

Mode Demonstration (Sound)

• For this walk through (see video GO HUGS https://sites.google.com/cua.edu/hugs/data-collection/go-hugs?authuser=0), Sound is first.

• We click the Sound button. (05:11)

The button turns yellow indicating it’s active and a green timer bar begins.

• The timer will run for 2 minutes (120 seconds).

Force Graph (05:36)

• A grid pops up to help you visualize what your baby’s grasp force looks like.

• The right hand generates a blue bar and the left hand generates an orange bar.

• “Mary had a little lamb” plays when your baby grasps the bar, though you can’t hear it on this video.

Scales (06:00)

• The scale on the right (y axis) tells how much force your baby is exerting. Think of it as a relative measure – it’s in Ohms, which is not meaningful until converted to a more usual unit such as grams or pounds.

• The scale at the bottom (x axis) marks the seconds into the session where the force occurs.

Resizing the Window (06:10)

• You can resize the GO HUGS window so you can see the scale and what your baby is doing at the same time.

Baby Inactivity

• If your baby isn’t interested in the bar, go ahead and place his/her hands on it. This is very often necessary, especially for younger infants.

• On the backend, guided by the video record, we will edit out the forces adults make while helping a baby get started.

Ending First Mode Data Collection (06:24)

• First time up, Popup returns.

• Click Stop.

• Return to the Camera dashboard and toggle the camera OFF and ON. (06:47)

• This action splits the data files by mode. It makes the files more manageable in size and also reduces the risk of losing ALL the data if there is problem with a single file.