By the end of this module, you should be able to do the following:
Explain why the very properties of digital multimedia are what enables it to be a powerful potential tool to help people
Recount unique, unusual, or innovative way in which digital and/or interactive multimedia can benefit individuals
Modules 12 and 13 took a rather dim view on multimedia technologies, which we saw could have a potentially negative impact on how individuals think, feel, and behave. A big part of the criticism rests on the suggestion that media technologies have evolved more quickly than the human brain has, and so media technologies can exploit or fool our cognitive and sensory abilities. This in turn can lead to unpleasant or unwanted experiences and behaviors.
However, this potential for digital media to exploit the brain means that it can be used to beneficial effect by 'hacking' the brain to achieve positive results. In this module, we will take a look at some of the more interesting and unusual examples of these. We start by looking innovative uses of digital audio.
Allot 15 minutes
Read Nathan Chandler's (2019) article, Science Is Finding Out Why Some Love ASMR Videos and Others Hate Them, on the popular website HowStuffWorks.com. As you read the article, ask yourself: what does ASMR has to do with digital media technologies?
Autonomous sensory meridian response (ASMR) is a phenomenon wherein certain sounds generate a pleasurable sensation that defies precise description to those who do not experience ASMR, although terms such as "tingles" have been associated with it (Barratt and Davis, 2015).
ASMR appears to have some therapeutic value. ASMR-inducing sounds (examples of which can be heard on Video 14.1) reportedly help some people fall asleep and with coping with stress, for instance. What is interesting is that some ASMR-inducing sounds appear to depend on modern media technologies, generating what Dr Craig Richard of Shenandoah University calls "transmitted ASMR". These sounds are often captured binaurally using microphones, mixed and stored as an audio file format that support at least two (stereo) tracks, and played back on stereo headphones. For some, simply whispering into someone’s ear or running fingers across a hairbrush very close to someone’s ear doesn’t seem to produce as strong an ASMR phenomenon; the sounds have to be recorded and played back to be most effective.
Video 14.1: An ASMR video (DennisASMR, 2018)
Allot 30 minutes
Part 1
Read Michael Breus' article on binaural beats from Psychology Today (2018). As you read the article, ask yourself:
How are ASMR-inducing sounds and binaural beats similar?
How are they different?
Part 2
There are many audio and video resources on the Web that allow you to experience binaural beats. One such resource is this binaural beat generator on Mynoise.net, but before listening to binaural beats, be sure to read the warning on the page, which cautions people prone to seizures or epilepsy, or pregnant women or children, against listening to binaural beats without medical supervision. If you do listen to binaural beats, be prepared to describe to the class what you heard and felt:
Before listening to the beats
While listening to the beats
After listening to the beats
Like the kind of audio used for transmitted ASMR, binaural beats require audio formats in which you can record two tracks, each to be played in one ear. However, with binaural beats, it is absolutely essential that the sounds be stereophonic. Like ASMR, binaural beats seem to be effective for some people in reducing anxiety (Wiwatwongwana et al, 2016) and stress (Gantt et al, 2017) in certain cases. It is hypothesized that binaural beats work by entraining the electrical patterns in the brain--what we often call "brainwaves"--to the frequency of the beats. ASMR, on the other hand, is thought to work because of different neurological mechanisms.
Allot 20 minutes
Watch Video 14.2 (embedded below), which is a segment from the independent news show, Democracy Now!. The segment covers a documentary called Alive Inside, which is about how music can powerfully affect memory and emotion. According to the proponents of the techniques discussed in the video, how does using personalized music work to reawaken the inner self of individuals with Alzheimers and dementia?
Video 14.2. A segment from the independent news show Democracy Now! about the documentary Alive Inside (Democracy Now!, 2014)
In the case of Alive Inside, although the ability to record and play back music predates digital media technologies, the portability, physical size, memory storage capacity, and affordability of modern media playback devices are what makes an intervention like the one discussed in the documentary possible for large numbers of people.
These past examples have all been about hearing and sound. Let us look at other sensory or media modalities.
Allot 5 minutes
In module 12, we saw how blue light can disrupt sleep patterns. However, interestingly enough, researchers have found that watching certain patterns of flashing light can also help travelers recover from jet lag more quickly. To find out more, read the article by Michelle Roberts (2016) on the BBC website, Flashes of light may stop jet lag. Some points to consider:
What was the explanation given by the scientists who conducted the study on why this intervention may be effective?
If you had to take a guess, who do you think would not be good candidates for this kind of intervention?
Allot 5-30 minutes
Read the abstract of the research paper, Virtual Reality as a Clinical Tool for Pain Management (Pourmand et al., 2018). Optional: If you would like to learn more about the use of virtuality for pain relief, read Reenita Das' article (2018) about virtual reality for pain relief, published by the popular magazine Forbes.
Why do researchers think that virtual reality can help with pain relief?
Figure 14.1. A head-mounted display used in virtual reality experiences
Recall from Module 12 that digital media can be so engaging and attention-capturing that some researchers believe that it can lead to media addiction. On the flip side, however, immersive multimedia can also distract individuals from other unwanted sensory stimuli, such as pain.
Yet another use of multimedia for pain relief is presented in Activity 14.6.
Allot 20 minutes
Listen to the podcast Loops by Radiolab (2019). (A written transcript is available.) The entire episode is fascinating and well-worth listening to, but if you're short on time, start listening (or go to the part of the transcript which starts at) 51:53 seconds into the podcast. Use the following questions to help guide you:
What kind of media modality (audio, static image, video, or animation) did the researchers use to help Melanie visualize her pain?
The technology used in Melanie's case uses neurofeedback. Look up the term on the Web, and share your findings with the class.
Draw a diagram that captures your understanding of how Melanie, the digital media representation of her pain, and the MRI machine interacted to help Melanie manage her pain.
Brain-computer interfaces (BCIs) represent one of the newest ways of interacting with media that artists, scientists, and other researchers are exploring. Instead of relying on users to click on buttons or tap on screens or speak out loud to issue commands, BCIs use technologies such as electroencephalogram (EEG) devices to pick up brain activity of users and try to infer what the user wants to do. This is a whole new branch of interaction design that has potential to help, for instance, people with severe motor deficits. (The title of this module was actually inspired by a hackathon in which I participated in 2016, called Hack the Brain: Hack Yourself Better or Worse, where I worked with a group of artists and scientists to prototype Bisensorial, an award-winning BCI demo that creates customized patterns of vibration and sound based on brainwave readings that aims to influence your mood.)
Neurofeedback technologies such as the one described in Activity 14.6 take this one step further by allowing users to monitor their own thinking using some kind of abstract representation of their own brain activity. In the case of Melanie, it was an animation of a flame. However, there are some innovative and sometimes very poetic ways that you can use neurofeedback in combination with unusual display devices that are not your typical monitor or screen, such as in an artwork called Eunioa II by the artist Lisa Park (Video 14.3). In this art installation/performance, the calmer the artist Lisa Park is, the less turbulent the pools of water become.
Video 14.3. The neurofeedback-based artwork, Eunioa II (Lisa Park, 2014)
There are many ways that digital multimedia technologies have been useful and beneficial to individuals. After all, without digital, interactive multimedia and the Internet, you may never have had a chance to pursue an undergraduate degree outside a more traditional university setting! In addition, it is likely that you can list a few other benefits that digital media technologies have benefited you or people that you know. You will likely cover these topics in your other BAMS courses. The unique and innovative ways in which multimedia could be used to benefit individuals as given in the examples in this module, however, may not be discussed in your other courses, which is why we devoted some time to exploring them. I hope that these examples might inspire you to push the boundaries of multimedia technologies and applications to benefit people!
Allot 30 minutes
Search for a popular or academic article that gives a unique, unusual, or innovative way in which digital and/or interactive multimedia can benefit individuals. Share your findings with the class.
Andersen, J. (2015). Now you’ve got the shiveries: Affect, intimacy, and the ASMR whisper community. Television & New Media, 16(8), 683–700.
Barratt, E. L., & Davis, N. J. (2015). Autonomous Sensory Meridian Response (ASMR): a flow-like mental state. PeerJ, 3, e851. https://doi.org/10.7717/peerj.851
Chandler, N. (2019, February 12). Science Is Finding Out Why Some Love ASMR Videos and Others Hate Them. Retrieved March 1, 2019, from https://science.howstuffworks.com/life/inside-the-mind/human-brain/science-is-finding-out-why-some-love-asmr-videos-and-others-hate-them.htm
Das, R. (2018, May 31). Virtual Reality: The Alternative To Marijuana And Opioids For Pain Management. Retrieved March 2, 2019, from https://www.forbes.com/sites/reenitadas/2018/05/31/virtual-reality-the-alternative-to-marijuana-and-opioids-for-pain-management/
Democracy Now! (2014). Alive Inside: How the Magic of Music Proves Therapeutic for Patients With Alzheimer’s and Dementia. Retrieved from https://www.youtube.com/watch?v=Mgwd_3k3pOw
DennisASMR. (2018). The Most Relaxing ASMR Video Ever Made (Sleep-Inducing). Retrieved from https://www.youtube.com/watch?v=VBQCf8ISy6o
Gantt, M. A., Dadds, S., Burns, D. S., Glaser, D., & Moore, A. D. (2017). The Effect of Binaural Beat Technology on the Cardiovascular Stress Response in Military Service Members With Postdeployment Stress. Journal of Nursing Scholarship: An Official Publication of Sigma Theta Tau International Honor Society of Nursing, 49(4), 411–420. https://doi.org/10.1111/jnu.12304
How Can Binaural Beats Help You Sleep Better? (2018, October 11). Retrieved March 2, 2019, from https://www.psychologytoday.com/blog/sleep-newzzz/201810/how-can-binaural-beats-help-you-sleep-better
Lisa Park. (2014). Eunoia II (Beautiful thought; 아름다운 생각 ll) from Lisa Park. Retrieved from https://www.youtube.com/watch?v=ZXMXqULrEWg
Pourmand, A., Davis, S., Marchak, A., Whiteside, T., & Sikka, N. (2018). Virtual Reality as a Clinical Tool for Pain Management. Current Pain and Headache Reports, 22(8), 53. https://doi.org/10.1007/s11916-018-0708-2
Radiolab. (2019, February 22). Loops. Retrieved March 2, 2019, from https://www.wnycstudios.org/story/radiolab-loops
Richard, C. (2014, June 23). What is ASMR? Retrieved March 2, 2019, from https://asmruniversity.com/about-asmr/what-is-asmr/
Roberts, M. (2016, February 9). Flashes of light may stop jet lag. Retrieved from https://www.bbc.com/news/health-35523024
Wiwatwongwana, D., Vichitvejpaisal, P., Thaikruea, L., Klaphajone, J., Tantong, A., & Wiwatwongwana, A. (2016). The effect of music with and without binaural beat audio on operative anxiety in patients undergoing cataract surgery: a randomized controlled trial. Eye, 30(11), 1407–1414. https://doi.org/10.1038/eye.2016.160