Embedded Files
Overview
Overview
This research involves the development and evaluation of HarmonicThreads, a novel computer musical interface designed to help people gain more access to musical interaction. Our goal in this project is to support those facing challenges with traditional musical instruments, such as cost, training, and mobility requirements.
Video
Video
Demo_Video_PerCom.MP4Development of HarmonicThreads
Development of HarmonicThreads
The HarmonicThreads system is developed to foster a natural user experience, with a flexible fabric as an interactable surface. We have explored a variety of approaches, using sensors to collect data from the user's interactions then devising methods to process them and produce outputs.
Stage 1: Depth Sensing
Stage 1: Depth Sensing
Using a depth sensing camera, we were able to detect the user's touch at specific locations along the fabric surface and print a circle to track that interaction.
Stage 2: Conductive Threads
Stage 2: Conductive Threads
With portability and cost in mind, we switched to an approach that embeds the sensor device into the fabric, reducing the need for a depth sensing camera or other external sensing devices. Here, conductive threads are attached to a touch sensor then sewn as columns into the fabric. Each thread is programmed to play a unique musical note.
Current Design
Current Design
The current design uses multiple sensors to sense the user's touch and force applied on the fabric. These sensor values are processed and used in a Pure Data program as parameters to control and produce sounds.
Sensors and devices: conductive thread, touch sensor, ultrasonic sensors, Arduino microcontroller boards, flip switch
Programming language: Pure Data, C++
Design Top View
Design Top View
A diagram showing the top view of the system and its components
Flowchart
Flowchart
A flowchart illustrating how the system works
Flowchart
Flowchart
A flowchart illustrating how the system works
Physical Prototype Stage 1
Physical Prototype Stage 1
This is a photo taken from the lab. At this point, the fabric is tied by the corners to a PVC pipe structure then held by friction against the walls of a cardboard box. This prototype is unstable and unsuitable to use in a real scenario. It is only supposed to provide the template for a more reliable, durable and effective design.
Physical Prototype Stage 2
Physical Prototype Stage 2
Multiple adjustments were made to ensure that the model works under a realistic setting.
To secure the fabric in place, we used a sewing machine to develop sleeves, then pulled the PVC pipes through these sleeves to make the fabric taut.
We developed a bolted laser cut wooden box to replace the cardboard one, then kept the fabric from falling inward by applying high strength Velcro attachments on the PVC and the inside frame of the box.
We also implemented wire management by crimping them and sliding them through a wire sleeve, making the design cleaner and more stable.
Current Model
Current Model
Inside View of Current Model
Inside View of Current Model
Research team:
Research team:
Ellie Nguyen, Chloe Galinato, Katelyn Teav, Franceli L. Cibrian
Acknowledgements:
Acknowledgements:
We sincerely thank Daisy Fernandez-Reyes, Tristan Do, and Miyuki Weldon for their support. This project was funded by the Fowler School of Engineering Research Grants, Chapman University's Summer Undergraduate Research Fellowship Grant, and the Robert A. Day Research Excellence Award.
Page updated
Report abuse