Wearable Music
AME 494 | Arizona State University
Instructor: Seth D. Thorn, PhD
Email: seth.thorn@asu.edu
Class Meeting: M/W 1:30 PM - 2:45 PM, ASU Sync,
Office Hours: Tu/Th, 10:30 AM - 11:30 AM by appointment
Instructor: Seth D. Thorn, PhD
Email: seth.thorn@asu.edu
Class Meeting: M/W 1:30 PM - 2:45 PM, ASU Sync,
Office Hours: Tu/Th, 10:30 AM - 11:30 AM by appointment
This course introduces students to wearable technology and wearable computing with the goal of developing sophisticated sonic algorithms and instruments with potential impact in dance, fashion, music, health, sports, or other contexts. Students develop their own wearable devices, employ sensor fusion algorithms, and learn mapping, signal processing, and sound synthesis techniques for creating rich, movement-responsive instruments.
In addition to learning technical skills required for musical human-computer interaction, students will engage in experimental inquiry related to somatic design, sonification, telematic play, entrainment, emergent coordination, and affective interaction. By focusing on sound as the primary modality of interaction, we'll engage an important question in interaction design that has become even more trenchant during the Covid-19 pandemic, namely, how can we interact and feel connected without looking at a screen? What is the minimum signal needed to feel connected? Students may craft novel wearable instruments to sustain such interactions.
Experience with a procedural programming language may be useful but not required. The Arduino IDE will be used to program the ESP32 microcontroller.
Familiarity with Max MSP is helpful but not required.
Acquire experience with wearable computing.
Use the Arduino IDE to program an ESP32-based microcontroller and send motion data to a computer using WiFi or Bluetooth.
Use Max MSP to perform signal processing and map motion data to sonic algorithms.
Use windowing at different time scales for estimating higher-level features (or mid-level features such as lightness, fragility, etc.).
Create high-production value sound synthesis using granular techniques, physical modeling, subtractive synthesis, and off-the-shelf VSTs.
Practice experiential design informed by felt experience and slow design (slow "soma-storming") approaches.
Sound synthesis and signal processing will be taught in the graphical programming language Max MSP, which is installed on all DC laptops. Student discounts and subscription licenses ($10 / month) are available if you wish to install the software on your own computer.
I recommend using headphones with a long wire so you can move freely when testing your musical wearable. Better still, look for a wireless solution, but note that bluetooth headphones will not work because of excessive latency. Instead, look for an analog solution: wireless headphones "for TV" work well, or you could set up an inexpensive FM transmitter / receiver solution.
Students must purchase this part:
Students will receive a portable router at no cost. These will be available for pickup:
Students must download and install this free software:
Optionally, I recommend purchasing this book, which is highly-informative and scholarly, but easy to read:
By the end of this course students will have:
Acquired experience software and hardware development skills for wearable, IoT, and tangible computing.
Explored interactive sonification of expressive body movements and movement qualities.
Proposed, revised, and developed a wearable design project informed by experiential design.
*Please note that this schedule is subject to change.
Unit 1: Introduction
Week 1: Syllabus Overview / Introduction
Week 2: Motion Data / Connectivity
Unit 2: Interactive Sound
Week 3: Sound Synthesis + Mapping
Week 4: Higher-level features
Week 5: Calibration, Signal Processing, Mapping
Week 6: Sound Design
Unit 3: Development + Ensemble
Week 7: Relational Models & Telematic Play
Week 8: Event Detection & Emergent Coordination
Week 9: Windowing & Dynamic Morphology
Week 10: Rhythmic Interaction & Entrainment
Unit 4: Collective Instruments + Ensemble
Week 11: Design Lab 1
Week 12: Design Lab 2
Week 13: Design Lab 3
Week 14: Design Lab 4
Week 15: Portfolio Presentations
The final grade for the course will be based on three assignments and a final project given during the semester, as well as a participation component:
Unit 1 Assignment: Wearable Proposal (5% of final grade)
Unit 2 Assignment: Musical Instrument (15% of final grade)
Unit 3 Assignment: Design Exercise (20% of final grade)
Unit 4: Final Project Portfolio (35% of final grade)
Participation (25% of final grade)
The grading rubric is based on the originality and technical proficiency of the work. Students are required to submit all work to Canvas; assignments submitted by email will not be reviewed. In addition to the submitted work, students will give in-class presentation for each assignment. The in-class presentation counts toward the participation grade in the course. The instructor reserves the right to give independent grades/evaluations for individuals who choose to work in groups.
A+ 98% - 100% | A 93% - 97% | A- 90% - 92%
B+ 88% - 89% | B 83% - 87% | B- 80% - 82%
C+ 78% - 79% | C 70% - 77% | D 60% - 69%
E 0% - 59%
All grades will be rounded to the nearest whole number. Grades that are on the border of a letter grade will be rounded up to the next letter grade. Grades will only be raised by 0.5%.
The incomplete is not a routine process for successful completion of coursework. Rather, it is a limited academic exception intended to address situations where a student who has been doing acceptable work has experienced exceptional extenuating circumstances beyond the student’s control preventing their timely completion of the course. In evaluating requests for an incomplete, I not only evaluate the nature of the stated extenuating circumstances and whether such circumstances were beyond the student’s control, but also whether the student’s record of performance in the class demonstrates the likelihood for successful completion of the remaining coursework. You can read more about the incomplete policy at: https://www.asu.edu/aad/manuals/ssm/ssm203-09.html
Late work will be accepted for 50% credit for up to two weeks after the deadline (with the exception of the final project, which cannot be extended). Exceptions to the half-credit policy will be made for late work due to religious observances, medical reasons, or family emergencies, provided that there is corroborating documentation. In no case will work be accepted more than two weeks past the deadline.
Office hours are by appointment. To schedule a meeting, send a request by email. If you need to cancel your appointment, please let me know before the meeting if possible. I cannot make appointments outside of my regularly scheduled office hours.
This course uses Sync. ASU Sync is a technology-enhanced approach designed to meet the dynamic needs of the class. During Sync classes, students learn remotely through live class lectures, discussions, study groups and/or tutoring. You can find out more information about ASU Sync for students here, https://provost.asu.edu/sync/students and https://www.asu.edu/about/spring-2021.
To access live sessions of this class, use this link (also posted above): https://asu.zoom.us/j/7130372627
If you cannot physically be on campus due to travel restrictions or personal health concerns, you will be able to attend your classes via ASU Sync or through iCourses during the fall semester. If you will not be on-campus for the fall semester, you are expected to contact your professors to make accommodations.
Attendance and participation for the duration of the class period is mandatory. If you have more than 3 absences (unexcused), your final grade will be lowered 1/3 grade for each subsequent absence (i.e. B to B-). You should notify me by email prior to absence if possible and provide doctor’s note where applicable. Repeated tardiness and leaving class early will be recorded, and as a result, your final grade will be lowered. It is the student's responsibility to keep track of his/her absences.
Excused absences related to religious observances/practices in accord with ACD 304–04, “Accommodation for Religious Practices.” Students may be excused for the observance of religious holidays. Students should notify the instructor at the beginning of the semester about the need to be absent from class due to religious observances. Students will be responsible for materials covered during their absence and should consult with the instructor to arrange reasonable accommodation for missed exams or other required assignments.
Excused absences related to university sanctioned activities in accord with ACD 304– 02, “Missed Classes Due to University-Sanctioned Activities.” Students required to miss classes due to university sanctioned activities will not be counted absent. However, absence from class or examinations due to university-sanctioned activities does not relieve students from responsibility for any part of the course work required during the period of the absence. Students should inform the instructor early in the semester of upcoming scheduled absences and immediately upon learning of unscheduled required class absences. Reasonable accommodation to make up missed exams or other required assignments will be made. Consult the instructor BEFORE the absence to arrange for this accommodation.
Line-of-duty absence and missed assignment policy: A student who is a member of the National Guard, Reserve, or other U.S. Armed Forces branch who misses classes, assignments or examinations due to line-of-duty responsibilities shall have the opportunity to make up the coursework in accordance with SSM 201-18 Accommodating Active Duty Military Personnel. This accommodation also applies to spouses who are the guardian of minor children during line-of -duty activities. This policy does not excuse students from course responsibilities during their absence. Students should first notify the Pat Tillman Veterans Center of their activation and then the instructor to discuss options.
Your instructor will make any reasonable adaptations for limitations due to any disability documented with the Student Accessibility and Inclusive Learning Services (SAILS), including learning disabilities. Please contact the instructor during office hours or by appointment to discuss any special needs you may have. You must contact the SAILS to process the paperwork for special course accommodations. To request academic accommodations due to a disability, please contact the SAILS (https://eoss.asu.edu/drc); Phone: (480) 965-1234; TDD: (480) 965-9000). Students who feel they will need disability accommodations in this class but have not registered SAILS should contact SAILS immediately. Students should contact the Center on the campus that your class is being held. Campus-specific location and contact information can be found on the SAILS website. SAILS offices are open 8 a.m. to 5 p.m. Monday – Friday. Check the above website for eligibility and documentation policies (https://eoss.asu.edu/drc). This is a very important step as accommodations may be difficult to make retroactively. If you have a letter from their office indicating that you have a disability which requires academic accommodations, in order to assure that you receive your accommodations in a timely manner, please present this documentation to me as soon as possible so that your needs can be addressed effectively.
Students will be required to have their cameras on during all class sessions. For students with bandwidth issues (e.g., the entire Arcadia residential community on campus), cameras may remain off for all sessions when necessary.
ASU Sync classes can be live streamed anywhere with the proper technology. We encourage you to use a PC or Apple laptop or desktop equipped with a built-in or standalone webcam. You will need an internet connection that can effectively stream live broadcasts. It is recommended that your internet download speed is at least 5.0 mbps. You can use this tool to test your current connection.
We do not recommend the use of iPads or Chromebooks for ASU Sync as these devices do not work for class exams that may be proctored remotely.
If you are not able to personally finance the equipment you need to attend class via ASU Sync, ASU has a laptop and WiFi hotspot checkout program available through ASU Library.
Who is eligible?
Any currently enrolled ASU student is eligible to checkout a laptop. The current availability of laptops can be found here.
Laptops are lent on a first-come, first-serve basis, and cannot be reserved in advance. They can be returned at any time, but will be due at the conclusion of the spring 2021 semester.
Rentals are limited to one laptop per student.
Laptops are available for checkout at the following libraries on all four campuses. (Please check online for current library hours) ○ Downtow
Phoenix campus Library
Polytechnic campus Library
Tempe: Hayden and Noble Libraries
West campus: Fletcher Library
Return laptops to any ASU Library Information Desk (not at the drop box or other location).
Refer to ASU Library Computer Use Policy and ASU Computer, Internet, and Electronic Communications Policy.
Borrowers are responsible for loss, damage, and theft of the laptop while in their possession. Borrowers should verify the condition of the laptop at the time of check-out and upon check-in.
The contents of this course, including lectures and other instructional materials, are copyrighted materials. Students may not share outside the class, including uploading, selling, or distributing course content or notes taken during the conduct of the course. Any recording of class sessions by students is prohibited, except as part of an accommodation approved by the Student Accessibility and Inclusive Learning Services.
Please note that video-taped class material may be used by the instructor for development and/or promotional purposes.
To be successful:
● check the course daily
● read announcements
● read and respond to course email messages as needed
● complete assignments by the due dates specified
● communicate regularly with your instructor and peers
● create a study and/or assignment schedule to stay on track
● access ASU Student Resources
ASU adheres to a university-wide Student Code of Conduct. The philosophy behind this policy states: The aim of education is the intellectual, personal, social, and ethical development of the individual. The educational process is ideally conducted in an environment that encourages reasoned discourse, intellectual honesty, openness to constructive change and respect for the rights of all individuals. Self-discipline and a respect for the rights of others in the university community are necessary for the fulfillment of such goals. The Student Code of Conduct is designed to promote this environment at each of the state universities. You are expected to treat your instructor and your fellow classmates with respect and kindness. In all correspondence and in Discussion Board postings, you should show respect for the viewpoints of others who may disagree with you or see things from a different perspective. Criticizing, ridiculing, insulting, or belittling others will not be accepted. Keep in mind that electronic communications do not have the advantage of nonverbal cues that are so much a part of interpersonal communication. Humor or satire can sometimes be misinterpreted in strictly electronic communication forums. In addition, all students should be aware of their Rights and Responsibilities at Arizona State University.
Self-discipline and a respect for the rights of others in the classroom or studio and university community are necessary for a conducive learning and teaching environment. Threatening or violent behavior will result in the administrative withdrawal of the student from the class. Disruptive behavior may result in the removal of the student from the class. Threatening, violent, or disruptive behavior will not be tolerated in this class, and will be handled in accordance with ASU policy (SSM 104-02). For more information please visit:
https://eoss.asu.edu/dos/srr/PoliciesAndProcedures
https://eoss.asu.edu/dos/safety/ThreateningBehavior
If you are unable to complete the course, it is your responsibility to arrange for withdrawal from the class. You will not be automatically withdrawn and unless you are officially withdrawn from the course you will receive a final grade based upon the total points you have earned for the semester. Students are required to pay all tuition fees for any registered course unless enrollment is official cancelled during the 100% refund period. Please visit the Academic Calendar to review the withdrawal deadlines for this semester. For more information on Drop/Add and Withdrawal visit:
Title IX is a federal law that provides that no person be excluded on the basis of sex from participation in, be denied benefits of, or be subjected to discrimination under any education program or activity. Both Title IX and university policy make clear that sexual violence and harassment based on sex is prohibited. An individual who believes they have been subjected to sexual violence or harassed on the basis of sex can seek support, including counseling and academic support, from the university. If you or someone you know has been harassed on the basis of sex or sexually assaulted, you can find information and resources at:
https://sexualviolenceprevention.asu.edu/faqs
As a mandated reporter, I am obligated to report any information I become aware of regarding alleged acts of sexual discrimination, including sexual violence and dating violence. ASU Counseling Services (https://eoss.asu.edu/counseling) is available if you wish to discuss any concerns confidentially and privately.
Policy on sexual discrimination as described in ACD 401, "Prohibition Against Discrimination, Harassment, and Retaliation", including the fact that the instructor is a mandated reporter and therefore obligated to report any information regarding alleged acts of sexual discrimination. Arizona State University is committed to providing an environment free of discrimination, harassment, or retaliation for the entire university community, including all students, faculty members, staff employees, and guests. ASU expressly prohibits discrimination, harassment, and retaliation by employees, students, contractors, or agents of the university based on any protected status: race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, and genetic information.
The instructor may choose to record class lectures and upload them to a password-enabled external hosting site. Students must refrain from uploading to any course shell, discussion board, or website used by the course instructor or other course forum, material that is not the student's original work, unless the student first complies with all applicable copyright laws. Faculty members reserve the right to delete materials on the grounds of suspected copyright infringement. The course content, including lectures and other handouts, is copyrighted material. THIS CONTENT IS PROTECTED AND MAY NOT BE SHARED, UPLOADED, SOLD, OR DISTRIBUTED.
Except where noted, the course materials and Max MSP patches are my own and are copyrighted. Please do not share, distribute, or upload without my permission.
The ASU student honor code affirms the commitment of ASU to uphold the values, principles, and ethics of academic integrity. All students are expected to follow the code, which states:
“We, the students of Arizona State University, have adopted this code as an affirmation of our commitment to academic integrity and our participation in ethical education. We embrace the duty to uphold ASU’s Honor Code, and in light of that duty,We promise to refrain from academic dishonesty. We pledge to act with integrity and honesty to promote these values among our peers. We agree to always abide by the Sun Devil Way and uphold the values of the New American University.”
Every student is expected to produce his/her original, independent work. Any student whose work indicates a violation of the ASU Academic Integrity Policy including cheating, plagiarism, and dishonesty will be subject to disciplinary action. Plagiarism is defined as deliberately passing off someone else’s words or ideas as your own. All necessary and appropriate sanctions will be issued to all parties involved with plagiarizing any and all course work. Plagiarism and any other form of academic dishonesty that is in violation with the Student Code of Conduct will not be tolerated. Arizona State University and the Herberger Institute for Design and the Arts expect the highest standards of academic integrity from all students. Failure to meet these standards may result in suspension or expulsion from the university or other sanctions as specified in the ASU Student Academic Integrity Policy (http://provost.asu.edu/academicintegrity), “[e]ach student must act with honesty and integrity, and must respect the rights of others in carrying out all academic assignments.” This policy also defines academic dishonesty and sets a process for faculty members and colleges to sanction dishonesty. Violations of this policy fall into five broad areas that include but are not limited to:
Cheating on an academic evaluation or assignments
Plagiarizing
Academic deceit, such as fabricating data or information
Aiding Academic Integrity Policy violations and inappropriately collaborating
Falsifying academic records
I sanction any incidents of academic dishonesty in my courses using University and HIDA guidelines. Should you have any question about whether or not something falls subject to this clause, feel free to contact me or review the university policy on academic integrity at the above link. Per ASU policy, a student may not avoid the consequences of academic dishonesty by withdrawing from a course, and may be placed back in the course in order to face sanctions resulting from academic integrity violations. You are responsible for abiding by this policy.
Effective immediately at Arizona State University, face coverings will be required for all employees, students and visitors while in buildings. Face coverings will also be required in outdoor community spaces where social distancing isn’t possible. Examples of outdoor community spaces include garages and parking lots, ASU shuttles, bicycle racks and sidewalks.
https://eoss.asu.edu/health/announcements/coronavirus
Students should wait for an absent instructor 15 minutes in class sessions of 90 minutes or less, and 30 minutes for those lasting more than 90 minutes, unless directed otherwise by someone from the academic unit.
The Instructor reserves the right to change portions of this syllabus (assignments, deadlines etc.) by verbal instructions during scheduled class time. The student is responsible for noting changes and acting accordingly. Grading and absence policies are not subject to change.