Richard Rodriguez - Week 6
I really like Richard's work for weeks 5 and 6. His focus on creating a scene is clearly visible. The image goes beyond the view window for the user to expose more of the scene as they interact with the tire! This was something that I thought would also be really cool to do when we need to create a game. You can clearly see his idea come to life from the sketches in week 5 to the additions of hues and even more interactivity in week 6. It inspires me to add some 'scenes' to my own work like this
This Music Visualizer will take a live sound input and display the beat visually through Processing. I found that this may need some more depth and considered using the OpenCV library to detect people and pulse the music around the silhouette of the person captured through the live camera feed.
This would make the project interactive by picking the sound, and watching the colors around the users body be transformed along with the beat of the song.
I did some research about what is available to me through Processing to make sure this is a feasible task. After my research I found that OpenCV allows for edge detection and I could possibly detect the edges of the person and manipulate those lines instead of drawing my own to the canvas.
The author of our textbook has very helpful tutorials to get started with using Sound in Processing, which I would plan to reference.
Project Outline:
Camera Input and Identify Best Detection Method
Get camera input working
As I currently understand there are 3 camera detection methods that I need to figure out which is best for my goal
Edge Detection, Object Detection or Contour Detection
These are provided by OpenCV for Processing available as an additional library in Processing (found here)
2. Fill space detected by chosen method with a solid color OR use BackgroundSubstractor once person is detected.
This is to hopefully aid in the glow effect and/or a guide for where these colors should start radiating from.
3. Return coordinates of outline of detected person
This part will be the trickiest and Im not even sure this is completely doable. With these coordinates it will create a baseline for where the colors and values go.
4. Use FFT (Fast Fourier Transform) and assign the values of the bands and amp to the coordinates gathered from the outline of the detected person.
This project will require a huge learning curve as I will need to learn the Sound and OpenCV libraries, which include FFT and Object Detection. The only concept I understand is just capturing input like camera and mic, however manipulating that data is a different obstacle. Excited and intimidated to start.
I decided to go this route because for me understanding how sound can be manipulated will be beneficial for different different mediums of art. This is also something I would like to use and share so, I'd like to take the opportunity. As a software developer, I do not have experience using tools like Processing outside of this class so applying what I know about coding into a new medium will be a great challenge that will force me to think differently from the development I do professionally.
Music Visualizer Conceptual Animation
via Procreate Dreams
**watch with sound**
Concept 1: Visual Aesthetic (all from Pinterest)
Space Scene is essentially me playing with Processing as a special effects tool to create a short clip of a rocket or spaceship flying through space. I was inspired by looking through the different Processing examples and I saw a 3D model of a rocket. I really enjoy 3D modeling so I would get to bridge those two worlds.
For this project I would import a 3D object (space craft of some sort) that would move through the space and then disappear in the distance. I am playing with the idea of adding planets or other space related things. I essentially want to create the effects shown below in the examples.
I will get the opportunity to play with a lot of things doing this like:
3D primitives, Sound (synthesizer), Lighting, Camera(maybe) and Particles.
I did however decide to not go with this for the final project as I felt it was better suited for Weeks 12 and 13 for creating a game, so Im glad I get to put this idea out as well.
The inserted video is a small visual of what I intended. The dot is the focal point that would be cool to move around the viewport to simulate turning.
( It looks super goofy in the beginning because I was not going to draw all those lines for each frame)
The video then shows the space ship that would move into frame and give the viewer a first person perspective as the space ship moves about the screen and into to 'hyper space'. Lots of opportunity here for creativity.
Space Scene Rough Animation via Procreate Dreams
Concept 2: Visual Aesthetic (all from Pinterest)