HUMAN MODULAR [AUDIO & VIDEO] SYNTHESIZER
(conceptual work) ・・・・・・・・・・・・・・・・
- Ismael Rittmann
- Keywords：Graphic Design, Music, Visualization, 3D Animation
Inspiration / References:
Interface- / Product Design:
Conceptual and visual work on a fictional audivisual experience space.
A participative music collaboration and performance.
Background and Purpose
I am interested in music and its visualization. In my opinion music is a very social medium. It can connect people without words - since sound itself is a language.
All visual media will be made of colored squares that function as visual modules to structure a space in a grid like fashion. On top of this raster, symbols and bigger shapes are placed to fill the background with content. All symbols only have one outline and always hold the opposite colour to their background. This effect multiplies.
This simple system allows for a unique look but still a lot of variation. It is easy to understand and stands out.
The pictograms function a bit like hyroglyphs and are meant to transport a message via semantic shapes, universally readable.
This system is based on these intuitively chosen colors:
[All colors arranged after brightness]
[a big grid of small squares displayes the audiospectrum in an abstract way. It reacts to any sound and can be adjusted in many different ways]
[layers of the audiovisual: spectrum, image(symbols), combined]
A room with projecters or screens on all four walls would be the ideal space for this fictional experience. The walls play the visuals and the guests have an influence on the music. For this to work I introduced a controller, which also functions as the advertising flyer. The two unique codes on the front of the paper can be read by a camera and translated into a rotational value. This value is then midi mapped to an instrument or effect to influence the music.
- Flyer (visual language)
- Audiovisual Mock-Up (animation & sound)
Music: ITSU - Fingerspelling
- Adobe Illustrator
- (Ableton Live)
The field of audiovisualisation is huge, and there are millions of ways to translate music into imgery. Creating one real time rendered version was a very good practice. I finally could motivate myself to look into Touchdesigner properly since I have always wanted to learn it.
- electronic music in clubs is consumed in a very hierarchic fashion. The Dj plays music - everyone else listens. Although this is already a social event, it leaves its participants very passive.
- music listening and creating could be a more interactive social event. This for example already happens at Karaoke in a specific way.
With motion tracking systems like XBox Kinect and all kinds of music games, the act of interacting with music is already widely spread and digitised.
These tools however are often used for personal experiences and not utilised for collective, interactive social experiences.
O find a topic
O formulate concept
O hold midterm presentation
O Create a final style for the audiovisual in touchdesigner.
O document that style and touchdesigner program.
O make finished version of flyer and poster.
O prepare everything for the presentation.
- Finished a functional version of the Visual Program in Touchdesigner.
- Worked on the flyer.
- Created an additional Poster.
I am currently thinking of motifs and ways the music visualization could work / what it should look like.
work on the interims report
(structure, explanation, etc....)
I composed and structured some simple electronic music loop in Ableton Live.
For this I used the track "ITSU - Futura" as a reference.
I improved the previous flyer design.
- added more sympols
- added a text styling for both english and japanese characters (filler text)
- changed the style for unique symbols (hand)
I am also collecting my thoughts on the process for the midterm presentation to have an easy to understand narrative.
I am currently looking into Touchdesigner and Ableton Live as my tools for audiovisualization.
introducing the visual language:
I am trying to develop an easy to understand and recognizable craphical identity.
As a basis I use 50x50 mm squares in 12 (13) colors. On each square or 'module' one symbol can be fittet. It is displayed in the contrary color to its background. This creates a sharp and vibrant contrast and the flyer looks very colorful and alive. The base colors were selected to harmonize with each other to some extent but allow for a lot of variety.
As a reference I would like to show some Modular synthesizers:
formulating the idea:
concept for fictional event:
a flyer acts as invitation and information holder. This flyer has printed various color codes and digital tracking markers on its outside.
This design choice is supposed to make the flyer become a kind of controller that can be registered and read by a camera/computer.
At the event installation the setup allows visitors to use their flyers as controllers to affect the music.
I plan to use the method of modulation as a key principle of the controllers intended function.
- The visual language should explain the simple functionality without words.
- Further functionalities will be explained on the inside of the flyer.
explaining illustrations will follow...
further research on my topic:
- idea to either create a mockup of the installation in digital or research the necessary tools to realize such an installation in a real space.
- I'm currently trying to reduce the amount of work and intended outputs to a realistic and manageable level.
- I also want to work out a visual identity for the fictional event.
What am I thinking about? / topic:
- I am interested in music visualization. In my opinion music is a very social medium. It can connect people without words - since sound itself is a language.
- Especially instrumental music has the ability to evoke images in ones personal imagination. I have always found it interesting to extract and find these images. They are my interpretation of the music. These images can strengthen the perception of the sound and arrangement and can also be used to make listening to music a social event.
- I want to make an interactive music visualizer that invites people to engage with a visual projection installation.
Research / Inspiration: