Final Projection Mapping experiment

 

The final projection mapping video is split into 3 sections. Each section is designed to represent Michel Chion's audiovisual theories, namely his findings on image temporisation.

Exhibit A

"sound renders the perception of time in the image as exact, detailed, immediate, concrete"

the shot is “going somewhere and it is oriented in time"

The first experiment progressively shows how sound synchronised with visuals can create a sense of anticipation. Skream's Settled is the electronic track I chose to accompany the projections. As each note sounds, windows appear to match them, the stairs and windows move up and down according to the pitch of the note playing to mimic a/v animation.

Contradictions

This can be achieved with more accurately by making keyframes reactant to the music, a practice which I will look into.

A/v artists can perfectly time the visuals making the practice somewhat obsolete.

Exhibit B

  “sound vectorises or dramatises shots, orienting them toward a future, a goal, and creation of a feeling of imminence”

"temporisation also depends on the type of sound present. depending on density, internal texture, tone quality. and progression, a sound can temporally animate an image to a greater or lesser degree, and with a more or less driving or restrained rhythm."

The second experiment lets the image take the back seat. As the music builds up, the shapes on the building shift. Although the audiovisual connection is limited to our processing of the two as individuals, the visuals do assist in creating anticipation. The visuals, which crawl along with the build up, help to slow the temporality of the scene before the climax of the song.

From an animation point of view, the frames could have been more cleanly done. the outline should have been a pre composition with the shifting colour sitting on a lower layer in After effects. 

The corner pin tool could have been used more accurately throughout the whole project. I sometimes used it manually where it could have been more accurately by typing their exact coordinates

Exhibit C

 “Movement of characters or objects, movement of smoke or light”

“Here, sound’s temporality combines with the temporality already present in the image. The two may move in concert or slightly at odds with each other, in the same manner as two instruments playing simultaneously.”