EL 1 Portfolio

Prototype experimentation: Session 1

I managed to acquire some metal from Goldsmith’s university, choosing long thick pieces with the aim of having a lower and wider resonant frequency range. We started by grinding the sharp edges off the pieces to make them safe, then we drilled holes as a means to hang them. The heaviest piece was too thick to drill through, so we welded two hooks on.

I chose to use a larger transducer for more volume, the downside of which was the suction cup was too large for the beams, so I had to tape the speakers on. I don’t think this was the most effective method. I’ve found the struggle with this method of sound is balancing the strength of the connection (between the speaker and material) and the damping of the resonance that occurs through attachment. Im considering trying a g clamp next as they are metal and hopefully won’t dampen the sound.

My original plan was to have two beams working in stereo, but after having trouble with syncing the two transducers, and lack of volume, I decided to stick to one beam. I found the material influenced the sound a lot, and the input sound of an E-bow on a metal guitar string suited the timbre. In the interest of time I decided to play a recording I made a few weeks earlier with about 4 harmonies, luckily I had many different versions with some other instrument such as synthesisers, granulated vocal recordings and electric guitar. This gave me a better understanding of how to compose the arrangement, how certain instruments resonated with the material and what worked well when combined.

A drawback I discovered while using this method is that it’s very hard to achieve a decent volume, to solve this I decided to record the sound using a zoom Hn5 held very close to the beam. I found that the the sound drastically changed depending on where I placed the mic, I could change the amount of low end by moving the mic. Towards the end of the session I found this to be the best position, it gave me the most ‘material’ in the sound:

Through this method I could also experiment with swinging the beam to bring a more dynamic spatialisation to the recording.

I realised that the input files had too much reverb applied and the identity of the material was getting lost. Removing all of the reverb resulted in a very empty sound, and was not what I set out for so I gradually added small amounts of reverb until I found a middle ground.

Retrospectively I realised I misunderstood the order of these manipulations. My first mistake was having all 4 harmonies play at the same time through one beam, I feel this loses a lot of the detail I could have harvested from the material had it been layered. My second mistake was applying the reverb first. No reverb sounded empty to me because I was listening to the whole composition through the material, giving me the expectation of a finished piece. I believe the better method would be to record each harmony separately through the material, I can then combine these recordings in the DAW and recreate the digital landscape’s structure. These recordings can then have reverb added as a last measure to contextualise them in the mountainside.

Revised order of process:

  • Record harmonies separately with no reverb
  • Create the soundscape in the DAW
  • Add these recordings in the space with Gain adjustment for distance
  • Add a Convolution reverb to contextualise the recordings in a realistic space.

I spent the last portion of the session crudely putting together a soundscape comprised of a few woodland recordings found on BBC library, a chain recording I conducted in the performance lab quickly and a wind track. I then layered a few of the recordings from this experiment to see how they fit together. I believe it is a proof of concept, however the harmonic metal moans need to be separated and contextualised in the digital space.

Rough draft for soundscape + Experimentation recordings

EL 1 Portfolio

SOUND RESEARCH: CRISTOBAL TAPIA DE VEER (UTOPIA)

I recently watched the 2013 drama Utopia. A show about conspiracy, engineered reality and humanity turned mechanical. The whole show has a very uncomfortable undertone, like nothing is what it seems, that everything that happens is part of some kind of plan. Some characters are convinced from an early age that they can do whatever they want because they are but a tiny blip in history, they become mechanical in their actions, with no thought of morality. 

This theme of engineered reality and this feeling of constant discomfort is potently expressed in the soundtrack created by Cristobal Tapia De Veer. He achieves this through manipulating samples of organic sounds such as birds or human breathing.

In the pursuit of texture, Cristobal avoids samples that he describes as too clean, pure or sterile. Instead he looks for samples from vinyls, then ‘disrespects’ or ‘tortures’ them with compression, bit crushers etc. He describes it as making them ‘textural, grainy, dirty, flawed, alive.’ He then slows down the sample, this makes the ultra fast moving waves perceivable, as rhythm. Cristobal samples a very small part of the audio file and loops it, giving it infinite sustain. He describes hidden rhythms ‘in the DNA’ of a sound. Using these dirty, rhythmic, alive sounds, Cristobal creates haunting scores that feel unsettling, alive but not quite organic. A frankensteins monster or a score. 

Cristobal Tapia De Veer created a soundtrack that perfectly complimented the show, in context and tone. I hope to bring this kind of ingenuity to my practice, considering how you can reflect the story and tone of a piece of media in the tools and auditory material you use. Manipulating samples to mould them into something new, finding texture in sound through disrespecting and torturing it. 

Using Cristobal’s techniques listed above, I created a piece of music in the style of Utopia.

I started with a sample of a male owl from the BBC sound library, I chose an owl because their call tends to hold a note. I then increased the gain, decreased the bit resolution, and selected a small part of the audio file. I played a melody on the lower notes on the keyboard, this gave the notes a gritty texture, the note slightly wavered giving it a natural but eerie sound.

I then took a sample of myself singing a note with an ă pronunciation, I repeated the process I did for the owl sample but played it only slightly under the original pitch. I liked how it sounded almost right/natural but not quite. I played the main melody with this instrument. The main melody was supported by a sample of myself singing a higher note with an ŏ pronunciation, chorus and reverb was then added to this sample and it was placed low in the mix.

I then recorded myself breathing out, I reversed the sample then vocoded it. This resulted in a rhythmic, almost human sound. I also recorded a sample of my neighbours builders hammering something, I think it sounds like a clock that doesn’t keep time which adds to the uneasy tone I’m aiming for. For the introduction I layered three samples of birds chirping, I then vocoded it and only played the vocoded part. On top of this I added a very quiet melody using the instrument made from my voice. I used two reversed samples of myself saying something to transition into the main melodies. I recorded an egg shaker, doubled the speed of the recording and added a tremolo to it, this made a very dry percussive sound that had movement, almost like an insect moving its wings. I used a recording of myself very lightly coughing to contrast the unnatural vocoded inward breath, this is intended throw the listener into a rhythm that is very suddenly interrupted by the chorus coming in a beat early. In the chorus, I used a sample of native American people shouting and screaming, it had a slight rhythmic quality and was melodically chaotic.

If I were to do this again I would increase the tempo to make the piece more intense, also I would more clearly plan out the layers of the piece, background foreground etc…

My piece:

EL 1 Portfolio

Clarifying ‘Immersion’

I use the term ‘immersion’ quite a lot in my research and writings in this project, and I would like to clarify exactly what I mean. The definition of immersion is deep mental involvement in something. This is a very broad definition and doesn’t suit my project. When I refer to immersion I am referring to diegetic immersion, a maintaining of audiovisual correspondence between musical source and what’s on the screen. Perhaps it is useful to define what the opposite of this immersion is so I know what to avoid, this would be the audience becoming aware or being reminded of the fact that they are watching a film, that everything they are seeing and hearing is designed to influence them. Once aware of this fact, I believe that the viewer is taken out of the experience.

My practice is focused on the relationship between score and story, musical and diegetic. I would like to investigate methods of building musical scores out of diegetic sound, and possibly maintaining diegetic congruency throughout the score. This is not to say that a traditional non-diegetic score is not immersive, they can be extremely immersive. It is even possible that the reason the can be so immersive is because it sits on a different plane to the story (Chion), giving the story space to be experienced. Perhaps the emotional influence overpowers the ‘self outing’ (Revealing the processes/construction of film) nature of the non-diegetic score. Furthermore, it could be that the ritual of sitting down in front of a screen already presupposes the viewer has accepted the non-real nature of film.

Regardless of these possibilities, I will be investigating the avenue of composition for film. This is because the research I have conducted on cinematic sound designers leads me to the conclusion that a diegetic score should be more immersive than a non-diegetic score. As the audience, generally we identify with the protagonist. We see through their eyes and hear what they hear. Our experience of the story is channeled through a person (obviously there are multiple exceptions eg. dramatic irony, films lacking people). It therefore makes sense to me that if we want total narrative and experiential immersion, the audience should only be hearing what the protagonist could conceivably be able to hear. Anything outside of that draws attention to the medium.

This may be a futile experiment in the long run, it is possible that these techniques make no difference to the immersion of a film. I think it is still a worthwhile investigation that may lead to some interesting results, uncover some useful techniques and give me a more in-depth understanding of the construction of film sound/scores.

EL 1 Portfolio

Materialism in sound art

Pierre Schaeffer

My practice and research is stems from the idea of the ‘material’ in sound art, through this practice we can achieve more immersive, diegesis focused cinematic scores. The principal movement that pathed the way for this practice is music concrete, pioneered by Schaeffer and Henry. Music concrete is composition using non-musical sounds, by considering the various qualities inherent in everyday sounds (pitch, length, percussion, timbre) you can layer and arrange these elements into a piece of music.

Variations for a door and a sigh

Acousmatic music developed out of music concrete, a complete decontextualisation of the sounds used for composition, the only matter of concern is the final noise rather than the source. This form of music is a subversion of our natural cause and effect method of listening. We analyse our environment for many reasons, to orient yourself or determine whether danger is present. We listen to a sound and immediately attach the source. Acousmatic music removes the source, and forces the audience to listen to these sounds in a musical way. I believe that it is impossible to completely remove context, the psychoacoustic and psychological elements at play mean that the audience will most likely be able to recognise elements of the noise. Either the audience can recognise the origin of the sound (such as the door and the sigh) or if the noise has been manipulated beyond recognition, the material remains. The sound of wood, metal or stone will remain recognisable.

I would like to take this methodology and approach to music making, and apply it to my project in a slightly different way. I would like to play music through a material using a transducer and record it’s vibrations in a space, this way I will achieve musical expression while maintaining the material identity. Hopefully this will result in a more believable sound than if I were to synthesise a metallic cello per say, at least this is what Mark Mangini’s postulations on psychoacoustic qualities of real recordings being more immersive lead me to believe. (DUNE research)

EL 1 Portfolio

Possible Direction of Experimentation

Material Quartet

I would like to compose a quartet piece, then using transducers play material as each instrument. This way I am able to create a musical piece that has the sonic identity of the material found in the animated world.

There are multiple iterations of this technique I could try:

The first is Three suspended metal beams with transducers attached, with a bass transducer underneath a slab of concrete. I believe this will probably be the most successful version.

The second is two suspended metal beams with transducers attached, and a loudspeaker with soil in the cone. I believe the soil might add an interesting texture and bring a more organic colour to the overall palette, but this arrangement might lack low end.

I believe I will most likely end up mixing arrangements to find the right palette. The first order of business however is to experiment with material and transducer, I think it might take some time to find the right resonance for the composition.

EL 1 Portfolio

ANIMISM/RESONANCE

Animism is an anthropological term that refers to an ideology found in many spiritualities. It’s the concept that people, animals, geographical and natural phenomenon are all connected by an individual spirit they all possess.

You can find elements of animism as early as Plato, as in his 380BC writings ‘Republic’ he refers to the souls of people and cities. Animus Mundi (world soul) was a commonly held concept among Ancient Greek philosophers. The concept is now however associated with primitive cultures due to 18th century ethnocentrism, specifically the work of Sir Edward Burnett Tylor and his book ‘Primitive Cultures’.

The Siberian Eveny culture engage in a form of animism in which the animals that they hunt are seen as ‘master parents’ to humans. The animal’s parental responsibility is a sacrifice, however this sacrifice can only happen if a certain hierarchy is reached in which the human must eat them to survive. There is a respect there that is not present in western tradition, the hunter exclaims after the kill “you came to me out of your own free will, please have pity on us and do not harm us”.

I believe that a parallel can be drawn between animism and resonance. Every object will emit a natural frequency when struck, if this frequency is exerted on the object, a compounding of waves occurs and the natural vibrations are amplified. For example a glass may have a natural frequency of 575Hz, if the glass has minimal imperfections and a speaker is playing 575Hz next to the object, the glass will vibrate at this frequency. It is possible to shatter the glass through these means.

Resonance can be seen as a force individual to each object, that allows for an interplay between inanimate things. This phenomenon also allows for interplay between object and human, as seen in the case of the millennium bridge.

On June 10th 2000, the millennium bridge was opened to the public. In order to avoid spoiling the view of the Thames and St Pauls cathedral, the architects refused to design the bridge with any tall support struts. Instead they opted for a horizontal suspension bridge, an impressive feat of engineering with a small oversight. The engineers forgot to account for the slight horizontal sway that occurs in a human’s walk. By coincidence the natural frequency of the bridge was equal to the frequency of the horizontal sway of a human’s gate. When this slight swaying is multiplied by the large amounts of foot traffic, the people amplified the frequency and the bridge wobbled quite drastically. This resulted in the bridge being closed, multiple foot traffic tests being conducted and eventually the implementation of dampeners on the suspension cables. Like putting a sock in a guitar bridge.

There is an interplay between human and object due to resonant frequencies, I would like to explore this further for this project. I believe respecting and working with the resonant identity of each object might result in interesting sonic performances whilst also respecting the content of the narrative.

Perkins, M., 2022. What Is Animism?. [online] Learn Religions. Available at: <https://www.learnreligions.com/what-is-animism-4588366> [Accessed 27 September 2022].

Swancutt, K., 2022. Animism. [online] Cambridge Encyclopedia of Anthropology. Available at: <https://www.anthroencyclopedia.com/entry/animism> [Accessed 27 September 2022].

BYJUS. 2022. Resonance – Definition, Examples & Resonant Frequency With Formula. [online] Available at: <https://byjus.com/physics/resonance/> [Accessed 28 September 2022].

Strogatz, S., 2022. [online] Available at: <https://www.sciencedaily.com/releases/2005/11/051103080801.htm> [Accessed 28 September 2022].

EL 1 Portfolio

HESAPIA

Image from ‘Hesapia’ Unreal project

Ive been given the opportunity to collaborate with a third year fine art student from Goldsmiths. Using software such as Unreal engine and cinema 4D they create intricate digital worlds, steeped in philosophical detail with narratives inspired by the likes of Carl Yung, Joseph Campbell and Religious texts.

The project is titled ‘Hesapia’. This is a fabricated word derived from the word ‘He Sapa’, a Native American Lakota word meaning ‘Black Ridge’. This refers to a mountain range that is believed to be the centre of the universe for the Lakota Sioux, and the origin of many Native American peoples. This land was later commandeered by western expansion and became part of the Dakota territory.

‘He Sapa’

Eunjo, my collaborator has drawn a parallel with He Sapa and the Garden of Eden. In her eyes, the Garden of Eden is a false narrative, the snake (representing nature) is vilified, as too is womanhood. The real Garden of Eden (or paradise) is more that of He Sapa, a balance of person and nature, life and death being appreciated in the same respect. A subversion of the typical western ideals of Anthropocentrism. This subversion is extended beyond the idea of anthropocentrism, to a balance of good, evil, creation and destruction. This is inspired by the works of Carl Yung, in which he denounces the idea of the dichotomy of good and evil, two forces that are in constant conflict and are incapable of harmonisation.

‘Hesapia’ will take on the form of an animated short film, with the potential of being transformed into an interactive space or game. The film will include many characters, representing various elements of philosophical writings, performing symbolic actions. Ultimately, the project is a reimagining of the Garden of Eden, one which represents and reflects with more accuracy the human condition and the relationships between humanity, object and nature.

I believe that this project is ripe for sonic exploration, it offers opportunity to experiment not only with sound design methodologies, but with contextual reflection within the sound world. I’m drawn to this project specifically because it is a perfect space for me to continue the practice I developed over the last two years, diegetic/soundscape composition. The philosophical and narrative substance allows for emotional exploration within the musical side of the sound design, and world building nature of her practice gives me insight into material from which to perform the composition.

Bibliography:

An Interview/meeting conducted with the artist in which we discussed the general overview of the project. Conducted 26th September 2022

Estes, N., 2022. Go back to where you come from, the Trump fans yelled. But “we came from there!”. [online] Mother Jones. Available at: <https://www.motherjones.com/environment/2021/01/the-battle-for-the-black-hills/> [Accessed 27 September 2022].

Magazine, B., 2022. Paha Sapa – The Black Hills – Black Hills Visitor. [online] Black Hills Visitor. Available at: <https://blackhillsvisitor.com/learn/paha-sapa-the-black-hills/> [Accessed 27 September 2022].

EL 1 Portfolio

Definition of my practice

The central area of praxis for my prototype is soundscape composition as a means to bring musicality to diegetic sounds in cinema, either through utilising material as a reverberant body or manipulating field recordings.

I am interested in this practice as it provides a challenge to scoring for cinema, that will in theory create an immersive musical experience based in environmental sound. By exploring this practice, i will gain an in depth understanding of how cinematic sound interweaves both music and representational sound. I will better understand the levels of abstraction on the spectrum of synchresis.

The physical representation of this exploration will be an approximately 8 minute score for an animation, comprised of hyper-realistic soundscapes gradually oscillating in and out of musical abstraction.

Sources that might be useful for this research are:

  • Soundscape Composers
  • Music Concrete Composers
  • Cinematic Sound designers
  • Writings on Cinematic Synchresis

EL Portfolio

Howard Ashman, Musical theatre and Emotional Transitioning

Howard Ashman - D23

Howard Ashman joined Disney in 1986 as a creative director and lyricist, his first big project was ‘The little Mermaid’ (1989). Ashman’s work on this project begun what is now referred to Disney’s golden age. His unique influence on the animated film genre was derived from his musical theatre background. Firstly, he reworked the traditional methodology for writing the films. He identified emotional states the characters needed to experience, wrote incredibly strong songs based on these emotions, then wrote the story to connect the songs.

The most important thing ashman brought to Disney’s animated films however, in my opinion, is an appreciation for diegetic music and emotional intensities. Howard ashman identifies this problem in a lecture he gave to the staff at Disney:

‘songs on the soundtrack, (are) as if the narrator is saying something, as if the narrator is going oooo oooo oooo staying alive staying alive. Who is singing that right ? (crowd laughs) But if you take it seriously and look at the structure, who is singing that is God out there, who is singing that is the narrator’s voice. Who is singing that is the film maker making a comment.’

(Howard Ashman from video by Sideways, 2019)

Ashman recognised the contextual and emotional distance between soundtrack and character, by making the music diegetic and placed within the narrative he allows the audience to better connect with the characters and empathise.

The last musical theatre inspired influence Ashman brought to the little mermaid was seamless transitions of emotional intensity. A common adage in musical theatre is if the emotion is too strong for speech then you sing, if its too strong for song then you dance. A valuable aspect of this is that it allows for a gradual rise of emotional intensity, keeping the audience on the journey. Much like a frog in a pot of gradually heating up water, the audience don’t notice the change until it’s too late. Morbid analogy i know but i feel it illustrates the point exactly.

It also seems that the seamlessness of the transition is directly linked to the level of intensity, like a damn that has to burst. The breaking of the damn if not forced by the film maker, but the emotional pressure, making it feel more natural.

‘The single most important key to making it work is, of course, rooted in the emotion of the moment. The more honest, earned, and believable the emotion of the character, and the more that emotion carries with it the need to expand in some way, the more the transition to singing will seem not merely necessary, but theatrically exciting’

(Haagensen , 2019)

It’s this concept of seamless transitioning of emotional intensity that draws my attention, i would like to find a way to achieve this outside of a musical theatre context. I would like to create a diegetic score, but diegetically link the music through means of material rather than a character’s voice.

Bibliography:

Haagensen , E. (no date) Moving emotionally from speech to song – backstage. Available at: https://www.backstage.com/magazine/article/moving-emotionally-speech-song-32284/ (Accessed: September 15, 2022).

The problem with Tarzan (2019) YouTube. Available at: https://youtu.be/rMJ8FyQiM4Y (Accessed: September 14, 2022).