Emotional reponses to music: The influence of lyrics

The ability to recognise basic emotions in music, such as happiness and sadness, is a universal skill that does not always depend on previous exposure to the musical style (Fritz et al. 2009). There is growing recognition of the variety of emotional states that music can express (Zentner et al – see my previous blog on complex musical emotions) and the speed at which we can correctly identify these states (as quick as 500ms!)

We know that the structures within music help to communicate happiness and sadness:

Sad music = soft dynamics, legato articulation, soft tempo and minor mode

Happy music = staccato articulation, louder intensities and major mode

A new article seeks to tackle the next logical question for music emotion studies – is there an additional influence of lyrics?

Bob Dylan

Most studies that present music in order to measure resulting perceptual, cognitive or affective responses stick to using instrumental works. The main justification for doing this is to avoid any confounding influences of activating the language system. This is a completely reasonable argument if your aim is to isolate the cognitive or neural processing of music. But it leaves us unable to draw conclusions about a large proportion of the world’s music – vocal music (e.g. pop, rock and folk music).

A new study by Elvira Brattico and her colleagues in Finland and Germany has looked at fMRI brain activation when people listen to happy and sad music with and without lyrics. They opted to move on from the typical use of western classical music and to use a range of music genres and timbres, as selected by 15 participants who had a wide range of musical training.

Participants selected 16 eighteen second excerpts of music: 4 sad and 4 happy that they liked and that they didn’t like.  They listened to them while in a 3T fMRI scanner and rated them again for liking and emotion (happy or sad?)

RESULTS

1) Acoustic analysis: The authors analysed low level acoustic features of the music itself to determine if there were any patters that marked a piece as happy or sad. They focused on the attack slope and the spectral centroid (i.e. timbre, brightness) as well as tempo and mode. They found:

Happy music with lyrics: Faster attack than happy music without lyrics and all sad music. It also had the brightest timbres compared to all other categories.

Happy music: Brighter timbres and faster tempos compared to sad music. It was also more frequently in the major mode.

Music with lyrics: Brighter timbres than music without lyrics.

2) fMRI analysis

Sad music with lyrics: Unique activation in several brain areas that were not active when lyrics were absent, including parahippocampal gyrus, amgydala, medial and inferior frontal gyri (including Broca’s area) and the auditory cortex  

Happy music with lyrics: Auditory regions alone

Happy music without lyrics: Limbic system and inferior frontal gyrus

CONCLUSION

There were few acoustic differences between music with and without lyrics. There were far larger acoustic differences between happy and sad music. The authors concluded that any differential affects driven by the presence of lyrics in the scanner would be as a result of the semantic impact of the words rather than their acoustic features.

  • Lyrics are crucial for defining sadness in music. The presence of lyrics in sad music was associated with brain activations that have previously been reported in response to music chills (see previous blog), judgments of beauty, demanding speech tasks and the human “mirror neuron” system.
  • By comparison, acoustic features are key to defining happiness in music. Instrumental happy music triggered more strong activations in the emotion-related limbic regions, in comparison to lyrical music.

Happy music was also associated with more left hemisphere activity, whether or not it contained lyrics. The authors explain this finding as being due to the acoustic features of happy music, including the faster attack and brighter timbres. There is growing evidence to support the theory (Zatorre et al. 2002) that the left hemisphere is not so much language dominant but dominant for sounds that contain fast specto-temporal transitions (including language but also happy music)

There were many other specific findings within the paper but that summary gives you a flavour of the major results and their interpretations. Overall, the paper gives insight into the effects of lyrics on the neural processing of human emotion in a range of musical styles and opens the door for a greater understanding of the potential effect of song, not just instrumental music, on our minds.

Pitch black: Music without vision

This week I had a musical experience that I must share with you, dear reader. To make things even more interesting the event in question led me to spend some of my spare time this week investigating an area of music psychology about which I knew almost nothing – what is it like to listen to music when you are blind?

A few weeks ago I had a very kind invitation from the Southbank Centre in London to attend a night at the London Jazz Festival called ‘Phronesis: Pitch Black’.The event was to feature the talents of London-based jazz trio Phronesis, which comprises Copenhagan-born Jasper Høiby on bass, Ivo Neame on piano and Anton Eger on drums.

 

 

 

 

 

 

If you would like a little musical taste of this fantastic band and to hear a little about their stories then they have a handy introduction Youtube video.

The ‘Pitch Black’ project was inspired by Jasper’s sister, who lost her sight to severe cataracts five years ago.  Jasper told me that his experience and admiration for his sister lead him to consider the real importance of senses in the musical experience and how drastically different music listening music be in the absence of vision. The aim of playing in the dark was to inspire a closer communication between the band members and between them and their audience. He was interested to discover how a lack of visual information would influence people’s experience of the band’s music and how it would inspire the band’s improvisation interactions in turn.

My tickets!

I was invited along to be part of the post-show panel and to comment on music perception in the absence of vision. I agreed immediately! It was a chance to experience a new musical event with fascinating possibilities and an excuse to dive into the literature for new ideas on music perception.  A perfect storm of temptation for me!

 

Findings in this area focus mainly on the difference in auditory skills between sighted and blind individuals. To summarise, the majority of papers in this area have reported that blind people have greater expertise in auditory tasks, including;

1)      Pitch discrimination (ability to perceive small changes to notes)
2)      Spatial localisation
3)      Verbal memory
4)      Speech perception, including hearing speech in noise
5)      Tasks that combine hearing and touching (such as Braille reading)

An excellent summary of the background findings is provided in a paper by Rokem and Ahissar (2009)

Another interesting finding is that blind individuals show greater amygdala activation in response to emotional auditory stimuli compared to sighted people. The amygdala is part of the brain’s limbic system and is strongly associated with the processing of emotion. The theory goes that the amygdale has a natural ‘allegiance’ to visual information, which quickly and more effectively signals emotional intent than sound (such as in emotional faces). When visual information is not available the amygdala switches its allegiance to interpreting auditory information.

This alliance between auditory information and the emotion centres of the brain is primary and therefore more automatic in blind individuals.  Even in sighted people however there is evidence that this relationship between visual and auditory emotional input is in place; sighted individuals experience greater amygdala activation to emotional music when their eyes are closed compared to when they are open (Lerner et al, 2010).

Blind individuals can also sometimes show activity in their visual cortex in response to auditory tasks, including during spatial location tasks (Gougoux et al, 2005) and emotion identification in voices (Klinge, Roder & Buchel, 2010), and there is a relationship between the amount of activation and the length of time someone has been blind. In the words of Robert Zatorre this demonstrates:

“ ..that there is plasticity in the brain. That is, [especially] when we are young we can actually change the way the neurons work, and reorganize brain function to suit our survival needs”

It is impossible to understand the experience of listening to music as a blind person by simply closing your eyes if you are sighted. The brain adapts, learns and grows over the period of time that it is without visual input so that an individual who has been blind for some time activates quite different brain areas when listening to music compared to a sighted person. We know from the behavioural tasks I listed above that this can sometimes, but not always, result in superior auditory skills.

So now the big question: what was it like to listen to 50 minutes of melodic contemporary jazz in the pitch black? It was truly amazing. The lights went down slowly over 7 minutes and at first you could sense the tension in the room. There is a natural apprehension that goes with knowing you are in a room full of strangers that you can’t see! But then once everyone relaxed, this was much easier with eyes closed in my case, the music took over the space. I could no longer locate the exact source of the sound but this soon ceased to matter. My listening became much more global as opposed to local – I wasn’t listening to any one instrument anymore but to the blend. Expectation based on the performers movements was also removed which resulted in some lovely musical surprises and quite a few moments of chills.

The interaction with the performers was, of course, more limited. As one audience member said ‘when the lights came on I suddenly realised that I had missed them’.  So I would not claim that the experience of listening to music in the dark was ‘better’ – just different. Exciting but at the same time very relaxing: A special feeling. And quite simply the best live jazz I have ever heard.

Thank you to the Southbank Centre and of course to Phronesis. I hope to see you guys again very soon.

You can read an interview with Jasper about the gig here.