Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Effects of visual load on auditory processing
Stockholm University, Faculty of Social Sciences, Department of Psychology, Perception and psychophysics.ORCID iD: 0000-0002-5807-6855
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

In daily life, people need to be able to focus on a task while ignoring any task-irrelevant background noise. For example, people who work in an open-space office may have to work on a report while ignoring the background talk among co-workers. Theories of attention argue that processing of task-irrelevant auditory information should become attenuated when attentional capacity is exhausted by task-relevant stimuli, for example a visual task. According to early-filter theory, top-down attenuation of auditory responses is possible at various stages of the auditory pathway through multiple recurrent loops. Furthermore, the adaptive filtering model of selective attention suggests that filtering occurs early when concurrent visual tasks are demanding (e.g., high load) and late when tasks are easy (e.g., low load).

The main aim of this thesis was to investigate whether auditory processing is attenuated during concurrent visual load manipulation, and if so, at which stage of the auditory pathway. Recurrent loops that are present throughout the entire auditory pathway should allow top-down modulation of even earliest responses, especially when accompanied by a highly demanding task. Recording these auditory responses during concurrent visual tasks with different levels of load could potentially show at which stages of auditory processing the filtering happens when the task demands are high or low, or there is no task at all.

This thesis tested the effects of visual load manipulation on the responses originating from different stages of the auditory pathway: mismatch negativity (MMN) to duration in Study I, MMN to frequency in Study III, auditory steady-state responses (ASSRs) to a 40-Hz modulation frequency in Study IV, and ASSRs to 20-, 40-, and 80-Hz modulation frequencies in Study V. Additionally, Study II compared different control conditions (cascade vs. no-repetition control) for evoking MMN to find a design that reduces confounds in the MMN. Results of Study II showed that cascade and no-repetition control are comparable control conditions for evoking MMN.

For the effects of visual load manipulation on auditory MMN (low vs. high load), results showed moderate evidence for the effect of load on duration MMN and moderate evidence for no effect of load on frequency MMN. However, results for the duration MMN might be confounded by physical differences between the low load and high load conditions in the visual task, and by a biased oddball paradigm used to evoke the MMN. Thus, it is most likely that auditory MMN is not affected by visual load (low vs. high).

For the effects of visual load on ASSRs (no, low, and high load), results showed moderate to strong evidence for no effects of load manipulation on ASSRs, but some comparisons were inconclusive. The convincing evidence obtained in Studies IV and V points to the robustness of ASSRs against visual load manipulation.

Because it is most likely that neither MMN nor ASSRs are affected by visual load manipulation, results presented in this thesis support the idea that attentional resources are modality specific. Because it is possible that filtering occurs at one stage of auditory processing and does not change with the concurrent task demands, the present results do not rule out the early-filter theory. However, results are inconsistent with the adaptive filtering model because filtering of task-irrelevant responses does not vary with the demands of the concurrent task.

Place, publisher, year, edition, pages
Stockholm: Department of Psychology, Stockholm University , 2020. , p. 98
Keywords [en]
EEG, event-related potential, mismatch negativity, auditory steady-state response, envelope following response, perceptual load, visual load, task difficulty, crossmodal attention, early-filter theory, adaptive filtering model
National Category
Psychology
Research subject
Psychology
Identifiers
URN: urn:nbn:se:su:diva-184774ISBN: 978-91-7911-246-2 (print)ISBN: 978-91-7911-247-9 (electronic)OAI: oai:DiVA.org:su-184774DiVA, id: diva2:1464162
Public defence
2020-10-21, U16, Frescati Hagväg 8 and digitally via Zoom: https://stockholmuniversity.zoom.us/j/65525307332, Stockholm, 13:00 (English)
Opponent
Supervisors
Available from: 2020-09-28 Created: 2020-09-04 Last updated: 2022-02-25Bibliographically approved
List of papers
1. Effects of sound pressure level and visual perceptual load on the auditory mismatch negativity
Open this publication in new window or tab >>Effects of sound pressure level and visual perceptual load on the auditory mismatch negativity
2017 (English)In: Neuroscience Letters, ISSN 0304-3940, E-ISSN 1872-7972, Vol. 640, p. 37-41Article in journal (Refereed) Published
Abstract [en]

Auditory change detection has been studied extensively with mismatch negativity (MMN), an event-related potential. Because it is unresolved if the duration MMN depends on sound pressure level (SPL), we studied effects of different SPLs (56, 66, and 76 dB) on the duration MMN. Further, previous research suggests that the MMN is reduced by a concurrent visual task. Because a recent behavioral study found that high visual perceptual load strongly reduced detection sensitivity to irrelevant sounds, we studied if the duration MMN is reduced by load, and if this reduction is stronger at low SPLs. Although a duration MMN was observed for all SPLs, the MMN was apparently not moderated strongly by SPL, perceptual load, or their interaction, because all 95% CIs overlapped zero. In a contrast analysis of the MMN (across loads) between the 56-dB and 76-dB groups, evidence (BF = 0.31) favored the null hypothesis that duration MMN is unaffected by a 20-dB increase in SPL. Similarly, evidence (BF = 0.19) favored the null hypothesis that effects of perceptual load on the duration MMN do not change with a 20-dB increase in SPL. However, evidence (BF = 3.12) favored the alternative hypothesis that the effect of perceptual load in the present study resembled the overall effect in a recent meta-analysis. When the present findings were combined with the meta-analysis, the effect of load (low minus high) was −0.43 μV, 95% CI [−0.64, −0.22] suggesting that the duration MMN decreases with load. These findings provide support for a sensitive monitoring system of the auditory environment.

Keywords
event-related potential, mismatch negativity, perceptual load, sound pressure level
National Category
Applied Psychology
Research subject
Psychology
Identifiers
urn:nbn:se:su:diva-138257 (URN)10.1016/j.neulet.2017.01.001 (DOI)000394396300006 ()
Available from: 2017-01-18 Created: 2017-01-18 Last updated: 2022-03-23Bibliographically approved
2. Cascade and no-repetition rules are comparable controls for the auditory frequency mismatch negativity in oddball tasks
Open this publication in new window or tab >>Cascade and no-repetition rules are comparable controls for the auditory frequency mismatch negativity in oddball tasks
2019 (English)In: Psychophysiology, ISSN 0048-5772, E-ISSN 1469-8986, Vol. 56, no 1, article id e13280Article in journal (Refereed) Published
Abstract [en]

The mismatch negativity (MMN) has been widely studied with oddball tasks to index processing of unexpected auditory change. The MMN is computed as the difference of deviant minus standard and is used to capture the pattern violation by the deviant. However, this oddball MMN is confounded because the deviant differs physically from the standard and is presented less often. To improve measurement, the same tone as the deviant is presented in a separate condition. This control tone is equiprobable with other tones and is used to compute a corrected MMN (deviant minus control). Typically, the tones are in random order except that consecutive tones are not identical (no-repetition rule). In contrast, a recent study on frequency MMN presented tones in a regular up-and-down sequence (cascade rule). If the cascade rule is detected more easily than the no-repetition rule, there should be a lower risk of a confounding MMN within the cascade condition. However, in previous research, the cascade and no-repetition conditions differed not only in the regularity of the tone sequence but also in number of tones, frequency range, and proportion of tones. We controlled for these differences to isolate effects of regularity in the tone sequence. Results of our preregistered analyses provided moderate evidence (BF01>6) that the corrected MMN did not differ between cascade and no-repetition conditions. These findings imply that no-repetition and cascade rules are processed similarly and that the no-repetition condition provides an adequate control in frequency MMN.

Keywords
cascade, mismatch negativity, N1, neural adaptation, no-repetition, oddball
National Category
Psychology Neurosciences
Research subject
Psychology
Identifiers
urn:nbn:se:su:diva-163511 (URN)10.1111/psyp.13280 (DOI)000453565300009 ()30246255 (PubMedID)
Available from: 2019-01-07 Created: 2019-01-07 Last updated: 2022-03-23Bibliographically approved
3. Visual Perceptual Load Does Not Affect the Frequency Mismatch Negativity
Open this publication in new window or tab >>Visual Perceptual Load Does Not Affect the Frequency Mismatch Negativity
2019 (English)In: Frontiers in Psychology, E-ISSN 1664-1078, Vol. 10, article id 1970Article in journal (Refereed) Published
Abstract [en]

The mismatch negativity (MMN) has been of particular interest in auditory perception because of its sensitivity to auditory change. It is typically measured in an oddball task and is computed as the difference of deviant minus standard tones. Previous studies suggest that the oddball MMN can be reduced by crossmodal attention to a concurrent, difficult visual task. However, more recent studies did not replicate this effect. Because previous findings seem to be biased, we preregistered the present study and used Bayesian hypothesis testing to measure the strength of evidence for or against an effect of visual task difficulty. We manipulated visual perceptual load (high and low load). In the task, the visual stimuli were identical for both loads to avoid confounding effects from physical differences of the visual stimuli. We also measured the corrected MMN because the oddball MMN may be confounded by physical differences between deviant and standard tones. The corrected MMN is obtained with a separate control condition in which the same tone as the deviant (critical tone) is equiprobable with other tones. The corrected MMN is computed as deviant minus critical tones. Furthermore, we assessed working memory capacity to examine its moderating role. In our large sample (N = 49), the evidential strength in support of no effect of visual load was moderate for the oddball MMN (9.09 > BF01 > 3.57) and anecdotal to moderate for the corrected MMN (4.55 > BF01 > 2.17). Also, working memory capacity did not correlate with the visual load effect on the oddball MMN and the corrected MMN. The present findings support the robustness of the auditory frequency MMN to manipulations of crossmodal, visual attention and suggest that this relationship is not moderated by working memory capacity.

Keywords
mismatch negativity, perceptual load, crossmodal attention, oddball, working memory capacity, N1
National Category
Psychology
Research subject
Psychology
Identifiers
urn:nbn:se:su:diva-173107 (URN)10.3389/fpsyg.2019.01970 (DOI)000482842400004 ()31507504 (PubMedID)
Available from: 2019-10-04 Created: 2019-10-04 Last updated: 2022-03-23Bibliographically approved
4. Visual load does not decrease the auditory steady‐state response to 40‐Hz amplitude‐modulated tones
Open this publication in new window or tab >>Visual load does not decrease the auditory steady‐state response to 40‐Hz amplitude‐modulated tones
2020 (English)In: Psychophysiology, ISSN 0048-5772, E-ISSN 1469-8986, Vol. 57, no 12, article id e13689Article in journal (Refereed) Published
Abstract [en]

The auditory pathway consists of multiple recurrent loops of afferent and efferent connections that extend from the cochlea up to the prefrontal cortex. The early-filter theory proposes that these loops allow topdown filtering of early and middle latency auditory responses. Furthermore, the adaptive filtering model suggests that filtering of irrelevant auditory stimuli should start lower in the pathway during more demanding tasks. If so, the 40-Hz auditory steady state responses (ASSRs) to irrelevant sounds should be affected by top-down crossmodal attention to a visual task, and effects should vary with the load of the visual task. Because few studies have examined this possibility, we conducted two preregistered studies that manipulated visual load (Study 1: N = 43, Study 2: N = 45). Study 1 used two levels (low and high), and Study 2 used four levels (no, low, high, and very high). Subjects were asked to ignore a 500-Hz taskirrelevant tone that was amplitude-modulated to evoke 40-Hz ASSRs. Results from Bayesian analyses provided moderate to extreme support for no effect of load (or of task) on ASSRs. Results also supported no interaction with time (i.e., over blocks, over minutes, or with changes in ASSRs that were synchronized with the onset of the visual stimuli). Further, results provided moderate support for no correlation between effects of load and working memory capacity. Because the present findings support the robustness of ASSRs against manipulations of crossmodal attention, they are not consistent with the adaptive filtering model.

Keywords
crossmodal attention, EEG, early-filter theory, task difficulty, envelope following response
National Category
Applied Psychology Psychology
Research subject
Psychology
Identifiers
urn:nbn:se:su:diva-184769 (URN)10.1111/psyp.13689 (DOI)000570168400001 ()
Funder
Swedish Research Council, 2015-01181
Available from: 2020-09-04 Created: 2020-09-04 Last updated: 2022-02-25Bibliographically approved
5. Visual load effects on the auditory steady state responses to 20-, 40-, and 80-Hz amplitude-modulated tones
Open this publication in new window or tab >>Visual load effects on the auditory steady state responses to 20-, 40-, and 80-Hz amplitude-modulated tones
2021 (English)In: Physiology & Behavior, ISSN 0031-9384, Vol. 228, article id 113240Article in journal (Refereed) Published
Abstract [en]

Ignoring background sounds while focusing on a visual task is a necessary ability in everyday life. If attentional resources are shared between modalities, processing of task-irrelevant auditory information should become attenuated when attentional capacity is exhausted by visual demands. According to earlyfilter theory, top-down attenuation of auditory responses is possible at various stages of the auditory pathway through multiple recurrent loops. Furthermore, the adaptive filtering model of selective attention suggests that filtering occurs early when concurrent visual tasks are demanding (e.g., high load) and late when tasks are easy (e.g., low load). This study examined effects of visual load on auditory steady state responses (ASSRs) to determine where in the auditory pathway the filtering occurs. Subjects performed a visual task with three levels of load (no, low, and high) while ignoring task-irrelevant sounds. The auditory stimuli were 500-Hz tones amplitude-modulated at 20 Hz, 40 Hz, or 80 Hz to target different processing stages of the auditory pathway. Results from bayesian analyses suggest that ASSRs are unaffected by visual load. These findings also suggest that attentional resources are modality specific and that the attentional filter of auditory processing does not vary with visual task demands.

Keywords
crossmodal attention, auditory steady state responses, early-filter model, visual load, task difficulty, amplitude-modulated tone
National Category
Applied Psychology Psychology
Research subject
Psychology
Identifiers
urn:nbn:se:su:diva-184770 (URN)10.1016/j.physbeh.2020.113240 (DOI)000596850000026 ()33188789 (PubMedID)
Funder
Swedish Research Council, 2015-01181
Available from: 2020-09-04 Created: 2020-09-04 Last updated: 2022-02-25Bibliographically approved

Open Access in DiVA

Effects of visual load on auditory processing(4151 kB)691 downloads
File information
File name FULLTEXT01.pdfFile size 4151 kBChecksum SHA-512
40c7c56afe6fc3b912df387a9a19132f0d3515ff504e9a2bd82c32df28552d998d59efa955ae856b4978af07e18c4f64856346a5f25a74c520e810438d458ea1
Type fulltextMimetype application/pdf

Authority records

Szychowska, Malina

Search in DiVA

By author/editor
Szychowska, Malina
By organisation
Perception and psychophysics
Psychology

Search outside of DiVA

GoogleGoogle Scholar
Total: 692 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1167 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf