Change search
ReferencesLink to record
Permanent link

Direct link
From lexical bundles to surprisal: Measuring the idiom principle
Stockholm University, Faculty of Humanities, Department of Linguistics, Computational Linguistics.ORCID iD: 0000-0003-2815-395X
Zurich University.
2014 (English)In: LEXICAL BUNDLES IN ENGLISH NON-FICTION WRITING: FORMS AND FUNCTIONS, 2014Conference paper, Abstract (Refereed)
Abstract [en]

Lexical bundles (LB) testify to Sinclair's idiom principle (SIP), and measure formulaicity, complexity and (non-) creativity (FCN). We exploit the information-theoretic measure of surprisal to analyze these.Frequency as measure of LB has been criticized (McEnery et al, 2006:208–220), instead collocation measures were suggested until Biber (2009:286–290) raised three criticisms. First, MI ranks rare collocations, which often include idioms, highest. We answer that also idioms are formulaic, and there are collocation measures which have a bias towards frequent collocations.Second, MI doesn't respect word order. We thus use directed word transition probabilities like surprisal (Levy and Jaeger 2007):3-gram surprisal =Third, formulaic sequences are often discontinuous. We thus sum over sequences, use 3-grams as atoms, and address syntactic surprisal.We argue that abstracting to surprisal as measure of LB and FCN is appropriate, as it expresses reader expectations and text entropy. We use surprisal to analyse differences between:

  1. spoken and written learner language (L2);
  2. L2 across proficiency levels;
  3. L2 compared with L1

We test Pawley and Syder (1983)'s and Levy and Jaeger (2007)'s hypothesis that native speakers play the tug-of-war between formulaicity and expressiveness best, thus minimizing comprehension difficulty, according to the uniform information density principle.

Place, publisher, year, edition, pages
National Category
General Language Studies and Linguistics
URN: urn:nbn:se:su:diva-109372OAI: diva2:764522
12th ESSE CONFERENCE, SLANG16 workshop
Available from: 2014-11-19 Created: 2014-11-19 Last updated: 2014-11-19

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Grigonyte, Gintare
By organisation
Computational Linguistics
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 128 hits
ReferencesLink to record
Permanent link

Direct link