This comprehensive account of performance-based assessment of L2 lexical proficiency analyzes and compares two of the primary methods of evaluation used in the field and unpacks the ways in which they tap into different dimensions of one model of lexical competence and proficiency.This book builds on the latest research on performance-based assessment, which has most recently pointed to the application of more quantitative measures to L2 data, to systematically explore the qualitative method of using human raters in assessment exercises and the quantitative method of using automatic computation of statistical measures of lexis and phraseology. Supported by an up-to-date review of the existing literature, both approaches’ unique features are highlighted but also compared to one another to provide a holistic overview of performance-based assessment as it stands today at both the theoretical and empirical level. These findings are exemplified in a concluding chapter, which summarizes results from an empirical study looking at a range of lexical and phraseological features and human raters’ scores of over 150 essays written by both L2 learners of English and native speakers. Taken together, the volume challenges existing tendencies within the field which attempt to use one method to validate one another by demonstrating their capacity to indicate very different elements of lexical proficiency, thereby offering a means by which to better conceptualize performance-based assessment of L2 vocabulary in the future.This book will be of interest to students and researchers working in second language acquisition and applied linguistics research, particularly those interested in issues around assessment, vocabulary acquisition, and language proficiency.The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a CC BY NC ND 4.0 license.
Agnieszka Leńko-Szymańska is Assistant Professor at the Institute of Applied Linguistics at the University of Warsaw, Poland.
Table of contentsIntroductionChapter 1: Lexical competence and lexical proficiency1.1. Introduction1.2. Preliminary definitions1.2.1. Communicative competence, language ability and language proficiency1.2.2. Cognitive linguistic models of language1.2.3. Aspects of language proficiency1.3.4. Approaches to the description of lexical competence1.3. Word-centred approaches to the description of lexical competence1.3.1. Components of word knowledge1.3.2. Degrees of word knowledge1.4. Lexicon-centred approaches to the description of lexical competence1.5. Lexical competence vs. lexical proficiency1.6. Lexical competence, lexical proficiency and phraseology1.7. ConclusionChapter 2: Lexical assessment methods2.1. Introduction2.2. Definition and qualities of a language test2.3. Tasks assessing lexical proficiency2.4. Task formats2.4.1. Discrete-point tasks2.4.2. Integrative tasks2.4.3. Communicative tasks2.5. Vocabulary tests2.5.1. Vocabulary testing for educational purposes2.5.2. Vocabulary testing for research purposes2.6. ConclusionChapter 3: Performance-based assessment of lexical proficiency3.1. Introduction3.2. Performance assessment3.3. The process of writing assessment3.3.1. Instrument3.3.2. Raters3.3.3. Scales3.4. Vocabulary in writing assessment scales in education3.4.1. Holistic scales3.4.2. Analytic scales3.5. Analytic scales for the assessment of vocabulary in education3.6. Vocabulary assessment scales for research purposes3.7. Extraneous variables in the assessment process3.7.1. Influence of the tasks3.7.2. Influence of the scales3.7.3. Influence of the raters3.8. ConclusionChapter 4: Statistical measures of lexical proficiency4.1. Introduction4.2. Lexical measures of fluency and measures of lexical productivity4.3. Measures of lexical accuracy4.4. Measures of lexical complexity4.4.1. Lexical diversity (variation)4.4.2. Lexical sophistication4.4.3. Older measures: Lexical density and lexical originality4.4.4. More recent measures: Word psychological properties and semantic relations4.4.5 Phraseological measures4.5. ConclusionChapter 5: Statistical measures and raters' scores of L2 production – review of literature5.1. Introduction5.2. Lexical measures for discriminating between different proficiency levels5.3. Lexical measures vs. raters’ scores5.3.1. Correlational studies5.3.2. Regression studies5.3.3. Analytic scores of lexical proficiency5.4. ConclusionChapter 6: The study – measuring and assessing lexical proficiency of advanced learners6.1. Introduction6.2. Research questions6.3. Subjects and instruments6.3.1. Essays6.3.2. Vocabulary tests6.4. Data6.4.1. Lexical indices6.4.2. Raters’ grades6.4.3. Vocabulary test scores6.4.4. Interviews6.5. Data analysis6.5.1. Analysis 1 – relationships between the indices6.5.2. Analysis 2 – comparison of the indices between the groups6.5.3. Analysis 3 – prediction of group membership based on selected indices6.5.4. Analyses 4 and 5 – relationships between the raters’ grades and their comparison between the groups6.5.5. Analysis 6 – relationships between the raters’ grades and the indices6.5.6. Analysis 7 – prediction of the raters’ grades based on selected indices6.5.7. Analysis 8 and 9 – comparison of vocabulary scores and their relationships with the indices and the raters’ grades6.5.8. Analysis 10 – interviews6.6. Discussion and conclusionConclusions7.1. Human scores vs. statistical lexical and phraseological indices – reappraisal7.2. An extended model of lexical competence and lexical proficiency for assessment purposesAcknowledgementsReferences