Rating EFL written performance / / Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker.
Saved in:
Superior document: | Versita Discipline: Language, Literature |
---|---|
VerfasserIn: | |
TeilnehmendeR: | |
Place / Publishing House: | London, England : : Versita, Versita Limited,, 2013. 2013 |
Year of Publication: | 2013 |
Edition: | 1st ed. |
Language: | English |
Series: | Versita discipline. Language, literature.
|
Physical Description: | 1 online resource (424 pages). |
Notes: | Bibliographic Level Mode of Issuance: Monograph |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
993603419804498 |
---|---|
ctrlnum |
(CKB)3390000000062054 (SSID)ssj0001540268 (PQKBManifestationID)11914079 (PQKBTitleCode)TC0001540268 (PQKBWorkID)11536856 (PQKB)10795566 (MiAaPQ)EBC4002169 (Au-PeEL)EBL4002169 (CaPaEBR)ebr11055002 (OCoLC)947127904 (EXLCZ)993390000000062054 |
collection |
bib_alma |
record_format |
marc |
spelling |
Bukta, Katalin, author. Rating EFL written performance / Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker. 1st ed. London, England : Versita, Versita Limited, 2013. 2013 1 online resource (424 pages). text txt computer c online resource cr Versita Discipline: Language, Literature Bibliographic Level Mode of Issuance: Monograph English Description based on online resource; title from PDF title page (ebrary, viewed May 31, 2015). Includes bibliographical references and index. Intro -- Introduction -- Overview of the Book -- PART I -- An Overview of the Literature on L2 Writing and Assessment -- Chapter 1 -- Writing Ability and L2 Writing Instruction -- Introduction -- 1.1 The Writing Skill in L1 and L2 -- 1.1.1 Theoretical Models of Written Text Production -- 1.1.2 Theoretical Frameworks of Communicative Competence -- 1.2 Writing Ability in L1 -- 1.3 Writing Ability in L2 -- 1.3.1 The Relationship Between L1 and L2 Writing Ability -- 1.3.2 Skilled and Unskilled L2 Writers -- 1.4 L2 Writing Instruction -- 1.4.1 Controlled Composition Approach to Writing -- 1.4.2 Process-Oriented Approach to Writing -- 1.4.3 The Role of Writing in Communicative Language Teaching -- 1.5 Conclusion -- Chapter 2 -- Assessing Language Ability -- Introduction -- 2.1 Assessing Language Ability -- 2.1.1 History of Language Testing -- 2.1.2 Recent Developments in Language Testing Research -- 2.2 L2 Ability Assessment -- 2.2.1 Language Ability and Language Performance -- 2.2.2 Characteristics of Performance Assessment -- 2.3 Test Features -- 2.3.1 Test Purpose -- 2.3.2 Testing Methods -- 2.4 Qualities of Language Tests -- 2.4.1 Reliability -- 2.4.2 Validity -- 2.4.3 Authenticity -- 2.4.4 Impact -- 2.4.5 Washback -- 2.4.6 Practicality -- 2.5 Test Method Characteristics -- 2.6 Assessing the Four Language Skills -- 2.7 Scoring Methods -- 2.7.1 Characteristics of Rating Scales -- 2.7.2 Rater Variables -- 2.7.3 Score Interpretation -- 2.8 Test-Taker Characteristics -- 2.9 Language Test Construction -- 2.10 Conclusion -- Chapter 3 -- Assessing Writing Ability -- Introduction -- 3.1 Written Performance Assessment -- 3.2 Alternative Ways of Writing Ability Assessment -- 3.3 Nature of Written Performance Assessment -- 3.3.1 Validity of Writing Assessment -- 3.3.2 Task Characteristics -- 3.3.3 Definition of Audience -- 3.3.4 Test Taker Characteristics. 3.4 Conclusion -- Chapter 4 -- Rating Written Performance -- Introduction -- 4.1 Scoring Procedures -- 4.2 Rater Variables -- 4.3 Rating as a Problem-Solving Activity -- 4.4 Frameworks of Scoring Processes -- 4.4.1 Milanovic, Saville and Shuhong's Framework of the Scoring Process -- 4.4.2 Wolfe's Framework of the Scoring Process -- 4.4.3 Lumley's Framework of the Scoring Process -- 4.4.4 Cumming, Kantor and Powers' Framework of the Scoring Process -- 4.5 Rater Stability -- 4.6 Rater Training -- 4.7 Conclusion -- Chapter 5 -- Verbal Protocol Analysis as a Research Method in Written Performance Assessment -- Introduction -- 5.1 Research in L2 Acquisition Studies -- 5.2 Introspective Reports as Data Collection -- 5.3 Categorisation of Verbal Protocols -- 5.4 Concurrent Think-Aloud Protocols in Written Performance Assessment -- 5.5 Verbal Protocol Analysis Procedure -- 5.5.1 Data Preparation and Collection Procedures -- 5.5.2 Verbal Report Procedure Preparation -- 5.5.3 Data Transcription -- 5.5.4 Segmenting the Protocols for Coding -- 5.5.5 Developing a Coding Scheme -- 5.5.6 Analysis of the Coded Data -- 5.6 Advantages and Limitations of Verbal Protocol Analysis as Research Methodology -- 5.7 Conclusion -- PART II -- Investigating Raters' Decision-Making Processes and Awarded Scores in Rating Hungarian Efl Learners' Compositions -- Chapter 6 -- A Pilot Study: Tracing Raters' Decision-Making Processes -- Introduction -- 6.1 Background to the Pilot Study on Assessment of Written Performance -- 6.2 Research Questions -- 6.3 Research Design -- 6.3.1 Participants: the Raters -- 6.3.2 Procedures for Data Collection -- 6.3.3 Test of Written Performance: the Task -- 6.3.4 The Assessment Scale -- 6.3.5 The Coding Scheme -- 6.4 Results and Discussion -- 6.4.1 Distribution of Comments During Rating -- 6.4.2 Comments on Rating Technicalities. 6.4.3 General Comments on the Scripts -- 6.4.4 The Way Raters Arrived at a Score -- 6.4.5 Assessment of the Communicative Goal -- 6.4.6 Assessment of Vocabulary -- 6.4.7 Assessment of accuracy and spelling -- 6.4.8 Assessment of the Text Organisation -- 6.5 The Rating Process -- 6.6 Conclusion -- Chapter 7 -- The Main Study: Processes and Outcomes in Rating L2 English Written Performance in a Pre-Service Tefl Course -- Introduction -- 7.1 Background to Main Study -- 7.2 Design of the Study -- 7.3 Research Questions -- 7.4 Participants -- 7.5 Data Collection Instruments -- 7.5.1 The Scripts -- 7.5.2 The Rating Scale -- 7.5.3 The Rating Task Assignment Package -- 7.6 Data Collection Procedures -- 7.6.1 Script Characteristics -- 7.6.2 Script Selection -- 7.6.3 Training Raters -- 7.6.4 The Rating Task -- 7.7 Processing Verbal Data -- 7.7.1 Transcript Segmentation -- 7.7.2 Coding Scheme Production -- 7.8 Rater Characteristics: Grouping Raters -- 7.9 Summary -- Chapter 8 -- Features of Raters' Rating Patterns -- Introduction -- 8.1 Raters' Gender Distribution -- 8.2 Language of the Verbal Protocols -- 8.3 Sequencing the Scripts for Rating -- 8.4 Length of Verbal Protocols -- 8.5 Raters' Rating Sequences -- 8.6 Raters' Rating Patterns -- 8.7 Conclusion -- Chapter 9 -- Raters' Rating Focus -- Introduction -- 9.1 Raters' Rating Foci -- 9.1.1 Management Focus: Management Strategies -- 9.1.2 Rating Focus: Rating Strategies -- 9.1.3 Reading Focus: Reading Strategies -- 9.1.4 Raters' Own Focus: Other Comments -- 9.2 Conclusion -- Chapter 10 -- Raters' Focus on the Four Rating Criteria -- Introduction -- 10.1 Raters' Focus on the Four Rating Criteria -- 10.2 Raters' Focus When Rating Task Achievement -- 10.3 Raters' Focus When Rating Vocabulary -- 10.4 Raters' Focus When Rating Grammar -- 10.5 Raters' Focus When Rating Organisation -- 10.6 Conclusion -- Chapter 11. Raters' Script Interpretation on the Weakest and Top Script -- Introduction -- 11.1 Rating Script N2: Benchmarks and Total Scores -- 11.1.1 Comments on Script N2 in the Pre-Scoring Stage -- 11.1.2 Rating Task Achievement of Script N2 -- 11.1.3 Rating Vocabulary of Script N2 -- 1.1.4 Rating Grammar of Script N2 -- 11.1.5 Rating Organisation of Script N2 -- 11.2 Ratings of Script N6: Benchmarks and Total Scores -- 11.2.1 Comments on Script N6 in the Pre-Scoring Stage -- 11.2.2 Rating Task Achievement of Script N6 -- 11.2.4 Rating Grammar of Script N6 -- 11.2.5 Rating Organisation of Script N6 -- 11.3 Conclusion -- Chapter 12 -- Raters' Perception of the Rating Task and Thinking Aloud -- Introduction -- 12.1 The Feedback Sheet -- 12.1.1 Raters' Feedback on the Language-Testing Course -- 12.1.2 Raters' Feedback on Training for Rating Written Performance -- 12.1.3 Raters' Feedback on the Rating Task -- 12.2 Conclusion -- General Conclusions -- Introduction -- Background to Written Performance Assessment -- Features of Rating Processes -- Raters' Rating Foci -- Interpretation of the Rating Criteria -- Raters' Script Interpretation -- Raters' Perceptions of the Rating Task -- Placing Empirical Findings on the Rating Processes into Theoretical Frameworks -- Verbal Protocol Analysis as Data Collection Method -- Implications of the Findings -- Limitations of the Study -- Further Research -- References -- Appendices -- Appendix 6.1 The letter writing task in the pilot study -- Appendix 6.2 The rating scale in the pilot study -- Appendix 6.3 The coding scheme for the pilot study -- Appendix 6.4 Number of utterances made during the rating process in the pilot study -- Appendix 6.5 A sample from EngR1 transcript in the pilot study (translated from Hungarian) -- Appendix 7.1 The writing task in the main study -- Appendix 7.2 The rating scale in the main study. Appendix 7.3 The letter to the students in the main study -- Appendix 7.4 The ten scripts in the main study -- Appendix 7.5 The score sheet in the main study -- Appendix 7.6 The feedback sheet in the main study -- Appendix 7.7 The course description for the elective seminar course in Testing in ELT -- Appendix 7.8 A sample verbal protocol transcript in the main study -- Appendix 7.9 The coding scheme in the main study -- Appendix 7.10 A sample of a coded protocol in the main study -- Appendix 7.11 Competent raters' total scores and rankings of the ten scripts in parentheses in the main study -- Appendix 7.12 Proficient raters' total scores and rankings in parentheses in the main study -- Index. English language Study and teaching Foreign speakers. 83-7656-078-6 Borowska, Anna, editor. Becker, Carl, editor. Versita discipline. Language, literature. |
language |
English |
format |
eBook |
author |
Bukta, Katalin, |
spellingShingle |
Bukta, Katalin, Rating EFL written performance / Versita Discipline: Language, Literature Intro -- Introduction -- Overview of the Book -- PART I -- An Overview of the Literature on L2 Writing and Assessment -- Chapter 1 -- Writing Ability and L2 Writing Instruction -- Introduction -- 1.1 The Writing Skill in L1 and L2 -- 1.1.1 Theoretical Models of Written Text Production -- 1.1.2 Theoretical Frameworks of Communicative Competence -- 1.2 Writing Ability in L1 -- 1.3 Writing Ability in L2 -- 1.3.1 The Relationship Between L1 and L2 Writing Ability -- 1.3.2 Skilled and Unskilled L2 Writers -- 1.4 L2 Writing Instruction -- 1.4.1 Controlled Composition Approach to Writing -- 1.4.2 Process-Oriented Approach to Writing -- 1.4.3 The Role of Writing in Communicative Language Teaching -- 1.5 Conclusion -- Chapter 2 -- Assessing Language Ability -- Introduction -- 2.1 Assessing Language Ability -- 2.1.1 History of Language Testing -- 2.1.2 Recent Developments in Language Testing Research -- 2.2 L2 Ability Assessment -- 2.2.1 Language Ability and Language Performance -- 2.2.2 Characteristics of Performance Assessment -- 2.3 Test Features -- 2.3.1 Test Purpose -- 2.3.2 Testing Methods -- 2.4 Qualities of Language Tests -- 2.4.1 Reliability -- 2.4.2 Validity -- 2.4.3 Authenticity -- 2.4.4 Impact -- 2.4.5 Washback -- 2.4.6 Practicality -- 2.5 Test Method Characteristics -- 2.6 Assessing the Four Language Skills -- 2.7 Scoring Methods -- 2.7.1 Characteristics of Rating Scales -- 2.7.2 Rater Variables -- 2.7.3 Score Interpretation -- 2.8 Test-Taker Characteristics -- 2.9 Language Test Construction -- 2.10 Conclusion -- Chapter 3 -- Assessing Writing Ability -- Introduction -- 3.1 Written Performance Assessment -- 3.2 Alternative Ways of Writing Ability Assessment -- 3.3 Nature of Written Performance Assessment -- 3.3.1 Validity of Writing Assessment -- 3.3.2 Task Characteristics -- 3.3.3 Definition of Audience -- 3.3.4 Test Taker Characteristics. 3.4 Conclusion -- Chapter 4 -- Rating Written Performance -- Introduction -- 4.1 Scoring Procedures -- 4.2 Rater Variables -- 4.3 Rating as a Problem-Solving Activity -- 4.4 Frameworks of Scoring Processes -- 4.4.1 Milanovic, Saville and Shuhong's Framework of the Scoring Process -- 4.4.2 Wolfe's Framework of the Scoring Process -- 4.4.3 Lumley's Framework of the Scoring Process -- 4.4.4 Cumming, Kantor and Powers' Framework of the Scoring Process -- 4.5 Rater Stability -- 4.6 Rater Training -- 4.7 Conclusion -- Chapter 5 -- Verbal Protocol Analysis as a Research Method in Written Performance Assessment -- Introduction -- 5.1 Research in L2 Acquisition Studies -- 5.2 Introspective Reports as Data Collection -- 5.3 Categorisation of Verbal Protocols -- 5.4 Concurrent Think-Aloud Protocols in Written Performance Assessment -- 5.5 Verbal Protocol Analysis Procedure -- 5.5.1 Data Preparation and Collection Procedures -- 5.5.2 Verbal Report Procedure Preparation -- 5.5.3 Data Transcription -- 5.5.4 Segmenting the Protocols for Coding -- 5.5.5 Developing a Coding Scheme -- 5.5.6 Analysis of the Coded Data -- 5.6 Advantages and Limitations of Verbal Protocol Analysis as Research Methodology -- 5.7 Conclusion -- PART II -- Investigating Raters' Decision-Making Processes and Awarded Scores in Rating Hungarian Efl Learners' Compositions -- Chapter 6 -- A Pilot Study: Tracing Raters' Decision-Making Processes -- Introduction -- 6.1 Background to the Pilot Study on Assessment of Written Performance -- 6.2 Research Questions -- 6.3 Research Design -- 6.3.1 Participants: the Raters -- 6.3.2 Procedures for Data Collection -- 6.3.3 Test of Written Performance: the Task -- 6.3.4 The Assessment Scale -- 6.3.5 The Coding Scheme -- 6.4 Results and Discussion -- 6.4.1 Distribution of Comments During Rating -- 6.4.2 Comments on Rating Technicalities. 6.4.3 General Comments on the Scripts -- 6.4.4 The Way Raters Arrived at a Score -- 6.4.5 Assessment of the Communicative Goal -- 6.4.6 Assessment of Vocabulary -- 6.4.7 Assessment of accuracy and spelling -- 6.4.8 Assessment of the Text Organisation -- 6.5 The Rating Process -- 6.6 Conclusion -- Chapter 7 -- The Main Study: Processes and Outcomes in Rating L2 English Written Performance in a Pre-Service Tefl Course -- Introduction -- 7.1 Background to Main Study -- 7.2 Design of the Study -- 7.3 Research Questions -- 7.4 Participants -- 7.5 Data Collection Instruments -- 7.5.1 The Scripts -- 7.5.2 The Rating Scale -- 7.5.3 The Rating Task Assignment Package -- 7.6 Data Collection Procedures -- 7.6.1 Script Characteristics -- 7.6.2 Script Selection -- 7.6.3 Training Raters -- 7.6.4 The Rating Task -- 7.7 Processing Verbal Data -- 7.7.1 Transcript Segmentation -- 7.7.2 Coding Scheme Production -- 7.8 Rater Characteristics: Grouping Raters -- 7.9 Summary -- Chapter 8 -- Features of Raters' Rating Patterns -- Introduction -- 8.1 Raters' Gender Distribution -- 8.2 Language of the Verbal Protocols -- 8.3 Sequencing the Scripts for Rating -- 8.4 Length of Verbal Protocols -- 8.5 Raters' Rating Sequences -- 8.6 Raters' Rating Patterns -- 8.7 Conclusion -- Chapter 9 -- Raters' Rating Focus -- Introduction -- 9.1 Raters' Rating Foci -- 9.1.1 Management Focus: Management Strategies -- 9.1.2 Rating Focus: Rating Strategies -- 9.1.3 Reading Focus: Reading Strategies -- 9.1.4 Raters' Own Focus: Other Comments -- 9.2 Conclusion -- Chapter 10 -- Raters' Focus on the Four Rating Criteria -- Introduction -- 10.1 Raters' Focus on the Four Rating Criteria -- 10.2 Raters' Focus When Rating Task Achievement -- 10.3 Raters' Focus When Rating Vocabulary -- 10.4 Raters' Focus When Rating Grammar -- 10.5 Raters' Focus When Rating Organisation -- 10.6 Conclusion -- Chapter 11. Raters' Script Interpretation on the Weakest and Top Script -- Introduction -- 11.1 Rating Script N2: Benchmarks and Total Scores -- 11.1.1 Comments on Script N2 in the Pre-Scoring Stage -- 11.1.2 Rating Task Achievement of Script N2 -- 11.1.3 Rating Vocabulary of Script N2 -- 1.1.4 Rating Grammar of Script N2 -- 11.1.5 Rating Organisation of Script N2 -- 11.2 Ratings of Script N6: Benchmarks and Total Scores -- 11.2.1 Comments on Script N6 in the Pre-Scoring Stage -- 11.2.2 Rating Task Achievement of Script N6 -- 11.2.4 Rating Grammar of Script N6 -- 11.2.5 Rating Organisation of Script N6 -- 11.3 Conclusion -- Chapter 12 -- Raters' Perception of the Rating Task and Thinking Aloud -- Introduction -- 12.1 The Feedback Sheet -- 12.1.1 Raters' Feedback on the Language-Testing Course -- 12.1.2 Raters' Feedback on Training for Rating Written Performance -- 12.1.3 Raters' Feedback on the Rating Task -- 12.2 Conclusion -- General Conclusions -- Introduction -- Background to Written Performance Assessment -- Features of Rating Processes -- Raters' Rating Foci -- Interpretation of the Rating Criteria -- Raters' Script Interpretation -- Raters' Perceptions of the Rating Task -- Placing Empirical Findings on the Rating Processes into Theoretical Frameworks -- Verbal Protocol Analysis as Data Collection Method -- Implications of the Findings -- Limitations of the Study -- Further Research -- References -- Appendices -- Appendix 6.1 The letter writing task in the pilot study -- Appendix 6.2 The rating scale in the pilot study -- Appendix 6.3 The coding scheme for the pilot study -- Appendix 6.4 Number of utterances made during the rating process in the pilot study -- Appendix 6.5 A sample from EngR1 transcript in the pilot study (translated from Hungarian) -- Appendix 7.1 The writing task in the main study -- Appendix 7.2 The rating scale in the main study. Appendix 7.3 The letter to the students in the main study -- Appendix 7.4 The ten scripts in the main study -- Appendix 7.5 The score sheet in the main study -- Appendix 7.6 The feedback sheet in the main study -- Appendix 7.7 The course description for the elective seminar course in Testing in ELT -- Appendix 7.8 A sample verbal protocol transcript in the main study -- Appendix 7.9 The coding scheme in the main study -- Appendix 7.10 A sample of a coded protocol in the main study -- Appendix 7.11 Competent raters' total scores and rankings of the ten scripts in parentheses in the main study -- Appendix 7.12 Proficient raters' total scores and rankings in parentheses in the main study -- Index. |
author_facet |
Bukta, Katalin, Borowska, Anna, Becker, Carl, |
author_variant |
k b kb |
author_role |
VerfasserIn |
author2 |
Borowska, Anna, Becker, Carl, |
author2_variant |
a b ab c b cb |
author2_role |
TeilnehmendeR TeilnehmendeR |
author_sort |
Bukta, Katalin, |
title |
Rating EFL written performance / |
title_full |
Rating EFL written performance / Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker. |
title_fullStr |
Rating EFL written performance / Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker. |
title_full_unstemmed |
Rating EFL written performance / Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker. |
title_auth |
Rating EFL written performance / |
title_new |
Rating EFL written performance / |
title_sort |
rating efl written performance / |
series |
Versita Discipline: Language, Literature |
series2 |
Versita Discipline: Language, Literature |
publisher |
Versita, Versita Limited, |
publishDate |
2013 |
physical |
1 online resource (424 pages). |
edition |
1st ed. |
contents |
Intro -- Introduction -- Overview of the Book -- PART I -- An Overview of the Literature on L2 Writing and Assessment -- Chapter 1 -- Writing Ability and L2 Writing Instruction -- Introduction -- 1.1 The Writing Skill in L1 and L2 -- 1.1.1 Theoretical Models of Written Text Production -- 1.1.2 Theoretical Frameworks of Communicative Competence -- 1.2 Writing Ability in L1 -- 1.3 Writing Ability in L2 -- 1.3.1 The Relationship Between L1 and L2 Writing Ability -- 1.3.2 Skilled and Unskilled L2 Writers -- 1.4 L2 Writing Instruction -- 1.4.1 Controlled Composition Approach to Writing -- 1.4.2 Process-Oriented Approach to Writing -- 1.4.3 The Role of Writing in Communicative Language Teaching -- 1.5 Conclusion -- Chapter 2 -- Assessing Language Ability -- Introduction -- 2.1 Assessing Language Ability -- 2.1.1 History of Language Testing -- 2.1.2 Recent Developments in Language Testing Research -- 2.2 L2 Ability Assessment -- 2.2.1 Language Ability and Language Performance -- 2.2.2 Characteristics of Performance Assessment -- 2.3 Test Features -- 2.3.1 Test Purpose -- 2.3.2 Testing Methods -- 2.4 Qualities of Language Tests -- 2.4.1 Reliability -- 2.4.2 Validity -- 2.4.3 Authenticity -- 2.4.4 Impact -- 2.4.5 Washback -- 2.4.6 Practicality -- 2.5 Test Method Characteristics -- 2.6 Assessing the Four Language Skills -- 2.7 Scoring Methods -- 2.7.1 Characteristics of Rating Scales -- 2.7.2 Rater Variables -- 2.7.3 Score Interpretation -- 2.8 Test-Taker Characteristics -- 2.9 Language Test Construction -- 2.10 Conclusion -- Chapter 3 -- Assessing Writing Ability -- Introduction -- 3.1 Written Performance Assessment -- 3.2 Alternative Ways of Writing Ability Assessment -- 3.3 Nature of Written Performance Assessment -- 3.3.1 Validity of Writing Assessment -- 3.3.2 Task Characteristics -- 3.3.3 Definition of Audience -- 3.3.4 Test Taker Characteristics. 3.4 Conclusion -- Chapter 4 -- Rating Written Performance -- Introduction -- 4.1 Scoring Procedures -- 4.2 Rater Variables -- 4.3 Rating as a Problem-Solving Activity -- 4.4 Frameworks of Scoring Processes -- 4.4.1 Milanovic, Saville and Shuhong's Framework of the Scoring Process -- 4.4.2 Wolfe's Framework of the Scoring Process -- 4.4.3 Lumley's Framework of the Scoring Process -- 4.4.4 Cumming, Kantor and Powers' Framework of the Scoring Process -- 4.5 Rater Stability -- 4.6 Rater Training -- 4.7 Conclusion -- Chapter 5 -- Verbal Protocol Analysis as a Research Method in Written Performance Assessment -- Introduction -- 5.1 Research in L2 Acquisition Studies -- 5.2 Introspective Reports as Data Collection -- 5.3 Categorisation of Verbal Protocols -- 5.4 Concurrent Think-Aloud Protocols in Written Performance Assessment -- 5.5 Verbal Protocol Analysis Procedure -- 5.5.1 Data Preparation and Collection Procedures -- 5.5.2 Verbal Report Procedure Preparation -- 5.5.3 Data Transcription -- 5.5.4 Segmenting the Protocols for Coding -- 5.5.5 Developing a Coding Scheme -- 5.5.6 Analysis of the Coded Data -- 5.6 Advantages and Limitations of Verbal Protocol Analysis as Research Methodology -- 5.7 Conclusion -- PART II -- Investigating Raters' Decision-Making Processes and Awarded Scores in Rating Hungarian Efl Learners' Compositions -- Chapter 6 -- A Pilot Study: Tracing Raters' Decision-Making Processes -- Introduction -- 6.1 Background to the Pilot Study on Assessment of Written Performance -- 6.2 Research Questions -- 6.3 Research Design -- 6.3.1 Participants: the Raters -- 6.3.2 Procedures for Data Collection -- 6.3.3 Test of Written Performance: the Task -- 6.3.4 The Assessment Scale -- 6.3.5 The Coding Scheme -- 6.4 Results and Discussion -- 6.4.1 Distribution of Comments During Rating -- 6.4.2 Comments on Rating Technicalities. 6.4.3 General Comments on the Scripts -- 6.4.4 The Way Raters Arrived at a Score -- 6.4.5 Assessment of the Communicative Goal -- 6.4.6 Assessment of Vocabulary -- 6.4.7 Assessment of accuracy and spelling -- 6.4.8 Assessment of the Text Organisation -- 6.5 The Rating Process -- 6.6 Conclusion -- Chapter 7 -- The Main Study: Processes and Outcomes in Rating L2 English Written Performance in a Pre-Service Tefl Course -- Introduction -- 7.1 Background to Main Study -- 7.2 Design of the Study -- 7.3 Research Questions -- 7.4 Participants -- 7.5 Data Collection Instruments -- 7.5.1 The Scripts -- 7.5.2 The Rating Scale -- 7.5.3 The Rating Task Assignment Package -- 7.6 Data Collection Procedures -- 7.6.1 Script Characteristics -- 7.6.2 Script Selection -- 7.6.3 Training Raters -- 7.6.4 The Rating Task -- 7.7 Processing Verbal Data -- 7.7.1 Transcript Segmentation -- 7.7.2 Coding Scheme Production -- 7.8 Rater Characteristics: Grouping Raters -- 7.9 Summary -- Chapter 8 -- Features of Raters' Rating Patterns -- Introduction -- 8.1 Raters' Gender Distribution -- 8.2 Language of the Verbal Protocols -- 8.3 Sequencing the Scripts for Rating -- 8.4 Length of Verbal Protocols -- 8.5 Raters' Rating Sequences -- 8.6 Raters' Rating Patterns -- 8.7 Conclusion -- Chapter 9 -- Raters' Rating Focus -- Introduction -- 9.1 Raters' Rating Foci -- 9.1.1 Management Focus: Management Strategies -- 9.1.2 Rating Focus: Rating Strategies -- 9.1.3 Reading Focus: Reading Strategies -- 9.1.4 Raters' Own Focus: Other Comments -- 9.2 Conclusion -- Chapter 10 -- Raters' Focus on the Four Rating Criteria -- Introduction -- 10.1 Raters' Focus on the Four Rating Criteria -- 10.2 Raters' Focus When Rating Task Achievement -- 10.3 Raters' Focus When Rating Vocabulary -- 10.4 Raters' Focus When Rating Grammar -- 10.5 Raters' Focus When Rating Organisation -- 10.6 Conclusion -- Chapter 11. Raters' Script Interpretation on the Weakest and Top Script -- Introduction -- 11.1 Rating Script N2: Benchmarks and Total Scores -- 11.1.1 Comments on Script N2 in the Pre-Scoring Stage -- 11.1.2 Rating Task Achievement of Script N2 -- 11.1.3 Rating Vocabulary of Script N2 -- 1.1.4 Rating Grammar of Script N2 -- 11.1.5 Rating Organisation of Script N2 -- 11.2 Ratings of Script N6: Benchmarks and Total Scores -- 11.2.1 Comments on Script N6 in the Pre-Scoring Stage -- 11.2.2 Rating Task Achievement of Script N6 -- 11.2.4 Rating Grammar of Script N6 -- 11.2.5 Rating Organisation of Script N6 -- 11.3 Conclusion -- Chapter 12 -- Raters' Perception of the Rating Task and Thinking Aloud -- Introduction -- 12.1 The Feedback Sheet -- 12.1.1 Raters' Feedback on the Language-Testing Course -- 12.1.2 Raters' Feedback on Training for Rating Written Performance -- 12.1.3 Raters' Feedback on the Rating Task -- 12.2 Conclusion -- General Conclusions -- Introduction -- Background to Written Performance Assessment -- Features of Rating Processes -- Raters' Rating Foci -- Interpretation of the Rating Criteria -- Raters' Script Interpretation -- Raters' Perceptions of the Rating Task -- Placing Empirical Findings on the Rating Processes into Theoretical Frameworks -- Verbal Protocol Analysis as Data Collection Method -- Implications of the Findings -- Limitations of the Study -- Further Research -- References -- Appendices -- Appendix 6.1 The letter writing task in the pilot study -- Appendix 6.2 The rating scale in the pilot study -- Appendix 6.3 The coding scheme for the pilot study -- Appendix 6.4 Number of utterances made during the rating process in the pilot study -- Appendix 6.5 A sample from EngR1 transcript in the pilot study (translated from Hungarian) -- Appendix 7.1 The writing task in the main study -- Appendix 7.2 The rating scale in the main study. Appendix 7.3 The letter to the students in the main study -- Appendix 7.4 The ten scripts in the main study -- Appendix 7.5 The score sheet in the main study -- Appendix 7.6 The feedback sheet in the main study -- Appendix 7.7 The course description for the elective seminar course in Testing in ELT -- Appendix 7.8 A sample verbal protocol transcript in the main study -- Appendix 7.9 The coding scheme in the main study -- Appendix 7.10 A sample of a coded protocol in the main study -- Appendix 7.11 Competent raters' total scores and rankings of the ten scripts in parentheses in the main study -- Appendix 7.12 Proficient raters' total scores and rankings in parentheses in the main study -- Index. |
isbn |
3-11-039928-8 83-7656-078-6 |
callnumber-first |
P - Language and Literature |
callnumber-subject |
PE - English Languages |
callnumber-label |
PE1128 |
callnumber-sort |
PE 41128 A2 B85 42013 |
illustrated |
Not Illustrated |
dewey-hundreds |
400 - Language |
dewey-tens |
420 - English & Old English languages |
dewey-ones |
428 - Standard English usage |
dewey-full |
428.0071 |
dewey-sort |
3428.0071 |
dewey-raw |
428.0071 |
dewey-search |
428.0071 |
oclc_num |
947127904 |
work_keys_str_mv |
AT buktakatalin ratingeflwrittenperformance AT borowskaanna ratingeflwrittenperformance AT beckercarl ratingeflwrittenperformance |
status_str |
n |
ids_txt_mv |
(CKB)3390000000062054 (SSID)ssj0001540268 (PQKBManifestationID)11914079 (PQKBTitleCode)TC0001540268 (PQKBWorkID)11536856 (PQKB)10795566 (MiAaPQ)EBC4002169 (Au-PeEL)EBL4002169 (CaPaEBR)ebr11055002 (OCoLC)947127904 (EXLCZ)993390000000062054 |
carrierType_str_mv |
cr |
hierarchy_parent_title |
Versita Discipline: Language, Literature |
is_hierarchy_title |
Rating EFL written performance / |
container_title |
Versita Discipline: Language, Literature |
author2_original_writing_str_mv |
noLinkedField noLinkedField |
_version_ |
1797653651664142336 |
fullrecord |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>10049nam a2200565 i 4500</leader><controlfield tag="001">993603419804498</controlfield><controlfield tag="005">20240418103632.0</controlfield><controlfield tag="006">m o d | </controlfield><controlfield tag="007">cr cnu||||||||</controlfield><controlfield tag="008">150602t20132013enk ob 001 0 eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">3-11-039928-8</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(CKB)3390000000062054</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(SSID)ssj0001540268</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(PQKBManifestationID)11914079</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(PQKBTitleCode)TC0001540268</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(PQKBWorkID)11536856</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(PQKB)10795566</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(MiAaPQ)EBC4002169</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(Au-PeEL)EBL4002169</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(CaPaEBR)ebr11055002</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)947127904</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(EXLCZ)993390000000062054</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">MiAaPQ</subfield><subfield code="b">eng</subfield><subfield code="e">rda</subfield><subfield code="e">pn</subfield><subfield code="c">MiAaPQ</subfield><subfield code="d">MiAaPQ</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="050" ind1=" " ind2="4"><subfield code="a">PE1128.A2</subfield><subfield code="b">.B85 2013</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">428.0071</subfield><subfield code="2">23</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Bukta, Katalin,</subfield><subfield code="e">author.</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Rating EFL written performance /</subfield><subfield code="c">Katalin Bukta; managing editor, Anna Borowska; language editor, Carl Becker.</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1st ed.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">London, England :</subfield><subfield code="b">Versita, Versita Limited,</subfield><subfield code="c">2013.</subfield></datafield><datafield tag="264" ind1=" " ind2="4"><subfield code="c">2013</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 online resource (424 pages).</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">text</subfield><subfield code="b">txt</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">computer</subfield><subfield code="b">c</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">online resource</subfield><subfield code="b">cr</subfield></datafield><datafield tag="490" ind1="1" ind2=" "><subfield code="a">Versita Discipline: Language, Literature</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Bibliographic Level Mode of Issuance: Monograph</subfield></datafield><datafield tag="546" ind1=" " ind2=" "><subfield code="a">English</subfield></datafield><datafield tag="588" ind1=" " ind2=" "><subfield code="a">Description based on online resource; title from PDF title page (ebrary, viewed May 31, 2015).</subfield></datafield><datafield tag="504" ind1=" " ind2=" "><subfield code="a">Includes bibliographical references and index.</subfield></datafield><datafield tag="505" ind1="0" ind2=" "><subfield code="a">Intro -- Introduction -- Overview of the Book -- PART I -- An Overview of the Literature on L2 Writing and Assessment -- Chapter 1 -- Writing Ability and L2 Writing Instruction -- Introduction -- 1.1 The Writing Skill in L1 and L2 -- 1.1.1 Theoretical Models of Written Text Production -- 1.1.2 Theoretical Frameworks of Communicative Competence -- 1.2 Writing Ability in L1 -- 1.3 Writing Ability in L2 -- 1.3.1 The Relationship Between L1 and L2 Writing Ability -- 1.3.2 Skilled and Unskilled L2 Writers -- 1.4 L2 Writing Instruction -- 1.4.1 Controlled Composition Approach to Writing -- 1.4.2 Process-Oriented Approach to Writing -- 1.4.3 The Role of Writing in Communicative Language Teaching -- 1.5 Conclusion -- Chapter 2 -- Assessing Language Ability -- Introduction -- 2.1 Assessing Language Ability -- 2.1.1 History of Language Testing -- 2.1.2 Recent Developments in Language Testing Research -- 2.2 L2 Ability Assessment -- 2.2.1 Language Ability and Language Performance -- 2.2.2 Characteristics of Performance Assessment -- 2.3 Test Features -- 2.3.1 Test Purpose -- 2.3.2 Testing Methods -- 2.4 Qualities of Language Tests -- 2.4.1 Reliability -- 2.4.2 Validity -- 2.4.3 Authenticity -- 2.4.4 Impact -- 2.4.5 Washback -- 2.4.6 Practicality -- 2.5 Test Method Characteristics -- 2.6 Assessing the Four Language Skills -- 2.7 Scoring Methods -- 2.7.1 Characteristics of Rating Scales -- 2.7.2 Rater Variables -- 2.7.3 Score Interpretation -- 2.8 Test-Taker Characteristics -- 2.9 Language Test Construction -- 2.10 Conclusion -- Chapter 3 -- Assessing Writing Ability -- Introduction -- 3.1 Written Performance Assessment -- 3.2 Alternative Ways of Writing Ability Assessment -- 3.3 Nature of Written Performance Assessment -- 3.3.1 Validity of Writing Assessment -- 3.3.2 Task Characteristics -- 3.3.3 Definition of Audience -- 3.3.4 Test Taker Characteristics.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">3.4 Conclusion -- Chapter 4 -- Rating Written Performance -- Introduction -- 4.1 Scoring Procedures -- 4.2 Rater Variables -- 4.3 Rating as a Problem-Solving Activity -- 4.4 Frameworks of Scoring Processes -- 4.4.1 Milanovic, Saville and Shuhong's Framework of the Scoring Process -- 4.4.2 Wolfe's Framework of the Scoring Process -- 4.4.3 Lumley's Framework of the Scoring Process -- 4.4.4 Cumming, Kantor and Powers' Framework of the Scoring Process -- 4.5 Rater Stability -- 4.6 Rater Training -- 4.7 Conclusion -- Chapter 5 -- Verbal Protocol Analysis as a Research Method in Written Performance Assessment -- Introduction -- 5.1 Research in L2 Acquisition Studies -- 5.2 Introspective Reports as Data Collection -- 5.3 Categorisation of Verbal Protocols -- 5.4 Concurrent Think-Aloud Protocols in Written Performance Assessment -- 5.5 Verbal Protocol Analysis Procedure -- 5.5.1 Data Preparation and Collection Procedures -- 5.5.2 Verbal Report Procedure Preparation -- 5.5.3 Data Transcription -- 5.5.4 Segmenting the Protocols for Coding -- 5.5.5 Developing a Coding Scheme -- 5.5.6 Analysis of the Coded Data -- 5.6 Advantages and Limitations of Verbal Protocol Analysis as Research Methodology -- 5.7 Conclusion -- PART II -- Investigating Raters' Decision-Making Processes and Awarded Scores in Rating Hungarian Efl Learners' Compositions -- Chapter 6 -- A Pilot Study: Tracing Raters' Decision-Making Processes -- Introduction -- 6.1 Background to the Pilot Study on Assessment of Written Performance -- 6.2 Research Questions -- 6.3 Research Design -- 6.3.1 Participants: the Raters -- 6.3.2 Procedures for Data Collection -- 6.3.3 Test of Written Performance: the Task -- 6.3.4 The Assessment Scale -- 6.3.5 The Coding Scheme -- 6.4 Results and Discussion -- 6.4.1 Distribution of Comments During Rating -- 6.4.2 Comments on Rating Technicalities.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">6.4.3 General Comments on the Scripts -- 6.4.4 The Way Raters Arrived at a Score -- 6.4.5 Assessment of the Communicative Goal -- 6.4.6 Assessment of Vocabulary -- 6.4.7 Assessment of accuracy and spelling -- 6.4.8 Assessment of the Text Organisation -- 6.5 The Rating Process -- 6.6 Conclusion -- Chapter 7 -- The Main Study: Processes and Outcomes in Rating L2 English Written Performance in a Pre-Service Tefl Course -- Introduction -- 7.1 Background to Main Study -- 7.2 Design of the Study -- 7.3 Research Questions -- 7.4 Participants -- 7.5 Data Collection Instruments -- 7.5.1 The Scripts -- 7.5.2 The Rating Scale -- 7.5.3 The Rating Task Assignment Package -- 7.6 Data Collection Procedures -- 7.6.1 Script Characteristics -- 7.6.2 Script Selection -- 7.6.3 Training Raters -- 7.6.4 The Rating Task -- 7.7 Processing Verbal Data -- 7.7.1 Transcript Segmentation -- 7.7.2 Coding Scheme Production -- 7.8 Rater Characteristics: Grouping Raters -- 7.9 Summary -- Chapter 8 -- Features of Raters' Rating Patterns -- Introduction -- 8.1 Raters' Gender Distribution -- 8.2 Language of the Verbal Protocols -- 8.3 Sequencing the Scripts for Rating -- 8.4 Length of Verbal Protocols -- 8.5 Raters' Rating Sequences -- 8.6 Raters' Rating Patterns -- 8.7 Conclusion -- Chapter 9 -- Raters' Rating Focus -- Introduction -- 9.1 Raters' Rating Foci -- 9.1.1 Management Focus: Management Strategies -- 9.1.2 Rating Focus: Rating Strategies -- 9.1.3 Reading Focus: Reading Strategies -- 9.1.4 Raters' Own Focus: Other Comments -- 9.2 Conclusion -- Chapter 10 -- Raters' Focus on the Four Rating Criteria -- Introduction -- 10.1 Raters' Focus on the Four Rating Criteria -- 10.2 Raters' Focus When Rating Task Achievement -- 10.3 Raters' Focus When Rating Vocabulary -- 10.4 Raters' Focus When Rating Grammar -- 10.5 Raters' Focus When Rating Organisation -- 10.6 Conclusion -- Chapter 11.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Raters' Script Interpretation on the Weakest and Top Script -- Introduction -- 11.1 Rating Script N2: Benchmarks and Total Scores -- 11.1.1 Comments on Script N2 in the Pre-Scoring Stage -- 11.1.2 Rating Task Achievement of Script N2 -- 11.1.3 Rating Vocabulary of Script N2 -- 1.1.4 Rating Grammar of Script N2 -- 11.1.5 Rating Organisation of Script N2 -- 11.2 Ratings of Script N6: Benchmarks and Total Scores -- 11.2.1 Comments on Script N6 in the Pre-Scoring Stage -- 11.2.2 Rating Task Achievement of Script N6 -- 11.2.4 Rating Grammar of Script N6 -- 11.2.5 Rating Organisation of Script N6 -- 11.3 Conclusion -- Chapter 12 -- Raters' Perception of the Rating Task and Thinking Aloud -- Introduction -- 12.1 The Feedback Sheet -- 12.1.1 Raters' Feedback on the Language-Testing Course -- 12.1.2 Raters' Feedback on Training for Rating Written Performance -- 12.1.3 Raters' Feedback on the Rating Task -- 12.2 Conclusion -- General Conclusions -- Introduction -- Background to Written Performance Assessment -- Features of Rating Processes -- Raters' Rating Foci -- Interpretation of the Rating Criteria -- Raters' Script Interpretation -- Raters' Perceptions of the Rating Task -- Placing Empirical Findings on the Rating Processes into Theoretical Frameworks -- Verbal Protocol Analysis as Data Collection Method -- Implications of the Findings -- Limitations of the Study -- Further Research -- References -- Appendices -- Appendix 6.1 The letter writing task in the pilot study -- Appendix 6.2 The rating scale in the pilot study -- Appendix 6.3 The coding scheme for the pilot study -- Appendix 6.4 Number of utterances made during the rating process in the pilot study -- Appendix 6.5 A sample from EngR1 transcript in the pilot study (translated from Hungarian) -- Appendix 7.1 The writing task in the main study -- Appendix 7.2 The rating scale in the main study.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Appendix 7.3 The letter to the students in the main study -- Appendix 7.4 The ten scripts in the main study -- Appendix 7.5 The score sheet in the main study -- Appendix 7.6 The feedback sheet in the main study -- Appendix 7.7 The course description for the elective seminar course in Testing in ELT -- Appendix 7.8 A sample verbal protocol transcript in the main study -- Appendix 7.9 The coding scheme in the main study -- Appendix 7.10 A sample of a coded protocol in the main study -- Appendix 7.11 Competent raters' total scores and rankings of the ten scripts in parentheses in the main study -- Appendix 7.12 Proficient raters' total scores and rankings in parentheses in the main study -- Index.</subfield></datafield><datafield tag="650" ind1=" " ind2="0"><subfield code="a">English language</subfield><subfield code="x">Study and teaching</subfield><subfield code="x">Foreign speakers.</subfield></datafield><datafield tag="776" ind1=" " ind2=" "><subfield code="z">83-7656-078-6</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Borowska, Anna,</subfield><subfield code="e">editor.</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Becker, Carl,</subfield><subfield code="e">editor.</subfield></datafield><datafield tag="830" ind1=" " ind2="0"><subfield code="a">Versita discipline.</subfield><subfield code="p">Language, literature.</subfield></datafield><datafield tag="906" ind1=" " ind2=" "><subfield code="a">BOOK</subfield></datafield><datafield tag="ADM" ind1=" " ind2=" "><subfield code="b">2024-04-20 04:30:37 Europe/Vienna</subfield><subfield code="f">system</subfield><subfield code="c">marc21</subfield><subfield code="a">2014-10-05 02:18:56 Europe/Vienna</subfield><subfield code="g">false</subfield></datafield><datafield tag="AVE" ind1=" " ind2=" "><subfield code="i">DOAB Directory of Open Access Books</subfield><subfield code="P">DOAB Directory of Open Access Books</subfield><subfield code="x">https://eu02.alma.exlibrisgroup.com/view/uresolver/43ACC_OEAW/openurl?u.ignore_date_coverage=true&portfolio_pid=5338461940004498&Force_direct=true</subfield><subfield code="Z">5338461940004498</subfield><subfield code="b">Available</subfield><subfield code="8">5338461940004498</subfield></datafield></record></collection> |