Peer Review in an Era of Evaluation : : Understanding the Practice of Gatekeeping in Academia.
Saved in:
: | |
---|---|
TeilnehmendeR: | |
Place / Publishing House: | Cham : : Springer International Publishing AG,, 2022. ©2022. |
Year of Publication: | 2022 |
Edition: | 1st ed. |
Language: | English |
Online Access: | |
Physical Description: | 1 online resource (414 pages) |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
5006840137 |
---|---|
ctrlnum |
(MiAaPQ)5006840137 (Au-PeEL)EBL6840137 (OCoLC)1292357405 |
collection |
bib_alma |
record_format |
marc |
spelling |
Forsberg, Eva. Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. 1st ed. Cham : Springer International Publishing AG, 2022. ©2022. 1 online resource (414 pages) text txt rdacontent computer c rdamedia online resource cr rdacarrier Intro -- Contents -- Notes on Contributors -- List of Figures -- List of Tables -- Part I: Peer Review: Introduction and Its Context -- 1: Peer Review in Academia -- Introduction -- The Many Face(t)s of Peer-Review Practices -- The Interplay of Primary and Secondary Peer Review -- Sites and Reviewer Tasks and Roles -- Power-making in the Selection of Expertise -- The Academic Genres of Peer Review -- Criteria and the Professional Judgement of Quality -- The Autonomy of a Profession and a Challenged Contract -- Why Study Peer Review? -- State of the Art of Research on Peer Review -- The Structure and Content of the Volume -- References -- 2: Hierarchies and Universal Inclusion in Scientific Communities -- Tensions and Contradictions in Contemporary Society -- Universal Inclusion -- Publication as the Elementary 'Unit-Act' of the System of Science -- Authorship of Publications as the Form of Inclusion in Science -- Citations as the Internal Structure of Publications -- Reading and Writing in Scientific Communities: The Hierarchy of Authorship -- The Emergence of Peer Review: The Hierarchy of Readership -- The Two Hierarchies: Authorship and Readership -- The Third and Fourth Hierarchy: Hierarchy of Publication Places and Hierarchy of Recruitment for Co-authorship -- Two Modalities of Quality Control in Science -- Anticipatory, Centralized Control by Scientific Elites -- Post-hoc, Decentralized Market Control Based on Universal Inclusion -- Concluding Remarks -- References -- 3: "'Disciplining' Educational Research in the Twentieth Century" -- Introduction -- Reviewers and Authors -- Initial Expectations -- Further Expansion -- Authors and Reviewers -- Community of Peers -- Blind Peer Review -- Papers and References -- Suggestions for Contributors -- Citation Consciousness -- Conclusion -- References. Part II: Peer Review and the Higher Education Evaluation Machinery -- 4: Gatekeepers on Campus: Peer Review in Quality Assurance of Higher Education Institutions -- Which Gates Do Peers Keep? -- Quality of Higher Education Institutions -- Quality of Performance and Performance Indicators -- Strengths and Weaknesses of Performance Indicators -- Quality of the Organisation and Peer Review -- Strengths and Weaknesses of Peer Review in Quality Assurance -- Persistent Dilemmas: Instead of a Conclusion -- References -- 5: The Many Faces of Peer Review -- Introduction -- Classical Peer Review as One of Several Evaluation Models -- Informed and Standards-Based Peer Review -- Modified Peer Review -- Extended Peer Review -- Peer Review in the Educational Field -- Conclusion and Discussion -- References -- 6: Your Brother's Gatekeeper: How Effects of Evaluation Machineries in Research Are Sometimes Enhanced -- Introduction -- Metrics and Ambiguity -- A Case Study of the Danish Bibliometric Indicator -- Vignettes -- Discussion and Conclusion -- References -- 7: Peer Review in Public Administration: The Case of the Swedish Higher Education Authority -- The National System for Quality Assurance of Higher Education in Sweden -- The History -- Critique -- 2011: A New System Is Launched -- Peer Review -- Sources -- The Role of the Peers and the Method of Peer Review -- Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Grasping the Concept of Result -- The Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Collegiality as a Form of Governance -- Peer Review in the National Quality Assurance System -- Sources -- Directions on Assessments -- Reports Describing Whole Quality Assurance Systems -- Guidelines for HEIs and Peers -- Reports on Reviews Conducted Within the Framework of National Systems for Quality Assurance of Higher Education. Accounts of Government Assignments -- Meta-analyses of the Authority's/the Authority's Own Reviews -- Other Reports -- Other -- References -- 8: Performance-Based Evaluation Metrics: Influence at the Macro, Meso, and Micro Level -- Introduction -- Algorithmic Historiography and the Birth of Scientometrics -- Bibliometrics for the Evaluation of Research -- The Citation as Mediator: The Performativity of "Being Cited" -- Consequences for Research Policy -- Co-production of Science and Society -- Performance-Based Research Allocation Models at Three Levels -- PRFS at the Macro Level: A Comparison Between the Norwegian and Swedish Systems -- At the Meso Level, Within Universities -- At the Micro Level, Individual Researchers -- Conclusions: The Performativity of Performance-Based Research Funding on Different Levels -- References -- 9: Peer Advocacy: Expressions of Loyalty in Peer Review -- Introduction -- Aims and Uses of Peer Review -- Advocacy in Academia -- Cases of Advocacy -- Case 1: National Reviews of Subjects and Programmes -- Case 2: Institutional Review of an Academic Development Unit -- Case 3: External Evaluators Appointed to Promote an Application for University Status -- Case 4: HR Competencies in Academic Appointment Processes -- Discussion -- Conclusions and Recommendations -- References -- 10: Is Peer Review Fit for Purpose? -- Introduction -- Methodology -- Refereed Journal Articles -- The Assessment of Doctoral Degrees -- The UK Research Excellence Framework (REF) -- Conclusion -- References -- Part III: Specificities of Different Peer-Review Practices -- 11: Peer Review in Academic Promotion of Excellent Teachers -- Introduction -- Career and Reward Structure in Swedish Higher Education -- Gatekeeping in the Promotion of 'Distinguished University Teachers' -- The Process of Promoting Teaching Excellence. The Mandatory Content of the Application Dossier -- Faculty Guidelines and Candidate Applications -- Judgement and Legitimation in the Making of 'Distinguished University Teachers' -- The (E)valuation of the 'Distinguished University Teacher': The Judgement -- The Scholarly Judgement of Criteria and Content -- The Scholarly Judgement of Evidence -- Justification of the (E)valuation: The Legitimation -- Justification In-between Standardization and Professional Judgement -- Justification Through Mandated Intertextuality -- Justification Through Scholarly Judgement -- The Intersection of Promotion, Peer Review, and Teaching Excellence -- The Promotion of 'Distinguished University Teachers': The Same, But Different -- A Latecomer and an Emergent Game Changer? -- References -- 12: Peers in Systematic Review: Gate Keeping Understandings of Research in the Field -- Introduction -- Peers in Academic Publishing and Systematic Review -- Analytical Framework -- Method -- Examples of Peers in three Review Processes -- Swedish Institute for Educational Research -- The Norwegian Knowledge Centre for Education -- Danish Clearinghouse for Educational Research (DCU) -- Peers in the Systematic Review Processes -- Concluding Remarks -- References -- Selected Systematic Review Technical Reports Analysed in the Study -- The Example Reports Used for the In-depth Reading Are Underlined -- 13: The Decision-Making Constraints and Processes of Grant Peer Review, and Their Effects on the Review Outcome -- Introduction -- Data Sources and Methods -- Analysis of the Grant-Review Practices of RCN -- The Various Models -- Overview of Proposals and Grants -- The Quality Criteria in the Assessments -- Considerations Other than Research Quality in the Assessments -- The Effects of the Various Ranking Processes -- Important Organizational Factors Affecting Ranking -- Conclusions. Appendix: The Review Criteria in the Different RCN Divisions -- The RCN Divisions' guidelines listed the following review criteria: -- References -- 14: Typecasting in the Recruitment of Full Professors -- Introduction -- The Field of Educational Science(s) -- Recruitment Procedures-A National Context -- Typecasting in the Recruitment of Full Professors -- The Intellectual and Social Organization of Educational Science(s) -- The Emergence of a Heterogeneous Field -- The Selection of Peers -- The Mobilization of Job Categories -- The Intersection Between Institutional Demands and Scientific Values -- Eliminatory Criteria, Signs and Retrospective Judgments -- Conclusive Notes -- Typecasting as a Device of Peer Review in the Formation of Education Science(s) -- The Professor of Education Science(s) in Late Modernity -- References -- 15: Assessing Academic Careers: The Peer Review of Professorial Candidates -- Introduction -- Picking the Best: Peer Review in Assessment Procedures -- Analysing Referee Reports -- Judgement Devices and Intellectual Structure -- Merits and Their Assessment: Five Main Themes -- Authorship, or the Reading of By-Lines -- Publication Prestige and the Importance of Articles in 'Top-Journals' -- Temporality. The Importance of a 'Positive Trajectory'. -- Racing for the Prize: Reputation Through Awards and Citations -- Boundary Keeping and the Shielding of Academic Markets -- Discussion -- References -- 16: Bureaucratic, Professional and Managerial Power in University Tenure Track Recruitment -- Introduction -- Selection and Recruitment of Candidates: A Regulative Perspective -- Recruitment and Tenure Track Systems in Finland -- Collection and Analysis of Data -- Influence and Actors in Recruitment: Bureaucratic, Managerial and Professional Powers -- The Recruitment Process in Tenure Track -- Defining the Position. Advertisement and Application. Description based on publisher supplied metadata and other sources. Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2024. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries. Electronic books. Geschwind, Lars. Levander, Sara. Wermke, Wieland. Print version: Forsberg, Eva Peer Review in an Era of Evaluation Cham : Springer International Publishing AG,c2022 9783030752620 ProQuest (Firm) https://ebookcentral.proquest.com/lib/oeawat/detail.action?docID=6840137 Click to View |
language |
English |
format |
eBook |
author |
Forsberg, Eva. |
spellingShingle |
Forsberg, Eva. Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. Intro -- Contents -- Notes on Contributors -- List of Figures -- List of Tables -- Part I: Peer Review: Introduction and Its Context -- 1: Peer Review in Academia -- Introduction -- The Many Face(t)s of Peer-Review Practices -- The Interplay of Primary and Secondary Peer Review -- Sites and Reviewer Tasks and Roles -- Power-making in the Selection of Expertise -- The Academic Genres of Peer Review -- Criteria and the Professional Judgement of Quality -- The Autonomy of a Profession and a Challenged Contract -- Why Study Peer Review? -- State of the Art of Research on Peer Review -- The Structure and Content of the Volume -- References -- 2: Hierarchies and Universal Inclusion in Scientific Communities -- Tensions and Contradictions in Contemporary Society -- Universal Inclusion -- Publication as the Elementary 'Unit-Act' of the System of Science -- Authorship of Publications as the Form of Inclusion in Science -- Citations as the Internal Structure of Publications -- Reading and Writing in Scientific Communities: The Hierarchy of Authorship -- The Emergence of Peer Review: The Hierarchy of Readership -- The Two Hierarchies: Authorship and Readership -- The Third and Fourth Hierarchy: Hierarchy of Publication Places and Hierarchy of Recruitment for Co-authorship -- Two Modalities of Quality Control in Science -- Anticipatory, Centralized Control by Scientific Elites -- Post-hoc, Decentralized Market Control Based on Universal Inclusion -- Concluding Remarks -- References -- 3: "'Disciplining' Educational Research in the Twentieth Century" -- Introduction -- Reviewers and Authors -- Initial Expectations -- Further Expansion -- Authors and Reviewers -- Community of Peers -- Blind Peer Review -- Papers and References -- Suggestions for Contributors -- Citation Consciousness -- Conclusion -- References. Part II: Peer Review and the Higher Education Evaluation Machinery -- 4: Gatekeepers on Campus: Peer Review in Quality Assurance of Higher Education Institutions -- Which Gates Do Peers Keep? -- Quality of Higher Education Institutions -- Quality of Performance and Performance Indicators -- Strengths and Weaknesses of Performance Indicators -- Quality of the Organisation and Peer Review -- Strengths and Weaknesses of Peer Review in Quality Assurance -- Persistent Dilemmas: Instead of a Conclusion -- References -- 5: The Many Faces of Peer Review -- Introduction -- Classical Peer Review as One of Several Evaluation Models -- Informed and Standards-Based Peer Review -- Modified Peer Review -- Extended Peer Review -- Peer Review in the Educational Field -- Conclusion and Discussion -- References -- 6: Your Brother's Gatekeeper: How Effects of Evaluation Machineries in Research Are Sometimes Enhanced -- Introduction -- Metrics and Ambiguity -- A Case Study of the Danish Bibliometric Indicator -- Vignettes -- Discussion and Conclusion -- References -- 7: Peer Review in Public Administration: The Case of the Swedish Higher Education Authority -- The National System for Quality Assurance of Higher Education in Sweden -- The History -- Critique -- 2011: A New System Is Launched -- Peer Review -- Sources -- The Role of the Peers and the Method of Peer Review -- Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Grasping the Concept of Result -- The Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Collegiality as a Form of Governance -- Peer Review in the National Quality Assurance System -- Sources -- Directions on Assessments -- Reports Describing Whole Quality Assurance Systems -- Guidelines for HEIs and Peers -- Reports on Reviews Conducted Within the Framework of National Systems for Quality Assurance of Higher Education. Accounts of Government Assignments -- Meta-analyses of the Authority's/the Authority's Own Reviews -- Other Reports -- Other -- References -- 8: Performance-Based Evaluation Metrics: Influence at the Macro, Meso, and Micro Level -- Introduction -- Algorithmic Historiography and the Birth of Scientometrics -- Bibliometrics for the Evaluation of Research -- The Citation as Mediator: The Performativity of "Being Cited" -- Consequences for Research Policy -- Co-production of Science and Society -- Performance-Based Research Allocation Models at Three Levels -- PRFS at the Macro Level: A Comparison Between the Norwegian and Swedish Systems -- At the Meso Level, Within Universities -- At the Micro Level, Individual Researchers -- Conclusions: The Performativity of Performance-Based Research Funding on Different Levels -- References -- 9: Peer Advocacy: Expressions of Loyalty in Peer Review -- Introduction -- Aims and Uses of Peer Review -- Advocacy in Academia -- Cases of Advocacy -- Case 1: National Reviews of Subjects and Programmes -- Case 2: Institutional Review of an Academic Development Unit -- Case 3: External Evaluators Appointed to Promote an Application for University Status -- Case 4: HR Competencies in Academic Appointment Processes -- Discussion -- Conclusions and Recommendations -- References -- 10: Is Peer Review Fit for Purpose? -- Introduction -- Methodology -- Refereed Journal Articles -- The Assessment of Doctoral Degrees -- The UK Research Excellence Framework (REF) -- Conclusion -- References -- Part III: Specificities of Different Peer-Review Practices -- 11: Peer Review in Academic Promotion of Excellent Teachers -- Introduction -- Career and Reward Structure in Swedish Higher Education -- Gatekeeping in the Promotion of 'Distinguished University Teachers' -- The Process of Promoting Teaching Excellence. The Mandatory Content of the Application Dossier -- Faculty Guidelines and Candidate Applications -- Judgement and Legitimation in the Making of 'Distinguished University Teachers' -- The (E)valuation of the 'Distinguished University Teacher': The Judgement -- The Scholarly Judgement of Criteria and Content -- The Scholarly Judgement of Evidence -- Justification of the (E)valuation: The Legitimation -- Justification In-between Standardization and Professional Judgement -- Justification Through Mandated Intertextuality -- Justification Through Scholarly Judgement -- The Intersection of Promotion, Peer Review, and Teaching Excellence -- The Promotion of 'Distinguished University Teachers': The Same, But Different -- A Latecomer and an Emergent Game Changer? -- References -- 12: Peers in Systematic Review: Gate Keeping Understandings of Research in the Field -- Introduction -- Peers in Academic Publishing and Systematic Review -- Analytical Framework -- Method -- Examples of Peers in three Review Processes -- Swedish Institute for Educational Research -- The Norwegian Knowledge Centre for Education -- Danish Clearinghouse for Educational Research (DCU) -- Peers in the Systematic Review Processes -- Concluding Remarks -- References -- Selected Systematic Review Technical Reports Analysed in the Study -- The Example Reports Used for the In-depth Reading Are Underlined -- 13: The Decision-Making Constraints and Processes of Grant Peer Review, and Their Effects on the Review Outcome -- Introduction -- Data Sources and Methods -- Analysis of the Grant-Review Practices of RCN -- The Various Models -- Overview of Proposals and Grants -- The Quality Criteria in the Assessments -- Considerations Other than Research Quality in the Assessments -- The Effects of the Various Ranking Processes -- Important Organizational Factors Affecting Ranking -- Conclusions. Appendix: The Review Criteria in the Different RCN Divisions -- The RCN Divisions' guidelines listed the following review criteria: -- References -- 14: Typecasting in the Recruitment of Full Professors -- Introduction -- The Field of Educational Science(s) -- Recruitment Procedures-A National Context -- Typecasting in the Recruitment of Full Professors -- The Intellectual and Social Organization of Educational Science(s) -- The Emergence of a Heterogeneous Field -- The Selection of Peers -- The Mobilization of Job Categories -- The Intersection Between Institutional Demands and Scientific Values -- Eliminatory Criteria, Signs and Retrospective Judgments -- Conclusive Notes -- Typecasting as a Device of Peer Review in the Formation of Education Science(s) -- The Professor of Education Science(s) in Late Modernity -- References -- 15: Assessing Academic Careers: The Peer Review of Professorial Candidates -- Introduction -- Picking the Best: Peer Review in Assessment Procedures -- Analysing Referee Reports -- Judgement Devices and Intellectual Structure -- Merits and Their Assessment: Five Main Themes -- Authorship, or the Reading of By-Lines -- Publication Prestige and the Importance of Articles in 'Top-Journals' -- Temporality. The Importance of a 'Positive Trajectory'. -- Racing for the Prize: Reputation Through Awards and Citations -- Boundary Keeping and the Shielding of Academic Markets -- Discussion -- References -- 16: Bureaucratic, Professional and Managerial Power in University Tenure Track Recruitment -- Introduction -- Selection and Recruitment of Candidates: A Regulative Perspective -- Recruitment and Tenure Track Systems in Finland -- Collection and Analysis of Data -- Influence and Actors in Recruitment: Bureaucratic, Managerial and Professional Powers -- The Recruitment Process in Tenure Track -- Defining the Position. Advertisement and Application. |
author_facet |
Forsberg, Eva. Geschwind, Lars. Levander, Sara. Wermke, Wieland. |
author_variant |
e f ef |
author2 |
Geschwind, Lars. Levander, Sara. Wermke, Wieland. |
author2_variant |
l g lg s l sl w w ww |
author2_role |
TeilnehmendeR TeilnehmendeR TeilnehmendeR |
author_sort |
Forsberg, Eva. |
title |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
title_sub |
Understanding the Practice of Gatekeeping in Academia. |
title_full |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
title_fullStr |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
title_full_unstemmed |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
title_auth |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
title_new |
Peer Review in an Era of Evaluation : |
title_sort |
peer review in an era of evaluation : understanding the practice of gatekeeping in academia. |
publisher |
Springer International Publishing AG, |
publishDate |
2022 |
physical |
1 online resource (414 pages) |
edition |
1st ed. |
contents |
Intro -- Contents -- Notes on Contributors -- List of Figures -- List of Tables -- Part I: Peer Review: Introduction and Its Context -- 1: Peer Review in Academia -- Introduction -- The Many Face(t)s of Peer-Review Practices -- The Interplay of Primary and Secondary Peer Review -- Sites and Reviewer Tasks and Roles -- Power-making in the Selection of Expertise -- The Academic Genres of Peer Review -- Criteria and the Professional Judgement of Quality -- The Autonomy of a Profession and a Challenged Contract -- Why Study Peer Review? -- State of the Art of Research on Peer Review -- The Structure and Content of the Volume -- References -- 2: Hierarchies and Universal Inclusion in Scientific Communities -- Tensions and Contradictions in Contemporary Society -- Universal Inclusion -- Publication as the Elementary 'Unit-Act' of the System of Science -- Authorship of Publications as the Form of Inclusion in Science -- Citations as the Internal Structure of Publications -- Reading and Writing in Scientific Communities: The Hierarchy of Authorship -- The Emergence of Peer Review: The Hierarchy of Readership -- The Two Hierarchies: Authorship and Readership -- The Third and Fourth Hierarchy: Hierarchy of Publication Places and Hierarchy of Recruitment for Co-authorship -- Two Modalities of Quality Control in Science -- Anticipatory, Centralized Control by Scientific Elites -- Post-hoc, Decentralized Market Control Based on Universal Inclusion -- Concluding Remarks -- References -- 3: "'Disciplining' Educational Research in the Twentieth Century" -- Introduction -- Reviewers and Authors -- Initial Expectations -- Further Expansion -- Authors and Reviewers -- Community of Peers -- Blind Peer Review -- Papers and References -- Suggestions for Contributors -- Citation Consciousness -- Conclusion -- References. Part II: Peer Review and the Higher Education Evaluation Machinery -- 4: Gatekeepers on Campus: Peer Review in Quality Assurance of Higher Education Institutions -- Which Gates Do Peers Keep? -- Quality of Higher Education Institutions -- Quality of Performance and Performance Indicators -- Strengths and Weaknesses of Performance Indicators -- Quality of the Organisation and Peer Review -- Strengths and Weaknesses of Peer Review in Quality Assurance -- Persistent Dilemmas: Instead of a Conclusion -- References -- 5: The Many Faces of Peer Review -- Introduction -- Classical Peer Review as One of Several Evaluation Models -- Informed and Standards-Based Peer Review -- Modified Peer Review -- Extended Peer Review -- Peer Review in the Educational Field -- Conclusion and Discussion -- References -- 6: Your Brother's Gatekeeper: How Effects of Evaluation Machineries in Research Are Sometimes Enhanced -- Introduction -- Metrics and Ambiguity -- A Case Study of the Danish Bibliometric Indicator -- Vignettes -- Discussion and Conclusion -- References -- 7: Peer Review in Public Administration: The Case of the Swedish Higher Education Authority -- The National System for Quality Assurance of Higher Education in Sweden -- The History -- Critique -- 2011: A New System Is Launched -- Peer Review -- Sources -- The Role of the Peers and the Method of Peer Review -- Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Grasping the Concept of Result -- The Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Collegiality as a Form of Governance -- Peer Review in the National Quality Assurance System -- Sources -- Directions on Assessments -- Reports Describing Whole Quality Assurance Systems -- Guidelines for HEIs and Peers -- Reports on Reviews Conducted Within the Framework of National Systems for Quality Assurance of Higher Education. Accounts of Government Assignments -- Meta-analyses of the Authority's/the Authority's Own Reviews -- Other Reports -- Other -- References -- 8: Performance-Based Evaluation Metrics: Influence at the Macro, Meso, and Micro Level -- Introduction -- Algorithmic Historiography and the Birth of Scientometrics -- Bibliometrics for the Evaluation of Research -- The Citation as Mediator: The Performativity of "Being Cited" -- Consequences for Research Policy -- Co-production of Science and Society -- Performance-Based Research Allocation Models at Three Levels -- PRFS at the Macro Level: A Comparison Between the Norwegian and Swedish Systems -- At the Meso Level, Within Universities -- At the Micro Level, Individual Researchers -- Conclusions: The Performativity of Performance-Based Research Funding on Different Levels -- References -- 9: Peer Advocacy: Expressions of Loyalty in Peer Review -- Introduction -- Aims and Uses of Peer Review -- Advocacy in Academia -- Cases of Advocacy -- Case 1: National Reviews of Subjects and Programmes -- Case 2: Institutional Review of an Academic Development Unit -- Case 3: External Evaluators Appointed to Promote an Application for University Status -- Case 4: HR Competencies in Academic Appointment Processes -- Discussion -- Conclusions and Recommendations -- References -- 10: Is Peer Review Fit for Purpose? -- Introduction -- Methodology -- Refereed Journal Articles -- The Assessment of Doctoral Degrees -- The UK Research Excellence Framework (REF) -- Conclusion -- References -- Part III: Specificities of Different Peer-Review Practices -- 11: Peer Review in Academic Promotion of Excellent Teachers -- Introduction -- Career and Reward Structure in Swedish Higher Education -- Gatekeeping in the Promotion of 'Distinguished University Teachers' -- The Process of Promoting Teaching Excellence. The Mandatory Content of the Application Dossier -- Faculty Guidelines and Candidate Applications -- Judgement and Legitimation in the Making of 'Distinguished University Teachers' -- The (E)valuation of the 'Distinguished University Teacher': The Judgement -- The Scholarly Judgement of Criteria and Content -- The Scholarly Judgement of Evidence -- Justification of the (E)valuation: The Legitimation -- Justification In-between Standardization and Professional Judgement -- Justification Through Mandated Intertextuality -- Justification Through Scholarly Judgement -- The Intersection of Promotion, Peer Review, and Teaching Excellence -- The Promotion of 'Distinguished University Teachers': The Same, But Different -- A Latecomer and an Emergent Game Changer? -- References -- 12: Peers in Systematic Review: Gate Keeping Understandings of Research in the Field -- Introduction -- Peers in Academic Publishing and Systematic Review -- Analytical Framework -- Method -- Examples of Peers in three Review Processes -- Swedish Institute for Educational Research -- The Norwegian Knowledge Centre for Education -- Danish Clearinghouse for Educational Research (DCU) -- Peers in the Systematic Review Processes -- Concluding Remarks -- References -- Selected Systematic Review Technical Reports Analysed in the Study -- The Example Reports Used for the In-depth Reading Are Underlined -- 13: The Decision-Making Constraints and Processes of Grant Peer Review, and Their Effects on the Review Outcome -- Introduction -- Data Sources and Methods -- Analysis of the Grant-Review Practices of RCN -- The Various Models -- Overview of Proposals and Grants -- The Quality Criteria in the Assessments -- Considerations Other than Research Quality in the Assessments -- The Effects of the Various Ranking Processes -- Important Organizational Factors Affecting Ranking -- Conclusions. Appendix: The Review Criteria in the Different RCN Divisions -- The RCN Divisions' guidelines listed the following review criteria: -- References -- 14: Typecasting in the Recruitment of Full Professors -- Introduction -- The Field of Educational Science(s) -- Recruitment Procedures-A National Context -- Typecasting in the Recruitment of Full Professors -- The Intellectual and Social Organization of Educational Science(s) -- The Emergence of a Heterogeneous Field -- The Selection of Peers -- The Mobilization of Job Categories -- The Intersection Between Institutional Demands and Scientific Values -- Eliminatory Criteria, Signs and Retrospective Judgments -- Conclusive Notes -- Typecasting as a Device of Peer Review in the Formation of Education Science(s) -- The Professor of Education Science(s) in Late Modernity -- References -- 15: Assessing Academic Careers: The Peer Review of Professorial Candidates -- Introduction -- Picking the Best: Peer Review in Assessment Procedures -- Analysing Referee Reports -- Judgement Devices and Intellectual Structure -- Merits and Their Assessment: Five Main Themes -- Authorship, or the Reading of By-Lines -- Publication Prestige and the Importance of Articles in 'Top-Journals' -- Temporality. The Importance of a 'Positive Trajectory'. -- Racing for the Prize: Reputation Through Awards and Citations -- Boundary Keeping and the Shielding of Academic Markets -- Discussion -- References -- 16: Bureaucratic, Professional and Managerial Power in University Tenure Track Recruitment -- Introduction -- Selection and Recruitment of Candidates: A Regulative Perspective -- Recruitment and Tenure Track Systems in Finland -- Collection and Analysis of Data -- Influence and Actors in Recruitment: Bureaucratic, Managerial and Professional Powers -- The Recruitment Process in Tenure Track -- Defining the Position. Advertisement and Application. |
isbn |
9783030752637 9783030752620 |
callnumber-first |
L - Education |
callnumber-subject |
LB - Theory and Practice of Education |
callnumber-label |
LB2300-2799 |
callnumber-sort |
LB 42300 42799.3 |
genre |
Electronic books. |
genre_facet |
Electronic books. |
url |
https://ebookcentral.proquest.com/lib/oeawat/detail.action?docID=6840137 |
illustrated |
Not Illustrated |
oclc_num |
1292357405 |
work_keys_str_mv |
AT forsbergeva peerreviewinaneraofevaluationunderstandingthepracticeofgatekeepinginacademia AT geschwindlars peerreviewinaneraofevaluationunderstandingthepracticeofgatekeepinginacademia AT levandersara peerreviewinaneraofevaluationunderstandingthepracticeofgatekeepinginacademia AT wermkewieland peerreviewinaneraofevaluationunderstandingthepracticeofgatekeepinginacademia |
status_str |
n |
ids_txt_mv |
(MiAaPQ)5006840137 (Au-PeEL)EBL6840137 (OCoLC)1292357405 |
carrierType_str_mv |
cr |
is_hierarchy_title |
Peer Review in an Era of Evaluation : Understanding the Practice of Gatekeeping in Academia. |
author2_original_writing_str_mv |
noLinkedField noLinkedField noLinkedField |
marc_error |
Info : MARC8 translation shorter than ISO-8859-1, choosing MARC8. --- [ 856 : z ] |
_version_ |
1792331061503459328 |
fullrecord |
<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>12432nam a22004693i 4500</leader><controlfield tag="001">5006840137</controlfield><controlfield tag="003">MiAaPQ</controlfield><controlfield tag="005">20240229073845.0</controlfield><controlfield tag="006">m o d | </controlfield><controlfield tag="007">cr cnu||||||||</controlfield><controlfield tag="008">240229s2022 xx o ||||0 eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9783030752637</subfield><subfield code="q">(electronic bk.)</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="z">9783030752620</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(MiAaPQ)5006840137</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(Au-PeEL)EBL6840137</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1292357405</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">MiAaPQ</subfield><subfield code="b">eng</subfield><subfield code="e">rda</subfield><subfield code="e">pn</subfield><subfield code="c">MiAaPQ</subfield><subfield code="d">MiAaPQ</subfield></datafield><datafield tag="050" ind1=" " ind2="4"><subfield code="a">LB2300-2799.3</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Forsberg, Eva.</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Peer Review in an Era of Evaluation :</subfield><subfield code="b">Understanding the Practice of Gatekeeping in Academia.</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1st ed.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Cham :</subfield><subfield code="b">Springer International Publishing AG,</subfield><subfield code="c">2022.</subfield></datafield><datafield tag="264" ind1=" " ind2="4"><subfield code="c">©2022.</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 online resource (414 pages)</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">computer</subfield><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">online resource</subfield><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="505" ind1="0" ind2=" "><subfield code="a">Intro -- Contents -- Notes on Contributors -- List of Figures -- List of Tables -- Part I: Peer Review: Introduction and Its Context -- 1: Peer Review in Academia -- Introduction -- The Many Face(t)s of Peer-Review Practices -- The Interplay of Primary and Secondary Peer Review -- Sites and Reviewer Tasks and Roles -- Power-making in the Selection of Expertise -- The Academic Genres of Peer Review -- Criteria and the Professional Judgement of Quality -- The Autonomy of a Profession and a Challenged Contract -- Why Study Peer Review? -- State of the Art of Research on Peer Review -- The Structure and Content of the Volume -- References -- 2: Hierarchies and Universal Inclusion in Scientific Communities -- Tensions and Contradictions in Contemporary Society -- Universal Inclusion -- Publication as the Elementary 'Unit-Act' of the System of Science -- Authorship of Publications as the Form of Inclusion in Science -- Citations as the Internal Structure of Publications -- Reading and Writing in Scientific Communities: The Hierarchy of Authorship -- The Emergence of Peer Review: The Hierarchy of Readership -- The Two Hierarchies: Authorship and Readership -- The Third and Fourth Hierarchy: Hierarchy of Publication Places and Hierarchy of Recruitment for Co-authorship -- Two Modalities of Quality Control in Science -- Anticipatory, Centralized Control by Scientific Elites -- Post-hoc, Decentralized Market Control Based on Universal Inclusion -- Concluding Remarks -- References -- 3: "'Disciplining' Educational Research in the Twentieth Century" -- Introduction -- Reviewers and Authors -- Initial Expectations -- Further Expansion -- Authors and Reviewers -- Community of Peers -- Blind Peer Review -- Papers and References -- Suggestions for Contributors -- Citation Consciousness -- Conclusion -- References.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Part II: Peer Review and the Higher Education Evaluation Machinery -- 4: Gatekeepers on Campus: Peer Review in Quality Assurance of Higher Education Institutions -- Which Gates Do Peers Keep? -- Quality of Higher Education Institutions -- Quality of Performance and Performance Indicators -- Strengths and Weaknesses of Performance Indicators -- Quality of the Organisation and Peer Review -- Strengths and Weaknesses of Peer Review in Quality Assurance -- Persistent Dilemmas: Instead of a Conclusion -- References -- 5: The Many Faces of Peer Review -- Introduction -- Classical Peer Review as One of Several Evaluation Models -- Informed and Standards-Based Peer Review -- Modified Peer Review -- Extended Peer Review -- Peer Review in the Educational Field -- Conclusion and Discussion -- References -- 6: Your Brother's Gatekeeper: How Effects of Evaluation Machineries in Research Are Sometimes Enhanced -- Introduction -- Metrics and Ambiguity -- A Case Study of the Danish Bibliometric Indicator -- Vignettes -- Discussion and Conclusion -- References -- 7: Peer Review in Public Administration: The Case of the Swedish Higher Education Authority -- The National System for Quality Assurance of Higher Education in Sweden -- The History -- Critique -- 2011: A New System Is Launched -- Peer Review -- Sources -- The Role of the Peers and the Method of Peer Review -- Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Grasping the Concept of Result -- The Early Assessments 1997-1998 -- Later Assessments 2016-2017 -- Collegiality as a Form of Governance -- Peer Review in the National Quality Assurance System -- Sources -- Directions on Assessments -- Reports Describing Whole Quality Assurance Systems -- Guidelines for HEIs and Peers -- Reports on Reviews Conducted Within the Framework of National Systems for Quality Assurance of Higher Education.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Accounts of Government Assignments -- Meta-analyses of the Authority's/the Authority's Own Reviews -- Other Reports -- Other -- References -- 8: Performance-Based Evaluation Metrics: Influence at the Macro, Meso, and Micro Level -- Introduction -- Algorithmic Historiography and the Birth of Scientometrics -- Bibliometrics for the Evaluation of Research -- The Citation as Mediator: The Performativity of "Being Cited" -- Consequences for Research Policy -- Co-production of Science and Society -- Performance-Based Research Allocation Models at Three Levels -- PRFS at the Macro Level: A Comparison Between the Norwegian and Swedish Systems -- At the Meso Level, Within Universities -- At the Micro Level, Individual Researchers -- Conclusions: The Performativity of Performance-Based Research Funding on Different Levels -- References -- 9: Peer Advocacy: Expressions of Loyalty in Peer Review -- Introduction -- Aims and Uses of Peer Review -- Advocacy in Academia -- Cases of Advocacy -- Case 1: National Reviews of Subjects and Programmes -- Case 2: Institutional Review of an Academic Development Unit -- Case 3: External Evaluators Appointed to Promote an Application for University Status -- Case 4: HR Competencies in Academic Appointment Processes -- Discussion -- Conclusions and Recommendations -- References -- 10: Is Peer Review Fit for Purpose? -- Introduction -- Methodology -- Refereed Journal Articles -- The Assessment of Doctoral Degrees -- The UK Research Excellence Framework (REF) -- Conclusion -- References -- Part III: Specificities of Different Peer-Review Practices -- 11: Peer Review in Academic Promotion of Excellent Teachers -- Introduction -- Career and Reward Structure in Swedish Higher Education -- Gatekeeping in the Promotion of 'Distinguished University Teachers' -- The Process of Promoting Teaching Excellence.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">The Mandatory Content of the Application Dossier -- Faculty Guidelines and Candidate Applications -- Judgement and Legitimation in the Making of 'Distinguished University Teachers' -- The (E)valuation of the 'Distinguished University Teacher': The Judgement -- The Scholarly Judgement of Criteria and Content -- The Scholarly Judgement of Evidence -- Justification of the (E)valuation: The Legitimation -- Justification In-between Standardization and Professional Judgement -- Justification Through Mandated Intertextuality -- Justification Through Scholarly Judgement -- The Intersection of Promotion, Peer Review, and Teaching Excellence -- The Promotion of 'Distinguished University Teachers': The Same, But Different -- A Latecomer and an Emergent Game Changer? -- References -- 12: Peers in Systematic Review: Gate Keeping Understandings of Research in the Field -- Introduction -- Peers in Academic Publishing and Systematic Review -- Analytical Framework -- Method -- Examples of Peers in three Review Processes -- Swedish Institute for Educational Research -- The Norwegian Knowledge Centre for Education -- Danish Clearinghouse for Educational Research (DCU) -- Peers in the Systematic Review Processes -- Concluding Remarks -- References -- Selected Systematic Review Technical Reports Analysed in the Study -- The Example Reports Used for the In-depth Reading Are Underlined -- 13: The Decision-Making Constraints and Processes of Grant Peer Review, and Their Effects on the Review Outcome -- Introduction -- Data Sources and Methods -- Analysis of the Grant-Review Practices of RCN -- The Various Models -- Overview of Proposals and Grants -- The Quality Criteria in the Assessments -- Considerations Other than Research Quality in the Assessments -- The Effects of the Various Ranking Processes -- Important Organizational Factors Affecting Ranking -- Conclusions.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Appendix: The Review Criteria in the Different RCN Divisions -- The RCN Divisions' guidelines listed the following review criteria: -- References -- 14: Typecasting in the Recruitment of Full Professors -- Introduction -- The Field of Educational Science(s) -- Recruitment Procedures-A National Context -- Typecasting in the Recruitment of Full Professors -- The Intellectual and Social Organization of Educational Science(s) -- The Emergence of a Heterogeneous Field -- The Selection of Peers -- The Mobilization of Job Categories -- The Intersection Between Institutional Demands and Scientific Values -- Eliminatory Criteria, Signs and Retrospective Judgments -- Conclusive Notes -- Typecasting as a Device of Peer Review in the Formation of Education Science(s) -- The Professor of Education Science(s) in Late Modernity -- References -- 15: Assessing Academic Careers: The Peer Review of Professorial Candidates -- Introduction -- Picking the Best: Peer Review in Assessment Procedures -- Analysing Referee Reports -- Judgement Devices and Intellectual Structure -- Merits and Their Assessment: Five Main Themes -- Authorship, or the Reading of By-Lines -- Publication Prestige and the Importance of Articles in 'Top-Journals' -- Temporality. The Importance of a 'Positive Trajectory'. -- Racing for the Prize: Reputation Through Awards and Citations -- Boundary Keeping and the Shielding of Academic Markets -- Discussion -- References -- 16: Bureaucratic, Professional and Managerial Power in University Tenure Track Recruitment -- Introduction -- Selection and Recruitment of Candidates: A Regulative Perspective -- Recruitment and Tenure Track Systems in Finland -- Collection and Analysis of Data -- Influence and Actors in Recruitment: Bureaucratic, Managerial and Professional Powers -- The Recruitment Process in Tenure Track -- Defining the Position.</subfield></datafield><datafield tag="505" ind1="8" ind2=" "><subfield code="a">Advertisement and Application.</subfield></datafield><datafield tag="588" ind1=" " ind2=" "><subfield code="a">Description based on publisher supplied metadata and other sources.</subfield></datafield><datafield tag="590" ind1=" " ind2=" "><subfield code="a">Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2024. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries. </subfield></datafield><datafield tag="655" ind1=" " ind2="4"><subfield code="a">Electronic books.</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Geschwind, Lars.</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Levander, Sara.</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Wermke, Wieland.</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Print version:</subfield><subfield code="a">Forsberg, Eva</subfield><subfield code="t">Peer Review in an Era of Evaluation</subfield><subfield code="d">Cham : Springer International Publishing AG,c2022</subfield><subfield code="z">9783030752620</subfield></datafield><datafield tag="797" ind1="2" ind2=" "><subfield code="a">ProQuest (Firm)</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://ebookcentral.proquest.com/lib/oeawat/detail.action?docID=6840137</subfield><subfield code="z">Click to View</subfield></datafield></record></collection> |