Research Associate - AI Peer: Large Language Models (LLMs) and Academic Peer Review Outcomes

We are recruiting a Research Associate to the ESRC-funded Metascience project AI Peer: Large language models (LLMs) and academic peer review outcomes. The project involves developing and evaluating LLM-based evaluations of published academic research to support quality control and research assessment tasks.

The role includes running a simple survey to get permission from authors to analyse their texts, managing the existing LLM pipeline to get LLM scores, and writing up the results. It also involves organising an international network of research evaluators that are interested in applying LLM technologies. The postholder will need to attend and present at meetings internationally.

Applicants will need excellent communication, networking, and organisational skills as well as some knowledge of Python, LLMs, and research evaluation or bibliometrics.

What We Offer
The University of Sheffield is a remarkable place to work. Our people are at the heart of everything we do. Their diverse backgrounds, abilities and beliefs make Sheffield a world-class university.

We offer a fantastic range of benefits including a highly competitive annual leave entitlement (with the ability to purchase more), a generous pensions scheme, flexible working opportunities, a commitment to your development and wellbeing, a wide range of retail discounts, and much more.

Advert information