Automated Essay Scoring

26 papers with code • 1 benchmarks • 1 datasets

Essay scoring: Automated Essay Scoring is the task of assigning a score to an essay, usually in the context of assessing the language ability of a language learner. The quality of an essay is affected by the following four primary dimensions: topic relevance, organization and coherence, word usage and sentence complexity, and grammar and mechanics.

Source: A Joint Model for Multimodal Document Quality Assessment

Datasets


Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation

webis-de/bea-24 24 Apr 2024

We evaluate both the AES performance that LLMs can achieve with prompting only and the helpfulness of the generated essay feedback.

0
24 Apr 2024

Autoregressive Score Generation for Multi-trait Essay Scoring

doheejin/arts 13 Mar 2024

Recently, encoder-only pre-trained models such as BERT have been successfully applied in automated essay scoring (AES) to predict a single overall score.

0
13 Mar 2024

Can Large Language Models Automatically Score Proficiency of Written Essays?

watheq9/aes-with-llms 10 Mar 2024

Although several methods were proposed to address the problem of automated essay scoring (AES) in the last 50 years, there is still much to desire in terms of effectiveness.

0
10 Mar 2024

VerAs: Verify then Assess STEM Lab Reports

psunlpgroup/veras 7 Feb 2024

With an increasing focus in STEM education on critical thinking skills, science writing plays an ever more important role in curricula that stress inquiry skills.

0
07 Feb 2024

From Automation to Augmentation: Large Language Models Elevating Essay Scoring Landscape

xiaochr/llm-aes 12 Jan 2024

Receiving immediate and personalized feedback is crucial for second-language learners, and Automated Essay Scoring (AES) systems are a vital resource when human instructors are unavailable.

7
12 Jan 2024

Unveiling the Tapestry of Automated Essay Scoring: A Comprehensive Investigation of Accuracy, Fairness, and Generalizability

carsonyang518/aaai24-aes-afg 11 Jan 2024

Automatic Essay Scoring (AES) is a well-established educational pursuit that employs machine learning to evaluate student-authored essays.

2
11 Jan 2024

Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task

michaeljohnilagan/aestrollhunting 30 Oct 2023

However, among users are trolls, who provide training examples with incorrect labels.

0
30 Oct 2023

Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks

liuwei1206/strusim 10 Jun 2023

Coherence is an important aspect of text quality, and various approaches have been applied to coherence modeling.

4
10 Jun 2023

Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring

doheejin/protact 26 May 2023

Thus, predicting various trait scores of unseen-prompt essays (called cross-prompt essay trait scoring) is a remaining challenge of AES.

13
26 May 2023

WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia

ken-ando/wikisqe 10 May 2023

Here, we propose WikiSQE, the first large-scale dataset for sentence quality estimation in Wikipedia.

1
10 May 2023