Automated Essay Scoring based on Two-Stage Learning
Published in
arXiv.org(2019)External Links:
TL
TL;DR
After adding some adversarial essays to the original datasets, TSLF outperforms the feature-engineered and end-to-end baselines to a great extent, and shows great robustness.
Abstract
Current state-of-art feature-engineered and end-to-end Automated Essay Score (AES) methods are proven to be unable to detect adversarial samples, e.g. the essays composed of permuted sentences and the prompt-irrelevant essays. Focusing on the problem, we develop a Two-Stage Learning Framework (TSLF) which integrates the advantages of both feature-engineered and end-to-end AES models. In experiments, we compare TSLF against a number of strong baselines, and the results demonstrate the effectiveness and robustness of our models. TSLF surpasses all the baselines on five-eighths of prompts and achieves new state-of-the-art average performance when without negative samples. After adding some adversarial essays to the original datasets, TSLF outperforms the feature-engineered and end-to-end baselines to a great extent, and shows great robustness.
References17 items
1
TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring
2
Fluency Boost Learning and Inference for Neural Grammatical Error Correction
3
Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input
4
Automated essay scoring with string kernels and word embeddings
5