[Re] Reproducibility study - Does enforcing diversity in hidden states of LSTM-Attention models improve transparency?

1 code implementation • RC 2020 • Frank Verhoef, Pieter Bouwman, Yun Li, Rogier van der Weerd

We follow four investigative routes: (i) Replication: we rerun experiments on datasets from the paper in order to replicate the results, and add the results that are missing in the paper; (ii) Code review: we scrutinize the code to validate its correctness; (iii) Evaluation methodology: we extend the set of evaluation metrics used in the paper with the LIME method, in an attempt to resolve inconclusive results; (iv) Generalization to other architectures: we test whether the authorsʼ claims apply to variations of the base model (more complex forms of attention and a BiLSTM encoder).

Navigate