Improving Review Representations with User Attention and Product Attention for Sentiment Classification

24 Jan 2018  ·  Zhen Wu, Xin-yu Dai, Cunyan Yin, Shu-Jian Huang, Jia-Jun Chen ·

Neural network methods have achieved great success in reviews sentiment classification. Recently, some works achieved improvement by incorporating user and product information to generate a review representation. However, in reviews, we observe that some words or sentences show strong user's preference, and some others tend to indicate product's characteristic. The two kinds of information play different roles in determining the sentiment label of a review. Therefore, it is not reasonable to encode user and product information together into one representation. In this paper, we propose a novel framework to encode user and product information. Firstly, we apply two individual hierarchical neural networks to generate two representations, with user attention or with product attention. Then, we design a combined strategy to make full use of the two representations for training and final prediction. The experimental results show that our model obviously outperforms other state-of-the-art methods on IMDB and Yelp datasets. Through the visualization of attention over words related to user or product, we validate our observation mentioned above.

PDF Abstract


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Sentiment Analysis User and product information HUAPA IMDB (Acc) 55.0 # 3
Yelp 2013 (Acc) 68.3 # 2
Yelp 2014 (Acc) 68.6 # 3


No methods listed for this paper. Add relevant methods here