- Zhiting Hu, Zichao Yang, R. Salakhutdinov, E. Xing. 2016. Deep Neural Networks with Massive Learned Knowledge. Abstract: Regulating deep neural networks (DNNs) with human structured knowledge has shown to be of great beneﬁt for improved accuracy and interpretability. We develop a general framework that enables learning knowledge and its conﬁdence jointly with the DNNs, so that the vast amount of fuzzy knowledge can be incorporated and automatically optimized with little manual efforts. We apply the framework to sentence sentiment analysis, augmenting a DNN with massive linguistic constraints on discourse and polarity structures. Our model substantially enhances the performance using less training data, and shows improved inter-pretability. The principled framework can also be applied to posterior regularization for regulating other statistical models.
