An ensemble deep learning model for author identification through multiple features

Abstract

One of the challenges in the natural language processing is authorship identification. The proposed research will improve the accuracy and stability of authorship identification by creating a new deep learning framework that combines the features of various types in a self-attentive weighted ensemble framework. Our approach enhances generalization to a great extent by combining a wide range of writing styles representations such as statistical features, TF-IDF vectors, and Word2Vec embeddings. The different sets of features are fed through separate Convolutional Neural Networks (CNN) so that the specific stylistic features can be extracted. More importantly, a self-attention mechanism is presented to smartly combine the results of these specialized CNNs so that the model can dynamically learn the significance of each type of features. The summation of the representation is then passed into a weighted SoftMax classifier with the aim of optimizing performance by taking advantage of the strengths of individual branches of the neural network. The suggested model was intensively tested on two different datasets, Dataset A, which included four authors, and Dataset B, which included thirty authors. Our method performed better than the baseline state-of-the-art methods by at least 3.09% and 4.45% on Dataset A and Dataset B respectively with accuracy of 80.29% and 78.44%, respectively. This self-attention-augmented multi-feature ensemble approach is very effective, with significant gains in state-of-the-art accuracy and robustness metrics of author identification.