Field-Aware Click-Through Rate Prediction Model Based on Attention Mechanism

Click-Through Rate(CTR) prediction is one of the most important tools for ad placement.Predicting the CTR of an ad and making recommendations to users can increase ad revenue.Field-aware click-through rate prediction models are superior to other click-through rate prediction models because they consider the field information; however, they generate a large amount of redundant information during feature interaction, which results in a low prediction accuracy.A Field-aware Attention Embedding Neural Network(FAENN) model is herein proposed.This model uses a Self-Attentive Mechanism(SAM) to distribute weights to the input vectors of the embedding layer.This helps to clearly identify the importance of the field-aware embedded features, speeding up the training process.The lower-order feature interaction layer focuses on the explicit first-order information of the features and the second-order interaction feature information and outputs the effective features to the higher-order interaction layer.The higher-order feature interaction layer combines the learned interaction vectors with the deep neural network to capture higher-order feature interactions to improve prediction accuracy.The experimental results show that the FAENN model has a higher prediction accuracy than the FM, FFM, and AFM models.