Recommendation system for technology convergence opportunities based on self-supervised representation learning

Knowledge distillation for multi-depth-model-fusion recommendation algorithm

Recommendation algorithms save a lot of valuable time for people to get the information they are interested in. However, the feature calculation and extraction process of each machine learning or deep learning recommendation algorithm are different, so how to obtain various features with different dimensions, i.e., how to integrate the advantages of each model and improve the model inference efficiency, becomes the focus of this paper. In this paper, a better deep learning model is obtained by integrating several cutting-edge deep learning models. Meanwhile, to make the integrated learning model converge better and faster, the parameters of the integrated module are initialized, constraints are imposed, and a new activation function is designed for better integration of the sub-models. Finally, the integrated large model is distilled for knowledge distillation, which greatly reduces the number of model parameters and improves the model inference efficiency.

Sequential patent trading recommendation using knowledge-aware attentional bidirectional long short-term memory network (KBiLSTM)

With the rapid development of the patent marketplace, patent trading recommendation is required to mitigate the technology searching cost of patent buyers. Current research focuses on the recommendation based on existing patents of a company; a few studies take into account the sequential pattern of patent acquisition activities and the possible diversity of a company’s business interests. Moreover, the profiling of patents based on solely patent documents fails to capture the high-order information of patents. To bridge the gap, we propose a knowledge-aware attentional bidirectional long short-term memory network (KBiLSTM) method for patent trading recommendation. KBiLSTM uses knowledge graph embeddings to profile patents with rich patent information. It introduces bidirectional long short-term memory network (BiLSTM) to capture the sequential pattern in a company’s historical records. In addition, to address a company’s diverse technology interests, we design an attention mechanism to aggregate the company’s historical patents given a candidate patent. Experimental results on the United States Patent and Trademark Office (USPTO) data set show that KBiLSTM outperforms state-of-the-art baselines for patent trading recommendation in terms of F1 and normalised discounted cumulative gain (nDCG). The attention visualisation of randomly selected company intuitively demonstrates the recommendation effectiveness.