1
|
Zheng Y, Qin J, Wei P, Chen Z, Lin L. CIPL: Counterfactual Interactive Policy Learning to Eliminate Popularity Bias for Online Recommendation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:17123-17136. [PMID: 37585330 DOI: 10.1109/tnnls.2023.3299929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/18/2023]
Abstract
Popularity bias, as a long-standing problem in recommender systems (RSs), has been fully considered and explored for offline recommendation systems in most existing relevant researches, but very few studies have paid attention to eliminate such bias in online interactive recommendation scenarios. Bias amplification will become increasingly serious over time due to the existence of feedback loop between the user and the interactive system. However, existing methods have only investigated the causal relations among different factors statically without considering temporal dependencies inherent in the online interactive recommendation system, making them difficult to be adapted to online settings. To address these problems, we propose a novel counterfactual interactive policy learning (CIPL) method to eliminate popularity bias for online recommendation. It first scrutinizes the causal relations in the interactive recommender models and formulates a novel temporal causal graph (TCG) to guide the training and counterfactual inference of the causal interactive recommendation system. Concretely, TCG is used to estimate the causal relations of item popularity on prediction score when the user interacts with the system at each time during model training. Besides, it is also used to remove the negative effect of popularity bias in the test stage. To train the causal interactive recommendation system, we formulated our CIPL by the actor-critic framework with an online interactive environment simulator. We conduct extensive experiments on three public benchmarks and the experimental results demonstrate that our proposed method can achieve the new state-of-the-art performance.
Collapse
|
2
|
Ou Z, Han Z, Liu P, Teng S, Song M. SIIR: Symmetrical Information Interaction Modeling for News Recommendation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:17111-17122. [PMID: 37578908 DOI: 10.1109/tnnls.2023.3299790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/16/2023]
Abstract
Accurate matching between user and candidate news plays a fundamental role in news recommendation. Most existing studies capture fine-grained user interests through effective user modeling. Nevertheless, user interest representations are often extracted from multiple history news items, while candidate news representations are learned from specific news items. The asymmetry of information density causes invalid matching of user interests and candidate news, which severely affects the click-through rate prediction for specific candidate news. To resolve the problems mentioned above, we propose a symmetrical information interaction modeling for news recommendation (SIIR) in this article. We first design a light interactive attention network for user (LIAU) modeling to extract user interests related to the candidate news and reduce interference of noise effectively. LIAU overcomes the shortcomings of complex structure and high training costs of conventional interaction-based models and makes full use of domain-specific interest tendencies of users. We then propose a novel heterogeneous graph neural network (HGNN) to enhance candidate news representation through the potential relations among news. HGNN builds a candidate news enhancement scheme without user interaction to further facilitate accurate matching with user interests, which mitigates the cold-start problem effectively. Experiments on two realistic news datasets, i.e., MIND and Adressa, demonstrate that SIIR outperforms the state-of-the-art (SOTA) single-model methods by a large margin.
Collapse
|
3
|
Zheng Y, Wei P, Chen Z, Tang C, Lin L. Routing User-Interest Markov Tree for Scalable Personalized Knowledge-Aware Recommendation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:14233-14246. [PMID: 37247310 DOI: 10.1109/tnnls.2023.3276395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
To facilitate more accurate and explainable recommendation, it is crucial to incorporate side information into user-item interactions. Recently, knowledge graph (KG) has attracted much attention in a variety of domains due to its fruitful facts and abundant relations. However, the expanding scale of real-world data graphs poses severe challenges. In general, most existing KG-based algorithms adopt exhaustively hop-by-hop enumeration strategy to search all the possible relational paths, this manner involves extremely high-cost computations and is not scalable with the increase of hop numbers. To overcome these difficulties, in this article, we propose an end-to-end framework Knowledge-tree-routed UseR-Interest Trajectories Network (KURIT-Net). KURIT-Net employs the user-interest Markov trees (UIMTs) to reconfigure a recommendation-based KG, striking a good balance for routing knowledge between short-distance and long-distance relations between entities. Each tree starts from the preferred items for a user and routes the association reasoning paths along the entities in the KG to provide a human-readable explanation for model prediction. KURIT-Net receives entity and relation trajectory embedding (RTE) and fully reflects potential interests of each user by summarizing all reasoning paths in a KG. Besides, we conduct extensive experiments on six public datasets, our KURIT-Net significantly outperforms state-of-the-art approaches and shows its interpretability in recommendation.
Collapse
|
4
|
He W, Xiao Y, Li T, Wang R, Li Q. Interest HD: An Interest Frame Model for Recommendation Based on HD Image Generation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:14356-14369. [PMID: 37267138 DOI: 10.1109/tnnls.2023.3278673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
This work is inspired by high-definition (HD) image generation techniques. When the user's interests are viewed as different frames of varying clarity, the unclear parts of one interest frame can be clarified by other interest frames. The user's overall HD interest portrait can be viewed as a fusion of multiple interest frames through detail compensation. Based on this inspiration, we propose a model for generating HD interest portrait called interest frame for recommendation (IF4Rec). First, we present a fine-grained pixel-level user interest mining method, Pixel embedding (PE) uses positional coding techniques to mine atomic-level interest pixel matrices in multiple dimensions, such as time, space, and frequency. Then, using an atomic-level interest pixel matrix, we propose Item2Frame to generate several interest frames for a user. The similarity score of each item is calculated to fill the multi-interest pixel clusters, through an improved self-attention mechanism. Finally, stimulated by HD image generation techniques, we initially present an interest frame noise compensation method. By utilizing the multihead attention mechanism, pixel-level optimization and noise complementation are performed between multi-interest frames, and an HD interest portrait is achieved. Experiments show that our model mines users' interests well. On five publicly available datasets, our model outperforms the baselines.
Collapse
|
5
|
Lin Y, Liu Y, Lin F, Zou L, Wu P, Zeng W, Chen H, Miao C. A Survey on Reinforcement Learning for Recommender Systems. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:13164-13184. [PMID: 37279123 DOI: 10.1109/tnnls.2023.3280161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Recommender systems have been widely applied in different real-life scenarios to help us find useful information. In particular, reinforcement learning (RL)-based recommender systems have become an emerging research topic in recent years, owing to the interactive nature and autonomous learning ability. Empirical results show that RL-based recommendation methods often surpass supervised learning methods. Nevertheless, there are various challenges in applying RL in recommender systems. To understand the challenges and relevant solutions, there should be a reference for researchers and practitioners working on RL-based recommender systems. To this end, we first provide a thorough overview, comparisons, and summarization of RL approaches applied in four typical recommendation scenarios, including interactive recommendation, conversational recommendation, sequential recommendation, and explainable recommendation. Furthermore, we systematically analyze the challenges and relevant solutions on the basis of existing literature. Finally, under discussion for open issues of RL and its limitations of recommender systems, we highlight some potential research directions in this field.
Collapse
|
6
|
Xie Y, Liu G, Yan C, Jiang C, Zhou M, Li M. Learning Transactional Behavioral Representations for Credit Card Fraud Detection. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:5735-5748. [PMID: 36197863 DOI: 10.1109/tnnls.2022.3208967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Credit card fraud detection is a challenging task since fraudulent actions are hidden in massive legitimate behaviors. This work aims to learn a new representation for each transaction record based on the historical transactions of users in order to capture fraudulent patterns accurately and, thus, automatically detect a fraudulent transaction. We propose a novel model by improving long short-term memory with a time-aware gate that can capture the behavioral changes caused by consecutive transactions of users. A current-historical attention module is designed to build up connections between current and historical transactional behaviors, which enables the model to capture behavioral periodicity. An interaction module is designed to learn comprehensive and rational behavioral representations. To validate the effectiveness of the learned behavioral representations, experiments are conducted on a large real-world transaction dataset provided to us by a financial company in China, as well as a public dataset. Experimental results and the visualization of the learned representations illustrate that our method delivers a clear distinction between legitimate behaviors and fraudulent ones, and achieves better fraud detection performance compared with the state-of-the-art methods.
Collapse
|
7
|
Roy R, Mazumdar S, Chowdhury AS. ADGAN: Attribute-Driven Generative Adversarial Network for Synthesis and Multiclass Classification of Pulmonary Nodules. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:2484-2495. [PMID: 35853058 DOI: 10.1109/tnnls.2022.3190331] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Lung cancer is the leading cause of cancer-related deaths worldwide. According to the American Cancer Society, early diagnosis of pulmonary nodules in computed tomography (CT) scans can improve the five-year survival rate up to 70% with proper treatment planning. In this article, we propose an attribute-driven Generative Adversarial Network (ADGAN) for synthesis and multiclass classification of Pulmonary Nodules. A self-attention U-Net (SaUN) architecture is proposed to improve the generation mechanism of the network. The generator is designed with two modules, namely, self-attention attribute module (SaAM) and a self-attention spatial module (SaSM). SaAM generates a nodule image based on given attributes whereas SaSM specifies the nodule region of the input image to be altered. A reconstruction loss along with an attention localization loss (AL) is used to produce an attention map prioritizing the nodule regions. To avoid resemblance between a generated image and a real image, we further introduce an adversarial loss containing a regularization term based on KL divergence. The discriminator part of the proposed model is designed to achieve the multiclass nodule classification task. Our proposed approach is validated over two challenging publicly available datasets, namely LIDC-IDRI and LUNGX. Exhaustive experimentation on these two datasets clearly indicate that we have achieved promising classification accuracy as compared to other state-of-the-art methods.
Collapse
|
8
|
Liu H, Guo Y, Yin J, Gao Z, Nie L. Review Polarity-Wise Recommender. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:10039-10050. [PMID: 35427224 DOI: 10.1109/tnnls.2022.3163789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The de facto review-involved recommender systems, using review information to enhance recommendation, have received increasing interest over the past years. Thereinto, one advanced branch is to extract salient aspects from textual reviews (i.e., the item attributes that users express) and combine them with the matrix factorization (MF) technique. However, the existing approaches all ignore the fact that semantically different reviews often include opposite aspect information. In particular, positive reviews usually express aspects that users prefer, while the negative ones describe aspects that users dislike. As a result, it may mislead the recommender systems into making incorrect decisions pertaining to user preference modeling. Toward this end, in this article, we present a review polarity-wise recommender model, dubbed as RPR, to discriminately treat reviews with different polarities. To be specific, in this model, positive and negative reviews are separately gathered and used to model the user-preferred and user-rejected aspects, respectively. Besides, to overcome the imbalance of semantically different reviews, we further develop an aspect-aware importance weighting strategy to align the aspect importance for these two kinds of reviews. Extensive experiments conducted on eight benchmark datasets have demonstrated the superiority of our model when compared with several state-of-the-art review-involved baselines. Moreover, our method can provide certain explanations to real-world rating prediction scenarios.
Collapse
|
9
|
Yang Z, Wang Y, Liu G, Li Z, Wang X. Recommendation model based on multi-grained interaction that fuses users’ dynamic interests. INT J MACH LEARN CYB 2023. [DOI: 10.1007/s13042-023-01821-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
10
|
An Efficient Model for Lungs Nodule Classification Using Supervised Learning Technique. JOURNAL OF HEALTHCARE ENGINEERING 2023; 2023:8262741. [PMID: 36785839 PMCID: PMC9922185 DOI: 10.1155/2023/8262741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 05/14/2022] [Accepted: 11/24/2022] [Indexed: 02/05/2023]
Abstract
Lung cancer has the highest death rate of any other cancer in the world. Detecting lung cancer early can increase a patient's survival rate. The corresponding work presents the method for improving the computer-aided detection (CAD) of nodules present in the lung area in computed tomography (CT) images. The main aim was to get an overview of the latest tools and technologies used: acquisition, storage, segmentation, classification, processing, and analysis of biomedical data. After the analysis, a model is proposed consisting of three main steps. In the first step, threshold values and component labeling of 3D components were used to segment the lung volume. In the second step, candidate nodules are identified and segmented with an optimal threshold value and rule-based trimming. It also selects 2D and 3D features from the candidate segmented node. In the final step, the selected features are used to train the SVM and classify the nodes and classify the non-nodes. To assess the performance of the proposed framework, experiments were performed on the LIDC data set. As a result, it was observed that the number of false positives in the nodule candidate was reduced to 4 FP per scan with a sensitivity of 95%.
Collapse
|
11
|
Han Y, Huang G, Song S, Yang L, Wang H, Wang Y. Dynamic Neural Networks: A Survey. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2022; 44:7436-7456. [PMID: 34613907 DOI: 10.1109/tpami.2021.3117837] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to different inputs, leading to notable advantages in terms of accuracy, computational efficiency, adaptiveness, etc. In this survey, we comprehensively review this rapidly developing area by dividing dynamic networks into three main categories: 1) sample-wise dynamic models that process each sample with data-dependent architectures or parameters; 2) spatial-wise dynamic networks that conduct adaptive computation with respect to different spatial locations of image data; and 3) temporal-wise dynamic models that perform adaptive inference along the temporal dimension for sequential data such as videos and texts. The important research problems of dynamic networks, e.g., architecture design, decision making scheme, optimization technique and applications, are reviewed systematically. Finally, we discuss the open problems in this field together with interesting future research directions.
Collapse
|
12
|
Wang D, Zhang X, Xiang Z, Yu D, Xu G, Deng S. Sequential Recommendation Based on Multivariate Hawkes Process Embedding With Attention. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:11893-11905. [PMID: 34097626 DOI: 10.1109/tcyb.2021.3077361] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Recommender systems are important approaches for dealing with the information overload problem in the big data era, and various kinds of auxiliary information, including time and sequential information, can help improve the performance of retrieval and recommendation tasks. However, it is still a challenging problem how to fully exploit such information to achieve high-quality recommendation results and improve users' experience. In this work, we present a novel sequential recommendation model, called multivariate Hawkes process embedding with attention (MHPE-a), which combines a temporal point process with the attention mechanism to predict the items that the target user may interact with according to her/his historical records. Specifically, the proposed approach MHPE-a can model users' sequential patterns in their temporal interaction sequences accurately with a multivariate Hawkes process. Then, we perform an accurate sequential recommendation to satisfy target users' real-time requirements based on their preferences obtained with MHPE-a from their historical records. Especially, an attention mechanism is used to leverage users' long/short-term preferences adaptively to achieve an accurate sequential recommendation. Extensive experiments are conducted on two real-world datasets (lastfm and gowalla), and the results show that MHPE-a achieves better performance than state-of-the-art baselines.
Collapse
|
13
|
Knowledge distillation for multi-depth-model-fusion recommendation algorithm. PLoS One 2022; 17:e0275955. [PMID: 36282818 PMCID: PMC9595540 DOI: 10.1371/journal.pone.0275955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 09/27/2022] [Indexed: 11/06/2022] Open
Abstract
Recommendation algorithms save a lot of valuable time for people to get the information they are interested in. However, the feature calculation and extraction process of each machine learning or deep learning recommendation algorithm are different, so how to obtain various features with different dimensions, i.e., how to integrate the advantages of each model and improve the model inference efficiency, becomes the focus of this paper. In this paper, a better deep learning model is obtained by integrating several cutting-edge deep learning models. Meanwhile, to make the integrated learning model converge better and faster, the parameters of the integrated module are initialized, constraints are imposed, and a new activation function is designed for better integration of the sub-models. Finally, the integrated large model is distilled for knowledge distillation, which greatly reduces the number of model parameters and improves the model inference efficiency.
Collapse
|
14
|
Yubo Z, Yingying L, Bing Z, Lin Z, Lei L. MMASleepNet: A multimodal attention network based on electrophysiological signals for automatic sleep staging. Front Neurosci 2022; 16:973761. [PMID: 36051650 PMCID: PMC9424881 DOI: 10.3389/fnins.2022.973761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 07/22/2022] [Indexed: 11/13/2022] Open
Abstract
Pandemic-related sleep disorders affect human physical and mental health. The artificial intelligence (AI) based sleep staging with multimodal electrophysiological signals help people diagnose and treat sleep disorders. However, the existing AI-based methods could not capture more discriminative modalities and adaptively correlate these multimodal features. This paper introduces a multimodal attention network (MMASleepNet) to efficiently extract, perceive and fuse multimodal features of electrophysiological signals. The MMASleepNet has a multi-branch feature extraction (MBFE) module followed by an attention-based feature fusing (AFF) module. In the MBFE module, branches are designed to extract multimodal signals' temporal and spectral features. Each branch has two-stream convolutional networks with a unique kernel to perceive features of different time scales. The AFF module contains a modal-wise squeeze and excitation (SE) block to adjust the weights of modalities with more discriminative features and a Transformer encoder (TE) to generate attention matrices and extract the inter-dependencies among multimodal features. Our MMASleepNet outperforms state-of-the-art models in terms of different evaluation matrices on the datasets of Sleep-EDF and ISRUC-Sleep. The implementation code is available at: https://github.com/buptantEEG/MMASleepNet/.
Collapse
Affiliation(s)
| | | | | | | | - Li Lei
- School of Artificial Intelligence, University of Posts and Telecommunications, Beijing, China
| |
Collapse
|
15
|
Zheng X, Ni Z, Zhong X, Luo Y. Kernelized Deep Learning for Matrix Factorization Recommendation System Using Explicit and Implicit Information. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; PP:1205-1216. [PMID: 35731766 DOI: 10.1109/tnnls.2022.3182942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In the current matrix factorization recommendation approaches, the item and the user latent factor vectors are with the same dimension. Thus, the linear dot product is used as the interactive function between the user and the item to predict the ratings. However, the relationship between real users and items is not entirely linear and the existing recommendation model of matrix factorization faces the challenge of data sparsity. To this end, we propose a kernelized deep neural network recommendation model in this article. First, we encode the explicit user-item rating matrix in the form of column vectors and project them to higher dimensions to facilitate the simulation of nonlinear user-item interaction for enhancing the connection between users and items. Second, the algorithm of association rules is used to mine the implicit relation between users and items, rather than simple feature extraction of users or items, for improving the recommendation performance when the datasets are sparse. Third, through the autoencoder and kernelized network processing, the implicit data are connected with the explicit data by the multilayer perceptron network for iterative training instead of doing simple linear weighted summation. Finally, the predicted rating is output through the hidden layer. Extensive experiments were conducted on four public datasets in comparison with several existing well-known methods. The experimental results indicated that our proposed method has obtained improved performance in data sparsity and prediction accuracy.
Collapse
|
16
|
Roy D, Dutta M. An Improved Cat Swarm Search-Based Deep Ensemble Learning Model for Group Recommender Systems. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT 2022. [DOI: 10.1142/s0219649222500320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Recommender systems are often employed in different fields such as music, travel, and movies. The recommender systems are broadly utilised nowadays due to the emergence of social activities, in which particular recommendations are offered by group recommender systems. It is a system for recommending the items to a set of users together based on their preferences. The user preferences are used from the behavioural and social aspects of group members to enhance the quality of products recommended in various groups for generating the group recommendations. These group recommender systems solve the cold start problem, which is raised in an individual recommendation system. The ultimate aim of this paper is to design and develop a new Improved Deep Ensemble Learning Model (ID-ELM) for the group recommender systems concerning different application-oriented datasets. Initially, the datasets from different applications like healthcare, e-commerce, and e-learning are gathered from benchmark sources and split the data into various groups. These data are given to the pre-processing for making it fit for further processing. The pre-processing steps like stop word removal, stemming, and punctuation removal are performed here. Then the features are extracted using the Continuous Bag of Words Model (CBOW), and Principal Component Analysis (PCA) is used for dimension reduction. These features are fed to the ID-ELM, in which the optimised Convolutional Neural Network (CNN) extracts the significant features from the pooling layer, and the fully connected layer is replaced by a set of classifiers termed Neural Networks (NN), AdaBoost, and Logistic Regression (LR). Finally, the ranking of the ensemble learning model based on the group reviews extends the recommendation outcome. The optimised CNN is proposed by the Adaptive Seeking Range-based Cat Swarm Optimisation (ASR-CSO) for attaining better results. This model is validated on the benchmark datasets to show the efficiency of the designed model with different meta-heuristic-based algorithms and classification algorithms.
Collapse
Affiliation(s)
- Deepjyoti Roy
- Computer Science and Engineering, Assam Down Town University, Guwahati, Assam, India
| | - Mala Dutta
- Computer Science and Engineering, Assam Down Town University, Guwahati, Assam, India
| |
Collapse
|
17
|
Sousa D, Couto FM. Biomedical Relation Extraction with Knowledge Graph-based Recommendations. IEEE J Biomed Health Inform 2022; 26:4207-4217. [PMID: 35536818 DOI: 10.1109/jbhi.2022.3173558] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Biomedical Relation Extraction (RE) systems identify and classify relations between biomedical entities to enhance our knowledge of biological and medical processes. Most state-of-the-art systems use deep learning approaches, mainly to target relations between entities of the same type, such as proteins or pharmacological substances. However, these systems are mostly restricted to what they directly identify on the text and ignore specialized domain knowledge bases, such as ontologies, that formalize and integrate biomedical information typically structured as direct acyclic graphs. On the other hand, Knowledge Graph (KG)-based recommendation systems already showed the importance of integrating KGs to add additional features to items. Typical systems have users as people and items that can range from movies to books, which people saw or read and classified according to their satisfaction rate. This work proposes to integrate KGs into biomedical RE through a recommendation model to further improve their range of action. We developed a new RE system, named K-BiOnt, by integrating a baseline state-of-the-art deep biomedical RE system with an existing KG-based recommendation state-of-the-art system. Our results show that adding recommendations from KG-based recommendation improves the system's ability to identify true relations that the baseline deep RE model could not extract from the text. All the software and data supporting our work will be made publicly available upon acceptance of this manuscript.
Collapse
|
18
|
Buckwheat Disease Recognition Based on Convolution Neural Network. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Buckwheat is an important cereal crop with high nutritional and health value. Buckwheat disease greatly affects the quality and yield of buckwheat. The real-time monitoring of disease is an essential part of ensuring the development of the buckwheat industry. In this research work, we proposed an automated way to identify buckwheat diseases. It was achieved by integrating a convolutional neural network (CNN) with the image processing technology. Firstly, the proposed approach would detect the buckwheat disease area accurately. Then, to improve the accuracy of classification, a two-level inception structure was added to the traditional convolutional neural network for accurate feature extraction. It also helps to handle low-quality image problems, which includes complex imaging environment and leaf crossing in sampling buckwheat image, etc. At the same time, instead of the traditional convolution, the convolution based on cosine similarity was adopted to reduce the influence of uneven illumination during the imaging. The experiment proved that the revised convolution enabled better feature extraction within samples with uneven illumination. Finally, the experiment results showed that the accuracy, recall, and F1-measure of the disease detection reached 97.54, 96.38, and 97.82%, respectively. For identifying disease categories, the mean values of precision, recall, and F1-measure were 84.86, 85.78, and 85.4%. Our method has provided important technical support for realizing the automatic recognition of buckwheat diseases.
Collapse
|
19
|
Abolghasemi R, Engelstad P, Herrera-Viedma E, Yazidi A. A personality-aware group recommendation system based on pairwise preferences. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.02.033] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
20
|
|
21
|
Wang P, Li L, Xie Q, Wang R, Xu G. Social dual-effect driven group modeling for neural group recommendation. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.01.093] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
22
|
A hybrid group-based movie recommendation framework with overlapping memberships. PLoS One 2022; 17:e0266103. [PMID: 35358269 PMCID: PMC8970527 DOI: 10.1371/journal.pone.0266103] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Accepted: 03/14/2022] [Indexed: 11/19/2022] Open
Abstract
Recommender Systems (RS) are widely used to help people or group of people in finding their required information amid the issue of ever-growing information overload. The existing group recommender approaches consider users to be part of a single group only, but in real life a user may be associated with multiple groups having conflicting preferences. For instance, a person may have different preferences in watching movies with friends than with family. In this paper, we address this problem by proposing a Hybrid Two-phase Group Recommender Framework (HTGF) that takes into consideration the possibility of users having simultaneous membership of multiple groups. Unlike the existing group recommender systems that use traditional methods like K-Means, Pearson correlation, and cosine similarity to form groups, we use Fuzzy C-means clustering which assigns a degree of membership to each user for each group, and then Pearson similarity is used to form groups. We demonstrate the usefulness of our proposed framework using a movies data set. The experiments were conducted on MovieLens 1M dataset where we used Neural Collaborative Filtering to recommend Top-k movies to each group. The results demonstrate that our proposed framework outperforms the traditional approaches when compared in terms of group satisfaction parameters, as well as the conventional metrics of precision, recall, and F-measure.
Collapse
|
23
|
Tan Z, Chen J, Kang Q, Zhou M, Abusorrah A, Sedraoui K. Dynamic Embedding Projection-Gated Convolutional Neural Networks for Text Classification. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:973-982. [PMID: 33417564 DOI: 10.1109/tnnls.2020.3036192] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Text classification is a fundamental and important area of natural language processing for assigning a text into at least one predefined tag or category according to its content. Most of the advanced systems are either too simple to get high accuracy or centered on using complex structures to capture the genuinely required category information, which requires long time to converge during their training stage. In order to address such challenging issues, we propose a dynamic embedding projection-gated convolutional neural network (DEP-CNN) for multi-class and multi-label text classification. Its dynamic embedding projection gate (DEPG) transforms and carries word information by using gating units and shortcut connections to control how much context information is incorporated into each specific position of a word-embedding matrix in a text. To our knowledge, we are the first to apply DEPG over a word-embedding matrix. The experimental results on four known benchmark datasets display that DEP-CNN outperforms its recent peers.
Collapse
|
24
|
Liao G, Deng X, Wan C, Liu X. Group event recommendation based on graph multi-head attention network combining explicit and implicit information. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2021.102797] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
25
|
Guo L, Yin H, Chen T, Zhang X, Zheng K. Hierarchical Hyperedge Embedding-Based Representation Learning for Group Recommendation. ACM T INFORM SYST 2022. [DOI: 10.1145/3457949] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Abstract
Group recommendation aims to recommend items to a group of users. In this work, we study group recommendation in a particular scenario, namely occasional group recommendation, where groups are formed ad hoc and users may just constitute a group for the first time—that is, the historical group-item interaction records are highly limited. Most state-of-the-art works have addressed the challenge by aggregating group members’ personal preferences to learn the group representation. However, the representation learning for a group is most complex beyond the aggregation or fusion of group member representation, as the personal preferences and group preferences may be in different spaces and even orthogonal. In addition, the learned user representation is not accurate due to the sparsity of users’ interaction data. Moreover, the group similarity in terms of common group members has been overlooked, which, however, has the great potential to improve the group representation learning. In this work, we focus on addressing the aforementioned challenges in the group representation learning task, and devise a hierarchical hyperedge embedding-based group recommender, namely HyperGroup. Specifically, we propose to leverage the user-user interactions to alleviate the sparsity issue of user-item interactions, and design a graph neural network-based representation learning network to enhance the learning of individuals’ preferences from their friends’ preferences, which provides a solid foundation for learning groups’ preferences. To exploit the group similarity (i.e., overlapping relationships among groups) to learn a more accurate group representation from highly limited group-item interactions, we connect all groups as a network of overlapping sets (a.k.a. hypergraph), and treat the task of group preference learning as embedding hyperedges (i.e., user sets/groups) in a hypergraph, where an inductive hyperedge embedding method is proposed. To further enhance the group-level preference modeling, we develop a joint training strategy to learn both user-item and group-item interactions in the same process. We conduct extensive experiments on two real-world datasets, and the experimental results demonstrate the superiority of our proposed HyperGroup in comparison to the state-of-the-art baselines.
Collapse
Affiliation(s)
- Lei Guo
- Shandong Normal University, Jinan, China
| | - Hongzhi Yin
- The University of Queensland, Brisbane, QLD, Australia
| | - Tong Chen
- The University of Queensland, Brisbane, QLD, Australia
| | - Xiangliang Zhang
- King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
| | - Kai Zheng
- University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
26
|
Huang Z, Lin Z, Gong Z, Chen Y, Tang Y. A two‐phase knowledge distillation model for graph convolutional network‐based recommendation. INT J INTELL SYST 2022. [DOI: 10.1002/int.22819] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Zhenhua Huang
- School of Computer Science South China Normal University Guangzhou China
| | - Zuorui Lin
- School of Computer Science South China Normal University Guangzhou China
| | - Zheng Gong
- School of Computer Science South China Normal University Guangzhou China
| | - Yunwen Chen
- Research and Development Department DataGrand Inc. Shenzhen China
| | - Yong Tang
- School of Computer Science South China Normal University Guangzhou China
| |
Collapse
|
27
|
Research on Video Quality Evaluation of Sparring Motion Based on BPNN Perception. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2021:9615290. [PMID: 34987571 PMCID: PMC8723849 DOI: 10.1155/2021/9615290] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/25/2021] [Revised: 10/19/2021] [Accepted: 10/23/2021] [Indexed: 11/17/2022]
Abstract
The quality of boxing video is affected by many factors. For example, it needs to be compressed and encoded before transmission. In the process of transmission, it will encounter network conditions such as packet loss and jitter, which will affect the video quality. Combined with the proposed nine characteristic parameters affecting video quality, this paper proposes an architecture of video quality evaluation system. Aiming at the compression damage and transmission damage of leisure sports video, a video quality evaluation algorithm based on BP neural network (BPNN) is proposed. A specific Wushu video quality evaluation algorithm system is implemented. The system takes the result of feature engineering of 9 feature parameters of boxing video as the input and the subjective quality score of video as the training output. The mapping relationship is established by BPNN algorithm, and the objective evaluation quality of boxing video is finally obtained. The results show that using the neural network analysis model, the characteristic parameters of compression damage and transmission damage used in this paper can get better evaluation results. Compared with the comparison algorithm, the accuracy of the video quality evaluation method proposed in this paper has been greatly improved. The subjective characteristics of users are evaluated quantitatively and added to the objective video quality evaluation model in this paper, so as to make the video evaluation more accurate and closer to users.
Collapse
|
28
|
Ni J, Huang Z, Hu Y, Lin C. A two-stage embedding model for recommendation with multimodal auxiliary information. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.09.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
29
|
Detection of spam reviews through a hierarchical attention architecture with N-gram CNN and Bi-LSTM. INFORM SYST 2022. [DOI: 10.1016/j.is.2021.101865] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
30
|
Ma L, Yang T. Construction and Evaluation of Intelligent Medical Diagnosis Model Based on Integrated Deep Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:7171816. [PMID: 34868296 PMCID: PMC8639276 DOI: 10.1155/2021/7171816] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 09/06/2021] [Accepted: 09/11/2021] [Indexed: 11/18/2022]
Abstract
In recent years, as human life expectancy increases, birth rate decreases and health management concerns; the traditional Healthcare imaging system, with its uneven Healthcare imaging resources, high Healthcare imaging costs, and diagnoses often relying on doctors' clinical experience and equipment level limitations, has affected people's demand for health, so there is a need for a more accurate, convenient, and affordable Healthcare imaging system that allows all people to enjoy fair and quality Healthcare imaging services. This paper discusses the construction and evaluation of an intelligent medical diagnostic model based on integrated deep neural networks, which not only provides a systematic diagnostic analysis of the various symptoms input by the inquirer but also has higher accuracy and efficiency compared with traditional medical diagnostic models. The construction of this model provides a theoretical basis for integrating deep neural networks applied to medical neighborhoods with big data algorithms.
Collapse
Affiliation(s)
- Lina Ma
- Henan Medical College, Zhengzhou, Henan 451191, China
| | - Tao Yang
- Henan University of Traditional Chinese Medicine, Zhengzhou, Henan 450000, China
| |
Collapse
|
31
|
Zhang Q, Chong CW, Abdullah AR, Ali MH. International Trade Path with Multi-Polarization based on Multidirectional Mutation Genetic Algorithm Enabled Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:1370180. [PMID: 34691167 PMCID: PMC8531821 DOI: 10.1155/2021/1370180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 09/14/2021] [Accepted: 09/16/2021] [Indexed: 11/28/2022]
Abstract
At present, the development speed of international trade cannot catch up with the economic development speed, and the insufficient development speed of international trade will directly affect the rapid development of national economy. In order to solve the problem of international trade, the overall optimal scheduling of trade vehicles and the optimal planning of trade transportation path are very important to improve enterprise services, reduce enterprise costs, increase enterprise benefits, and enhance enterprise competitiveness. The second development of the program is based on the programming interface provided by Baidu map. This paper proposes a neural network algorithm for genetic optimization of multiple mutations, which overcomes the shortcoming of traditional genetic algorithm population "ten" character distribution by mixing multiple coding methods, and enhances the local search ability of genetic algorithm by introducing a new large-mutation small-range search population. The example application shows that the optimization method can realize the optimization of international trade path under real road conditions and greatly improve the work efficiency of actual trade.
Collapse
Affiliation(s)
- Qing Zhang
- School of Business and Economics University Putra Malaysia, Serdang, Selangor Darul Ehsan 43400, Malaysia
| | - Choo Wei Chong
- School of Business and Economics University Putra Malaysia, Serdang, Selangor Darul Ehsan 43400, Malaysia
| | - Abdul Rashid Abdullah
- School of Business and Economics University Putra Malaysia, Serdang, Selangor Darul Ehsan 43400, Malaysia
| | - Mass Hareeza Ali
- School of Business and Economics University Putra Malaysia, Serdang, Selangor Darul Ehsan 43400, Malaysia
| |
Collapse
|
32
|
|
33
|
Evolving Container to Unikernel for Edge Computing and Applications in Process Industry. Processes (Basel) 2021. [DOI: 10.3390/pr9020351] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022] Open
Abstract
Industry 4.0 promotes manufacturing and process industry towards digitalization and intellectualization. Edge computing can provide delay-sensitive services in industrial processes to realize intelligent production. Lightweight virtualization technology is one of the key elements of edge computing, which can implement resource management, orchestration, and isolation services without considering heterogenous hardware. It has revolutionized software development and deployment. The scope of this review paper is to present an in-depth analysis of two such technologies, Container and Unikernel, for edge computing. We discuss and compare their applicability in terms of migration, security, and orchestration for edge computing and industrial applications. We describe their performance indexes, evaluation methods and related findings. We then discuss their applications in industrial processes. To promote further research, we present some open issues and challenges to serve as a road map for both researchers and practitioners in the areas of Industry 4.0, industrial process automation, and advanced computing.
Collapse
|
34
|
Ni J, Huang Z, Cheng J, Gao S. An effective recommendation model based on deep representation learning. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2020.07.038] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
35
|
Wang T, Wang K, Su X. Fault localization by analyzing failure propagation with samples in cloud computing environment. JOURNAL OF CLOUD COMPUTING: ADVANCES, SYSTEMS AND APPLICATIONS 2020. [DOI: 10.1186/s13677-020-00164-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
AbstractWith the development of information technology such as cloud computing, IoT, etc, software becomes the infrastructure. On the one hand, it is critical to ensure the reliability of software, on the other, sample code can be mined from open source software to provide reference for automatic debugging. Most of existing automated debugging researches are based on the assumption that defect programs are nearly correct, therefore they can successfully pass some test cases and fail to execute others. However, this assumption sometimes does not hold. In view of the fact that a programs may fail for all the given test cases in the test suite, but there are a large number of examples available for reference, a sample based fault localization method is studied. A fault localization method by analyzing the context of failure propagation is proposed, which locates suspicious statements by identifying the execution status and structural semantics differences between the defective program and sample program. Through the interactive analysis of value sequences and structure semantics, the influence of code variations and failure propagation is reduced. The experimental results have shown that the method can effectively locate suspicious statements and provide assistance for defect repair when there are enough sample programs.
Collapse
|
36
|
Zhu H, Liu G, Zhou M, Xie Y, Abusorrah A, Kang Q. Optimizing Weighted Extreme Learning Machines for imbalanced classification and application to credit card fraud detection. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.04.078] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
37
|
Lye GX, Cheng WK, Tan TB, Hung CW, Chen YL. Creating Personalized Recommendations in a Smart Community by Performing User Trajectory Analysis through Social Internet of Things Deployment. SENSORS 2020; 20:s20072098. [PMID: 32276431 PMCID: PMC7181154 DOI: 10.3390/s20072098] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 04/02/2020] [Accepted: 04/03/2020] [Indexed: 11/16/2022]
Abstract
Despite advancements in the Internet of Things (IoT) and social networks, developing an intelligent service discovery and composition framework in the Social IoT (SIoT) domain remains a challenge. In the IoT, a large number of things are connected together according to the different objectives of their owners. Due to this extensive connection of heterogeneous objects, generating a suitable recommendation for users becomes very difficult. The complexity of this problem exponentially increases when additional issues, such as user preferences, autonomous settings, and a chaotic IoT environment, must be considered. For the aforementioned reasons, this paper presents an SIoT architecture with a personalized recommendation framework to enhance service discovery and composition. The novel contribution of this study is the development of a unique personalized recommender engine that is based on the knowledge–desire–intention model and is suitable for service discovery in a smart community. Our algorithm provides service recommendations with high satisfaction by analyzing data concerning users’ beliefs and surroundings. Moreover, the algorithm eliminates the prevalent cold start problem in the early stage of recommendation generation. Several experiments and benchmarking on different datasets are conducted to investigate the performance of the proposed personalized recommender engine. The experimental precision and recall results indicate that the proposed approach can achieve up to an approximately 28% higher F-score than conventional approaches. In general, the proposed hybrid approach outperforms other methods.
Collapse
Affiliation(s)
- Guang Xing Lye
- Faculty of Information and Communication Technology, Universiti Tunku Abdul Rahman, 31900 Kampar, Perak, Malaysia; (G.X.L.); (W.K.C.); (T.B.T.); (C.W.H.)
| | - Wai Khuen Cheng
- Faculty of Information and Communication Technology, Universiti Tunku Abdul Rahman, 31900 Kampar, Perak, Malaysia; (G.X.L.); (W.K.C.); (T.B.T.); (C.W.H.)
| | - Teik Boon Tan
- Faculty of Information and Communication Technology, Universiti Tunku Abdul Rahman, 31900 Kampar, Perak, Malaysia; (G.X.L.); (W.K.C.); (T.B.T.); (C.W.H.)
| | - Chen Wei Hung
- Faculty of Information and Communication Technology, Universiti Tunku Abdul Rahman, 31900 Kampar, Perak, Malaysia; (G.X.L.); (W.K.C.); (T.B.T.); (C.W.H.)
| | - Yen-Lin Chen
- Department of Computer Science and Information Engineering, National Taipei University of Technology, 1, Sec. 3, Chung-hsiao E. Rd., Taipei 10608, Taiwan
- Correspondence: ; Tel.: +886-2-2771-2171 (ext. 4239)
| |
Collapse
|