1
|
Yu P, Zheng Y, Liu Z, Wei B, Zhang W, Lin Z, Li Z. Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction. ENTROPY (BASEL, SWITZERLAND) 2025; 27:94. [PMID: 39851714 PMCID: PMC11764816 DOI: 10.3390/e27010094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 01/17/2025] [Accepted: 01/17/2025] [Indexed: 01/26/2025]
Abstract
With the development of intelligent technology, data in practical applications show exponential growth in quantity and scale. Extracting the most distinguished attributes from complex datasets becomes a crucial problem. The existing attribute reduction approaches focus on the correlation between attributes and labels without considering the redundancy. To address the above problem, we propose an ensemble approach based on an incremental information level and improved evidence theory for attribute reduction (IILE). Firstly, the incremental information level reduction measure comprehensively assesses attributes based on reduction capability and redundancy level. Then, an improved evidence theory and approximate reduction methods are employed to fuse multiple reduction results, thereby obtaining an approximately globally optimal and a most representative subset of attributes. Eventually, using different metrics, experimental comparisons are performed on eight datasets to confirm that our proposal achieved better than other methods. The results show that our proposal can obtain more relevant attribute sets by using the incremental information level and improved evidence theory.
Collapse
Affiliation(s)
- Peng Yu
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Yifeng Zheng
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Ziwen Liu
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Baoya Wei
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Wenjie Zhang
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Ziqiong Lin
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| | - Zhehan Li
- School of Computer Science, Minnan Normal University, Zhangzhou 363000, China; (P.Y.); (Y.Z.); (Z.L.); (W.Z.); (Z.L.); (Z.L.)
- Key Laboratory of Data Science and Intelligence Application, Fujian Province University, Zhangzhou 363000, China
| |
Collapse
|
2
|
Li Y, Zhang B, Mo H, Hu J, Liu Y, Tan X. Unsupervised attribute reduction based on variable precision weighted neighborhood dependency. iScience 2024; 27:111270. [PMID: 39660055 PMCID: PMC11629270 DOI: 10.1016/j.isci.2024.111270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 08/18/2024] [Accepted: 10/24/2024] [Indexed: 12/12/2024] Open
Abstract
Neighborhood rough set (NRS) have been successfully applied to attribute reduction (AR). However, most current methods of AR based on NRS are supervised or semi-supervised. This limits their ability to process data without decision information. When granulating data samples, NRS considers only the number of samples within the neighborhood radius. It does not consider distribution information between samples, which can result in the loss of original data information. To address the aforementioned issue, we propose an unsupervised attribute reduction (UAR) strategy based on variable precision weighted neighborhood dependency (VPWND) (UAR_VPWND). We compare algorithm UAR_VPWND to existing classical UAR algorithms using public datasets. The experimental results show that algorithm UAR_VPWND can select fewer attributes to maintain or improve the performance of clustering learning algorithms.
Collapse
Affiliation(s)
- Yi Li
- Institute of Computer Application Research, Sichuan Minzu College, Kangding 626001, China
| | - Benwen Zhang
- Institute of Computer Application Research, Sichuan Minzu College, Kangding 626001, China
| | - Hongming Mo
- Institute of Computer Application Research, Sichuan Minzu College, Kangding 626001, China
| | - Jiancheng Hu
- College of Applied Mathematics, Chengdu University of Information Technology, Chengdu 610225, China
| | - Yuncheng Liu
- School of Mathematics, Southwest Minzu University, Chengdu 610041, China
| | - Xingqiang Tan
- Institute of Computer Application Research, Sichuan Minzu College, Kangding 626001, China
| |
Collapse
|
3
|
Yuan K, Miao D, Pedrycz W, Zhang H, Hu L. Multigranularity Data Analysis With Zentropy Uncertainty Measure for Efficient and Robust Feature Selection. IEEE TRANSACTIONS ON CYBERNETICS 2024; PP:740-752. [PMID: 40030537 DOI: 10.1109/tcyb.2024.3499952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Multigranularity data analysis has recently become an active research topic in the intelligent computing and data mining fields. Feature selection via multigranularity data analysis is an effective tool for characterizing hierarchical data and enhancing the accuracy of the results. Although the multigranularity data analysis method has been widely adopted for feature selection, existing studies still present one prevalent disadvantage: multigranularity data analysis mostly focuses on information presented at a single granularity while ignoring the hierarchical structure of multigranularity data, which is contrary to the nature of multigranularity. Hence, this article proposes a multigranularity data analysis with a zentropy uncertainty measure for efficient and robust feature selection. Specifically, a consistent degree is first introduced to obtain optimal granularity combinations and establish an efficient neighborhood model for multigranularity information processing. Then, a novel and robust uncertainty measure is developed by integrating the multigranularity information, namely the zentropy-based measure. Considering its accuracy among uncertainty measures, two important measures are further designed and applied to feature selection. Extensive experiments demonstrate that the proposed method can achieve better robustness and classification performance than other state-of-the-art methods.
Collapse
|
4
|
Pamučar D, Puška A, Simić V, Stojanović I, Deveci M. Selection of healthcare waste management treatment using fuzzy rough numbers and Aczel-Alsina Function. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2023; 121:106025. [PMID: 36908983 PMCID: PMC9985309 DOI: 10.1016/j.engappai.2023.106025] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 01/04/2023] [Accepted: 02/18/2023] [Indexed: 06/18/2023]
Abstract
The COVID-19 pandemic led to an increase in healthcare waste (HCW). HCW management treatment needs to be re-taken into focus to deal with this challenge. In practice, there are several treatments of HCW with their advantages and disadvantages. This study is conducted to select the appropriate treatment for HCW in the Brčko District of Bosnia and Herzegovina. Six HCW management treatments are analyzed and observed through twelve criteria. Ten-level linguistic values were used to bring this evaluation closer to human thinking. A fuzzy rough approach is used to solve the problem of inaccuracy in determining these values. The OPA method from the Bonferroni operator is used to determine the weights of the criteria. The results of the application of this method showed that the criterion Environmental Impact ( C 4 ) received the highest weight, while the criterion Automation Level ( C 8 ) received the lowest value. The ranking of HCW management treatments was performed using MARCOS methods based on the Aczel-Alsina function. The results of this analysis showed that the best-ranked HCW management treatment is microwave (A6) while landfill treatment (A5) is ranked worst. This study has provided a new approach based on fuzzy rough numbers where the Bonferroni function is used to determine the lower and upper limits, while the application of the Aczel-Alsina function reduced the influence of decision-makers on the final decision because this function stabilizes the decision-making process.
Collapse
Affiliation(s)
- Dragan Pamučar
- Department of Operations Research and Statistics, Faculty of Organizational Sciences, University of Belgrade, 11000, Belgrade, Serbia
- College of Engineering, Yuan Ze University, Taiwan
| | - Adis Puška
- Government of Brčko District, Department of Public Safety, Bosnia and Herzegovina
| | - Vladimir Simić
- University of Belgrade, Faculty of Transport and Traffic Engineering, Vojvode Stepe 305, 11000 Belgrade, Serbia
| | - Ilija Stojanović
- American University in the Emirates, Dubai International Academic City, Block 6 & 7, P.O. Box: 503000, United Arab Emirates
| | - Muhammet Deveci
- Turkish Naval Academy, National Defence University, Department of Industrial Engineering, 34940, Tuzla, Istanbul, Turkey
- The Bartlett School of Sustainable Construction, University College London, 1-19 Torrington Place, London WC1E 7HB, UK
| |
Collapse
|
5
|
An in-depth and contrasting survey of meta-heuristic approaches with classical feature selection techniques specific to cervical cancer. Knowl Inf Syst 2023. [DOI: 10.1007/s10115-022-01825-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
6
|
Gaeta A, Loia V, Lomasto L, Orciuoli F. A novel approach based on rough set theory for analyzing information disorder. APPL INTELL 2022; 53:15993-16014. [PMID: 36471689 PMCID: PMC9713159 DOI: 10.1007/s10489-022-04283-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/18/2022] [Indexed: 12/04/2022]
Abstract
The paper presents and evaluates an approach based on Rough Set Theory, and some variants and extensions of this theory, to analyze phenomena related to Information Disorder. The main concepts and constructs of Rough Set Theory, such as lower and upper approximations of a target set, indiscernibility and neighborhood binary relations, are used to model and reason on groups of social media users and sets of information that circulate in the social media. Information theoretic measures, such as roughness and entropy, are used to evaluate two concepts, Complexity and Milestone, that have been borrowed by system theory and contextualized for Information Disorder. The novelty of the results presented in this paper relates to the adoption of Rough Set Theory constructs and operators in this new and unexplored field of investigation and, specifically, to model key elements of Information Disorder, such as the message and the interpreters, and reason on the evolutionary dynamics of these elements. The added value of using these measures is an increase in the ability to interpret the effects of Information Disorder, due to the circulation of news, as the ratio between the cardinality of lower and upper approximations of a Rough Set, cardinality variations of parts, increase in their fragmentation or cohesion. Such improved interpretative ability can be beneficial to social media analysts and providers. Four algorithms based on Rough Set Theory and some variants or extensions are used to evaluate the results in a case study built with real data used to contrast disinformation for COVID-19. The achieved results allow to understand the superiority of the approaches based on Fuzzy Rough Sets for the interpretation of our phenomenon.
Collapse
Affiliation(s)
- Angelo Gaeta
- Dipartimento di Scienze Aziendali - Management & Innovation Systems (DISA-MIS), Università degli Studi di Salerno, Via Giovanni Paolo II, 132, 84084 Fisciano Italy
| | - Vincenzo Loia
- Dipartimento di Scienze Aziendali - Management & Innovation Systems (DISA-MIS), Università degli Studi di Salerno, Via Giovanni Paolo II, 132, 84084 Fisciano Italy
| | - Luigi Lomasto
- Ministero dell’Istruzione, ISS Manlio Rossi Doria, Via Manlio Rossi Doria Marigliano, Napoli, Italy
| | - Francesco Orciuoli
- Dipartimento di Scienze Aziendali - Management & Innovation Systems (DISA-MIS), Università degli Studi di Salerno, Via Giovanni Paolo II, 132, 84084 Fisciano Italy
| |
Collapse
|
7
|
Xing J, Zhao H, Chen H, Deng R, Xiao L. Boosting Whale Optimizer with Quasi-Oppositional Learning and Gaussian Barebone for Feature Selection and COVID-19 Image Segmentation. JOURNAL OF BIONIC ENGINEERING 2022; 20:797-818. [PMID: 36466725 PMCID: PMC9707266 DOI: 10.1007/s42235-022-00297-8] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 10/09/2022] [Accepted: 10/19/2022] [Indexed: 06/17/2023]
Abstract
UNLABELLED Whale optimization algorithm (WOA) tends to fall into the local optimum and fails to converge quickly in solving complex problems. To address the shortcomings, an improved WOA (QGBWOA) is proposed in this work. First, quasi-opposition-based learning is introduced to enhance the ability of WOA to search for optimal solutions. Second, a Gaussian barebone mechanism is embedded to promote diversity and expand the scope of the solution space in WOA. To verify the advantages of QGBWOA, comparison experiments between QGBWOA and its comparison peers were carried out on CEC 2014 with dimensions 10, 30, 50, and 100 and on CEC 2020 test with dimension 30. Furthermore, the performance results were tested using Wilcoxon signed-rank (WS), Friedman test, and post hoc statistical tests for statistical analysis. Convergence accuracy and speed are remarkably improved, as shown by experimental results. Finally, feature selection and multi-threshold image segmentation applications are demonstrated to validate the ability of QGBWOA to solve complex real-world problems. QGBWOA proves its superiority over compared algorithms in feature selection and multi-threshold image segmentation by performing several evaluation metrics. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s42235-022-00297-8.
Collapse
Affiliation(s)
- Jie Xing
- Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035 China
| | - Hanli Zhao
- Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035 China
| | - Huiling Chen
- Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035 China
| | - Ruoxi Deng
- Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035 China
| | - Lei Xiao
- Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035 China
| |
Collapse
|
8
|
Online group streaming feature selection using entropy-based uncertainty measures for fuzzy neighborhood rough sets. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-022-00763-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractOnline group streaming feature selection, as an essential online processing method, can deal with dynamic feature selection tasks by considering the original group structure information of the features. Due to the fuzziness and uncertainty of the feature stream, some existing methods are unstable and yield low predictive accuracy. To address these issues, this paper presents a novel online group streaming feature selection method (FNE-OGSFS) using fuzzy neighborhood entropy-based uncertainty measures. First, a separability measure integrating the dependency degree with the coincidence degree is proposed and introduced into the fuzzy neighborhood rough sets model to define a new fuzzy neighborhood entropy. Second, inspired by both algebra and information views, some fuzzy neighborhood entropy-based uncertainty measures are investigated and some properties are derived. Furthermore, the optimal features in the group are selected to flow into the feature space according to the significance of features, and the features with interactions are left. Then, all selected features are re-evaluated by the Lasso model to discard the redundant features. Finally, an online group streaming feature selection algorithm is designed. Experimental results compared with eight representative methods on thirteen datasets show that FNE-OGSFS can achieve better comprehensive performance.
Collapse
|
9
|
Xu J, Qu K, Meng X, Sun Y, Hou Q. Feature selection based on multiview entropy measures in multiperspective rough set. INT J INTELL SYST 2022. [DOI: 10.1002/int.22878] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Affiliation(s)
- Jiucheng Xu
- Engineering Lab of Intelligence Business & Internet of Things Henan Province Xinxiang China
- College of Computer and Information Engineering Henan Normal University Xinxiang China
| | - Kanglin Qu
- Engineering Lab of Intelligence Business & Internet of Things Henan Province Xinxiang China
- College of Computer and Information Engineering Henan Normal University Xinxiang China
| | - Xiangru Meng
- Engineering Lab of Intelligence Business & Internet of Things Henan Province Xinxiang China
- College of Computer and Information Engineering Henan Normal University Xinxiang China
| | - Yuanhao Sun
- Engineering Lab of Intelligence Business & Internet of Things Henan Province Xinxiang China
- College of Computer and Information Engineering Henan Normal University Xinxiang China
| | - Qincheng Hou
- Engineering Lab of Intelligence Business & Internet of Things Henan Province Xinxiang China
- College of Computer and Information Engineering Henan Normal University Xinxiang China
| |
Collapse
|
10
|
Wan J, Chen H, Li T, Yang X, Sang B. Dynamic interaction feature selection based on fuzzy rough set. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.10.026] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|