1
|
Zhang L, Lin G, Wei L, Liao S, Lin Y. A novel ANN-based feature subset selection in multi-scale granular ball neighborhood decision tables. Neural Netw 2025; 185:107178. [PMID: 39884179 DOI: 10.1016/j.neunet.2025.107178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Revised: 11/18/2024] [Accepted: 01/13/2025] [Indexed: 02/01/2025]
Abstract
As an effective data preprocessing method, feature subset selection has been widely explored in recent years. However, the feature subset selection for the Wu-Leung model and its extended model involves high time complexity. Therefore, we combine the granular ball neighborhood rough set with the Wu-Leung model. A multi-scale granular ball neighborhood decision table is designed. Meanwhile, the weight of features are not the same at different scales and are correlated with the decision. We combine the artificial neural network (ANN) with the multi-scale granular ball neighborhood decision table to calculate feature weights. Based on this, the weight-based feature subset selection algorithm, and the positive region increment-based feature subset selection algorithm are designed. Most importantly, in order to overcome the situation of missing or missing labels during data collection, we design an unsupervised feature subset selection algorithm. Finally, the effectiveness and feasibility of the proposed three algorithms are verified through experimental comparison and analysis. The advantages of the proposed algorithm are analyzed.
Collapse
Affiliation(s)
- Lujing Zhang
- School of Mathematics and Statistics, Minnan Normal University, Zhangzhou, Fujian 363000, China; Fujian Key Laboratory of Granular Computing and Applications, Zhangzhou, Fujian 363000, China.
| | - Guoping Lin
- School of Mathematics and Statistics, Minnan Normal University, Zhangzhou, Fujian 363000, China; Fujian Key Laboratory of Granular Computing and Applications, Zhangzhou, Fujian 363000, China; Key Laboratory of Applied Mathematics (Putian University), Fujian Province University, Fujian Putian, 351100, China.
| | - Ling Wei
- School of Mathematics and Statistics, Minnan Normal University, Zhangzhou, Fujian 363000, China; School of Mathematics, Northwest University, Xi'an 710127, China; Institute of Concepts, Cognition and Intelligence, Northwest University, Xi'an 710127, China.
| | - Shujiao Liao
- School of Mathematics and Statistics, Minnan Normal University, Zhangzhou, Fujian 363000, China.
| | - Yidong Lin
- School of Mathematics and Statistics, Minnan Normal University, Zhangzhou, Fujian 363000, China.
| |
Collapse
|
2
|
Chu X, Sun B, Mo X, Liu J, Zhang Y, Weng H, Chen D. Time-series dynamic three-way group decision-making model and its application in TCM efficacy evaluation. Artif Intell Rev 2023. [DOI: 10.1007/s10462-023-10445-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/13/2023]
|
3
|
Zhou J, Liu Y, Liang D, Xie C. Two-Stage Three-Way Enhanced Multi-Criteria Classification Optimization for Risk-Averse Product Design Programming. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.03.068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/11/2023]
|
4
|
Wang W, Huang B, Wang T. Optimal scale selection based on multi-scale single-valued neutrosophic decision-theoretic rough set with cost-sensitivity. Int J Approx Reason 2023. [DOI: 10.1016/j.ijar.2023.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
|
5
|
Incremental approaches for optimal scale selection in dynamic multi-scale set-valued decision tables. INT J MACH LEARN CYB 2023. [DOI: 10.1007/s13042-022-01761-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
6
|
Maximal consistent block based optimal scale selection for incomplete multi-scale information systems. INT J MACH LEARN CYB 2023. [DOI: 10.1007/s13042-022-01728-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
|
7
|
The movement strategy of three-way decisions based on clustering. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.01.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
8
|
Chen X, Huang B, Wang T. Optimal scale generation in two-class dominance decision tables with sequential three-way decision. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2022.12.097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
9
|
Rule acquisition in generalized multi-scale information systems with multi-scale decisions. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.12.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
10
|
A review of sequential three-way decision and multi-granularity learning. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.11.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
11
|
Generalized multigranulation sequential three-way decision models for hierarchical classification. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.10.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
12
|
Li J, Feng Y. Update of optimal scale in dynamic multi-scale decision information systems. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.10.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
13
|
Measuring effectiveness of movement-based three-way decision using fuzzy Markov model. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.11.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
14
|
Sequential 3WD-based local optimal scale selection in dynamic multi-scale decision information systems. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.10.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
15
|
Multi-granulation-based knowledge discovery in incomplete generalized multi-scale decision systems. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01634-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
16
|
|
17
|
Deng J, Zhan J, Wu WZ. A ranking method with a preference relation based on the PROMETHEE method in incomplete multi-scale information systems. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.07.033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
18
|
Zhang Q, Cheng Y, Zhao F, Wang G, Xia S. Optimal Scale Combination Selection Integrating Three-Way Decision With Hasse Diagram. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:3675-3689. [PMID: 33635795 DOI: 10.1109/tnnls.2021.3054063] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Multi-scale decision system (MDS) is an effective tool to describe hierarchical data in machine learning. Optimal scale combination (OSC) selection and attribute reduction are two key issues related to knowledge discovery in MDSs. However, searching for all OSCs may result in a combinatorial explosion, and the existing approaches typically incur excessive time consumption. In this study, searching for all OSCs is considered as an optimization problem with the scale space as the search space. Accordingly, a sequential three-way decision model of the scale space is established to reduce the search space by integrating three-way decision with the Hasse diagram. First, a novel scale combination is proposed to perform scale selection and attribute reduction simultaneously, and then an extended stepwise optimal scale selection (ESOSS) method is introduced to quickly search for a single local OSC on a subset of the scale space. Second, based on the obtained local OSCs, a sequential three-way decision model of the scale space is established to divide the search space into three pair-wise disjoint regions, namely the positive, negative, and boundary regions. The boundary region is regarded as a new search space, and it can be proved that a local OSC on the boundary region is also a global OSC. Therefore, all OSCs of a given MDS can be obtained by searching for the local OSCs on the boundary regions in a step-by-step manner. Finally, according to the properties of the Hasse diagram, a formula for calculating the maximal elements of a given boundary region is provided to alleviate space complexity. Accordingly, an efficient OSC selection algorithm is proposed to improve the efficiency of searching for all OSCs by reducing the search space. The experimental results demonstrate that the proposed method can significantly reduce computational time.
Collapse
|
19
|
An optimization viewpoint on evaluation-based interval-valued multi-attribute three-way decision model. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.04.055] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
20
|
Optimal scale combination selection for inconsistent multi-scale decision tables. Soft comput 2022; 26:6119-6129. [PMID: 35505939 PMCID: PMC9047633 DOI: 10.1007/s00500-022-07102-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/02/2022] [Indexed: 11/24/2022]
Abstract
Hierarchical structured data are very common for data mining and other tasks in real-life world. How to select the optimal scale combination from a multi-scale decision table is critical for subsequent tasks. At present, the models for calculating the optimal scale combination mainly include lattice model, complement model and stepwise optimal scale selection model, which are mainly based on consistent multi-scale decision tables. The optimal scale selection model for inconsistent multi-scale decision tables has not been given. Based on this, firstly, this paper introduces the concept of complement and lattice model proposed by Li and Hu. Secondly, based on the concept of positive region consistency of inconsistent multi-scale decision tables, the paper proposes complement model and lattice model based on positive region consistent and gives the algorithm. Finally, some numerical experiments are employed to verify that the model has the same properties in processing inconsistent multi-scale decision tables as the complement model and lattice model in processing consistent multi-scale decision tables. And for the consistent multi-scale decision table, the same results can be obtained by using the model based on positive region consistent. However, the lattice model based on positive region consistent is more time-consuming and costly. The model proposed in this paper provides a new theoretical method for the optimal scale combination selection of the inconsistent multi-scale decision table.
Collapse
|
21
|
Yang X, Chen Y, Fujita H, Liu D, Li T. Mixed data-driven sequential three-way decision via subjective–objective dynamic fusion. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.107728] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
22
|
|
23
|
On selection of optimal cuts in complete multi-scale decision tables. Artif Intell Rev 2021. [DOI: 10.1007/s10462-021-09965-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
24
|
A further study on optimal scale selection in dynamic multi-scale decision information systems based on sequential three-way decisions. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-021-01474-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
|
25
|
Incremental sequential three-way decision based on continual learning network. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-021-01472-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
26
|
Optimal Granule Combination Selection Based on Multi-Granularity Triadic Concept Analysis. Cognit Comput 2021. [DOI: 10.1007/s12559-021-09934-6 10.1007/s12559-021-09934-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
27
|
Wan Q, Li J, Wei L. Optimal Granule Combination Selection Based on Multi-Granularity Triadic Concept Analysis. Cognit Comput 2021. [DOI: 10.1007/s12559-021-09934-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
28
|
Huang Z, Li J. Multi-scale covering rough sets with applications to data classification. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107736] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
29
|
Ju H, Ding W, Yang X, Fujita H, Xu S. Robust supervised rough granular description model with the principle of justifiable granularity. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107612] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
30
|
A novel intuitionistic fuzzy three-way decision model based on an intuitionistic fuzzy incomplete information system. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-021-01426-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
31
|
Deng J, Zhan J, Wu WZ. A three-way decision methodology to multi-attribute decision-making in multi-scale decision information systems. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.03.058] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
32
|
|
33
|
She YH, Qian ZH, He XL, Wang JT, Qian T, Zheng WL. On generalization reducts in multi-scale decision tables. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2020.12.045] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
34
|
Bao H, Wu WZ, Zheng JW, Li TJ. Entropy based optimal scale combination selection for generalized multi-scale information tables. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-020-01243-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
35
|
Zhang Q, Huang Z, Wang G. A novel sequential three-way decision model with autonomous error correction. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106526] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
36
|
Hong Pak C, Hong Kim J, Guk Jong M. Describing hierarchy of concept lattice by using matrix. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2020.05.020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
37
|
Hu C, Zhang L. Dynamic dominance-based multigranulation rough sets approaches with evolving ordered data. INT J MACH LEARN CYB 2021. [DOI: 10.1007/s13042-020-01119-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
38
|
Optimal scale selection and attribute reduction in multi-scale decision tables based on three-way decision. Inf Sci (N Y) 2020. [DOI: 10.1016/j.ins.2020.05.109] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
39
|
Hu C, Zhang L. Efficient approaches for maintaining dominance-based multigranulation approximations with incremental granular structures. Int J Approx Reason 2020. [DOI: 10.1016/j.ijar.2020.08.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
40
|
Xu Y, Wang Q, Sun W. Matrix-based incremental updating approximations in multigranulation rough set under two-dimensional variation. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01219-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
41
|
Cheng Y, Zhang Q, Wang G. Optimal scale combination selection for multi-scale decision tables based on three-way decision. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01173-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
42
|
Li W, Li J, Huang J, Dai W, Zhang X. A new rough set model based on multi-scale covering. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01169-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
43
|
Incremental updating probabilistic neighborhood three-way regions with time-evolving attributes. Int J Approx Reason 2020. [DOI: 10.1016/j.ijar.2020.01.015] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
44
|
Hu C, Zhang L. A dynamic framework for updating neighborhood multigranulation approximations with the variation of objects. Inf Sci (N Y) 2020. [DOI: 10.1016/j.ins.2019.12.036] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
45
|
Dynamic granularity selection based on local weighted accuracy and local likelihood ratio. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2020.106087] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
46
|
Zhang X, Zhang Q, Cheng Y, Wang G. Optimal scale selection by integrating uncertainty and cost-sensitive learning in multi-scale decision tables. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01101-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
47
|
|
48
|
Zhang C, Dai J, Chen J. Knowledge granularity based incremental attribute reduction for incomplete decision systems. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01089-4] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
49
|
Dai D, Li H, Jia X, Zhou X, Huang B, Liang S. A co-training approach for sequential three-way decisions. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01086-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
50
|
|