With the unbalanced data set emerging in large numbers on the internet
the research on the unbalanced data classification becomes a new hotspot.According to the feature's distribution characteristics in the classification
a new feature selection method based on inter-class and between-classes distributions was proposed.The proposed method not only takes full account of the rare category of information's impact on the feature selection
making the constructed distribution function well reflect the characteristics of rare information
but also selects the features of significant contribution for unbalanced data classification.The experimental results show that both MacroF1 and MicroF1 of the proposed method have advantages over Category DistributionBased Feature Selection(CDFS) method and the class information method.
关键词
Keywords
references
徐燕,李锦涛,王斌,等.不均衡数据集上文本分类的特征选择研究[J].计算机研究与发展,2007,44(Suppl):58-62.Xu Yan,Li Jintao,Wang Bin,et al.A study of feature selection for text categorization on imbalanced data[J].Journal of Computer Research and Development,2007,44(Suppl):58-62.(in Chinese)
Zheng Z,Wu X,Srihari R.Feature selection for text categorization on imbalanced data[C].Proc of ACM SIGKDDExplorations Newsletter.New York:ACM,2004:80-89.
谢纪刚,裘正定.非平衡数据集Fisher线形判别模型[J].北京交通大学学报,2006(10):15-18.Xie Jigang,Qiu Zhengding.Fisher linear discriminant model with class imbalance[J].Journal of Beijing JIaotongUniversity,2006(10):15-18.(in Chinese)
Yan J,Liu N,Zhang B,et al.OCFS:Optimal orthogonal centroid feature selection for text categorization[C].Procof SIGIR’05.New York:ACM,2005:122-129.
余俊英,王明文.文本分类中的类别信息特征选择方法[J].山东大学学报(自然科学版),2006,41(3):1671-9352.Yu Junying,Wang Mingwen.Class information feature selection method for text classification[J].Journal ofShandong University(Natural Science Edition),2006,41(3):1671-9352.(in Chinese)
婧红芳,王斌,杨雅辉,等.基于类别分布的特征选择框架[J].计算机研究与发展,2009,46(9):1586-1593.Jing Hongfang,Wang Bin,Yang Yahui,et al.Category distribution-based feature selection framework[J].Journalof Computer Research and Development,2009,46(9):1586-1593.(in Chinese)