• massively parallel feature selection: an approach based on variance preservation

    جزئیات بیشتر مقاله
    • تاریخ ارائه: 1392/07/24
    • تاریخ انتشار در تی پی بین: 1392/07/24
    • تعداد بازدید: 1008
    • تعداد پرسش و پاسخ ها: 0
    • شماره تماس دبیرخانه رویداد: -
     advances in computer technologies have enabled corporations to accumulate data at an unprecedented speed. large-scale business data might contain billions of observations and thousands of features, which easily brings their scale to the level of terabytes. most traditional feature selection algorithms are designed and implemented for a centralized computing architecture. their usability significantly deteriorates when data size exceeds tens of gigabytes. high-performance distributed computing frameworks and protocols, such as the message passing interface (mpi) and mapreduce, have been proposed to facilitate software development on grid infrastructures, enabling analysts to process large-scale problems efficiently. this paper presents a novel large-scale feature selection algorithm that is based on variance analysis. the algorithm selects features by evaluating their abilities to explain data variance. it supports both supervised and unsupervised feature selection and can be readily implemented in most distributed computing environments. the algorithm was implemented as a sas high-performance analytics procedure, which can read data in distributed form and perform parallel feature selection in both symmetric multiprocessing mode (smp) and massively parallel processing mode (mpp). experimental results demonstrated the superior performance of the proposed method for large scale feature selection.

سوال خود را در مورد این مقاله مطرح نمایید :

با انتخاب دکمه ثبت پرسش، موافقت خود را با قوانین انتشار محتوا در وبسایت تی پی بین اعلام می کنم
مقالات جدیدترین ژورنال ها