محبوبترین نویسندگان :
نویسندگان مقالات پربازدید :
یادگیری ماشین 2013
جزئیات رویداد
همایش ، رویداد ، ژورنال
اینستاگرام تی پی بین
حوزه های تحت پوشش رویداد

  • block coordinate descent algorithms for large-scale sparse multiclass classification

    نویسندگان :
    کلمات کلیدی :
    جزئیات بیشتر مقاله
    • تاریخ ارائه: 1392/07/24
    • تاریخ انتشار در تی پی بین: 1392/07/24
    • تعداد بازدید: 1293
    • تعداد پرسش و پاسخ ها: 0
    • شماره تماس دبیرخانه رویداد: -
     over the past decade, ℓ 1 regularization has emerged as a powerful way to learn classifiers with implicit feature selection. more recently, mixed-norm (e.g., ℓ 1/ℓ 2) regularization has been utilized as a way to select entire groups of features. in this paper, we propose a novel direct multiclass formulation specifically designed for large-scale and high-dimensional problems such as document classification. based on a multiclass extension of the squared hinge loss, our formulation employs ℓ1/ℓ 2 regularization so as to force weights corresponding to the same features to be zero across all classes, resulting in compact and fast-to-evaluate multiclass models. for optimization, we employ two globally-convergent variants of block coordinate descent, one with line search (tseng and yun in math. program. 117:387–423, 2009) and the other without (richtárik and takáč in math. program. 1–38, 2012a; tech. rep. arxiv:1212.0873, 2012b). we present the two variants in a unified manner and develop the core components needed to efficiently solve our formulation. the end result is a couple of block coordinate descent algorithms specifically tailored to our multiclass formulation. experimentally, we show that block coordinate descent performs favorably compared to other solvers such as fobos, fista and sparsa. furthermore, we show that our formulation obtains very compact multiclass models and outperforms ℓ 1/ℓ 2-regularized multiclass logistic regression in terms of training speed, while achieving comparable test accuracy.

سوال خود را در مورد این مقاله مطرح نمایید :

با انتخاب دکمه ثبت پرسش، موافقت خود را با قوانین انتشار محتوا در وبسایت تی پی بین اعلام می کنم
مقالات جدیدترین رویدادها
مقالات جدیدترین ژورنال ها