• the flip-the-state transition operator for restricted boltzmann machines

    جزئیات بیشتر مقاله
    • تاریخ ارائه: 1392/07/24
    • تاریخ انتشار در تی پی بین: 1392/07/24
    • تعداد بازدید: 998
    • تعداد پرسش و پاسخ ها: 0
    • شماره تماس دبیرخانه رویداد: -
     most learning and sampling algorithms for restricted boltzmann machines (rmbs) rely on markov chain monte carlo (mcmc) methods using gibbs sampling. the most prominent examples are contrastive divergence learning (cd) and its variants as well as parallel tempering (pt). the performance of these methods strongly depends on the mixing properties of the gibbs chain. we propose a metropolis-type mcmc algorithm relying on a transition operator maximizing the probability of state changes. it is shown that the operator induces an irreducible, aperiodic, and hence properly converging markov chain, also for the typically used periodic update schemes. the transition operator can replace gibbs sampling in rbm learning algorithms without producing computational overhead. it is shown empirically that this leads to faster mixing and in turn to more accurate learning.

سوال خود را در مورد این مقاله مطرح نمایید :

با انتخاب دکمه ثبت پرسش، موافقت خود را با قوانین انتشار محتوا در وبسایت تی پی بین اعلام می کنم
مقالات جدیدترین رویدادها
مقالات جدیدترین ژورنال ها