The Hybrid Bootstrap: A Drop-in Replacement for Dropout

التفاصيل البيبلوغرافية
العنوان: The Hybrid Bootstrap: A Drop-in Replacement for Dropout
المؤلفون: Kosar, Robert, Scott, David W.
سنة النشر: 2018
المجموعة: Computer Science
Statistics
مصطلحات موضوعية: Statistics - Machine Learning, Computer Science - Learning
الوصف: Regularization is an important component of predictive model building. The hybrid bootstrap is a regularization technique that functions similarly to dropout except that features are resampled from other training points rather than replaced with zeros. We show that the hybrid bootstrap offers superior performance to dropout. We also present a sampling based technique to simplify hyperparameter choice. Next, we provide an alternative sampling technique for convolutional neural networks. Finally, we demonstrate the efficacy of the hybrid bootstrap on non-image tasks using tree-based models.
نوع الوثيقة: Working Paper
الوصول الحر: http://arxiv.org/abs/1801.07316Test
رقم الانضمام: edsarx.1801.07316
قاعدة البيانات: arXiv