التفاصيل البيبلوغرافية
| العنوان: |
Unsupervised Learning of Binary Vectors |
| المؤلفون: |
COPELLI LOPES DA SILVA, MAURO |
| المساهمون: |
Van den Broeck, Christian |
| بيانات النشر: |
UHasselt Diepenbeek |
| سنة النشر: |
1999 |
| المجموعة: |
Document Server@UHasselt (Universiteit Hasselt) |
| الوصف: |
In this thesis unsupervised learning of binary vectors from data is studied using methods from Statistical Mechanics of disordered systems. In the model data vectors are distributed according to a single symmetry breaking direction The aim of unsupervised learning is to provide a good approximation to this direction The difference with respect to previous studies is the knowledge that this preferential direction has binary components It is shown that sampling from the posterior distribution 'Gibbs learning' leads for general smooth distributions to an exponentially fast approach to perfect learning in the asymptotic limit of large number of examples. If the distribution is non-smooth then first order phase transitions to perfect learning are expected. In the limit of poor performance at the other end of the asymptotics the binary nature of the preferential direction is irrelevant and the results are the same as for the spherical case a second order phase transition 'retarded learning' is predicted to occur if the data distribution is not biased or if the distribution is biased learning starts off immediately. Using concepts from Bayesian inference the center of mass of the Gibbs ensemble is shown to have maximal average Bayes-optimal performance. This upper bound for continuous vectors is extended to a discrete space resulting in the clipped center of mass of the Gibbs ensemble having maximal average performance among the binary vectors In order to calculate the performance of this best binary vector the geometric properties of the center of mass of binary vectors are first studied. The surprising result is found that the center of mass of innite binary vectors which obey some simple constraints is again a binary vector. When disorder is taken into account in the calculation however the properties of the Bayes-optimal center of mass change completely leading to a vector with continuous components. The performance of the best binary vector is calculated and shown to always lie above that of Gibbs learning and ... |
| نوع الوثيقة: |
doctoral or postdoctoral thesis |
| وصف الملف: |
application/pdf |
| اللغة: |
unknown |
| العلاقة: |
http://hdl.handle.net/1942/8837Test |
| الإتاحة: |
http://hdl.handle.net/1942/8837Test |
| حقوق: |
info:eu-repo/semantics/openAccess |
| رقم الانضمام: |
edsbas.5E3F0060 |
| قاعدة البيانات: |
BASE |
