• JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
  • JoomlaWorks Simple Image Rotator
 
  Bookmark and Share
 
 
Master's Dissertation
DOI
https://doi.org/10.11606/D.45.2023.tde-18092023-103415
Document
Author
Full name
Tiago Madeira
Institute/School/College
Knowledge Area
Date of Defense
Published
São Paulo, 2023
Supervisor
Committee
Mauá, Denis Deratani (President)
Antonucci, Alessandro
Cozman, Fabio Gagliardi
Title in English
Finding maxima of Gaussian Sum-Product Networks
Keywords in English
Gaussian mixture models
Machine learning
Mode finding
Probabilistic models
Sum-Product Networks
Abstract in English
This thesis is about finding maxima of Sum-Product Networks (SPNs). SPNs are expressive statistical deep models that efficiently represent complex probability distributions. They encode context-specific independence among random variables and enable exact marginal and conditional probability inference in linear time. The research explores Gaussian SPNs (GSPNs), which are continuous SPNs with Gaussian distributions at their leaves. GSPNs provide compact representations of Gaussian Mixture Models (GMMs) with many components. The relationship between GSPNs and GMMs has been largely unexplored in the literature, particularly regarding mode-finding techniques. The problem of finding modes in Gaussian mixtures is challenging, and existing techniques involve hill-climbing algorithms. However, there is limited research discussing modes in the context of SPNs. The objective of this work is to investigate and establish a framework for identifying modes in GSPNs. This is accomplished by developing an algorithm that employs an EM-style fixed-point iteration method for mode finding in GSPNs. The algorithm is presented in detail, accompanied by a formal proof of its correctness. Two applications for it are discussed: Maximum-A-Posteriori inference and modal clustering. Some experimental results are provided to evaluate the effectiveness of the proposed approach.
Title in Portuguese
Encontrando máximos de redes Soma-Produto Gaussianas
Keywords in Portuguese
Aprendizagem de máquina
Busca de modas
Modelos de misturas Gaussianas
Modelos probabilísticos
Redes Soma-Produto
Abstract in Portuguese
Esta dissertação é sobre busca de máximos de Redes Soma-Produto (SPNs, do inglês Sum-Product Networks). As SPNs são modelos estatísticos profundos expressivos que representam eficientemente distribuições de probabilidade complexas. Elas codificam independência contextual específica entre variáveis aleatórias e permitem inferência exata de probabilidade marginal e condicional em tempo linear. A pesquisa explora as SPNs Gaussianas (GSPNs), que são SPNs contínuas com distribuições Gaussianas em suas folhas. As GSPNs fornecem representações compactas de Modelos de Misturas Gaussianas (GMMs) com muitos componentes. A relação entre GSPNs e GMMs tem sido pouco explorada na literatura, especialmente no que diz respeito a técnicas de busca de modas. O problema de encontrar modas em misturas Gaussianas é desafiador e as técnicas existentes envolvem algoritmos de escalada. No entanto, há pouca pesquisa discutindo modas no contexto de SPNs. O objetivo deste trabalho é investigar e estabelecer uma abordagem para encontrar modas em GSPNs. Isso é alcançado através do desenvolvimento de um algoritmo que utiliza um método de iteração de ponto fixo no estilo EM (Expectativa-Maximização) para encontrar modas em GSPNs. O algoritmo é apresentado em detalhes, acompanhado de uma prova formal de sua corretude. Duas aplicações para ele são discutidas: inferência de Máximo-A-Posteriori e clusterização modal. Alguns resultados experimentais são fornecidos para avaliar a eficácia da abordagem proposta.
 
WARNING - Viewing this document is conditioned on your acceptance of the following terms of use:
This document is only for private use for research and teaching activities. Reproduction for commercial use is forbidden. This rights cover the whole data about this document as well as its contents. Any uses or copies of this document in whole or in part must include the author's name.
main.pdf (3.72 Mbytes)
Publishing Date
2023-09-27
 
WARNING: Learn what derived works are clicking here.
All rights of the thesis/dissertation are from the authors
CeTI-SC/STI
Digital Library of Theses and Dissertations of USP. Copyright © 2001-2024. All rights reserved.