Probabilistic model

cosmos 15th May 2019 at 3:33am
Probability theory

A Probability distribution, which is used to model some system, often with Uncertainty/Randomness.

These models relate Random variables, using some more or less general assumptions about the nature of the data.

Graphical model

Artificial neural network

See Machine learning

Generative modelDeep generative model

Random-cluster model


Example of probabilistic modeling (particulary in Deep learning paradigm), using the DeepSaber project as example.

_technical outline of ML approach to beat saber problem_

  • Supervised learning: song -> level
  • But there are many levels that are good for a song
  • Learn the probability distribution over beat-saber levels, conditioned on song
  • We parametrize the distribution by a neural network with softmax output
  • Train by Max Likelihood: find set of parameters that make the training data most likely.
  • How do you even express a complicated distribution with a neural network?
    • Insert noise into it: GANs, normalizing flows
    • Divide and conquer (autoregression)!. Decompose distribution into product of conditionals
    • State space
  • All of our approaches use autoregression over the sequence
  • For each point in the sequence, we tried both GAN, and state space approach to express distribution over block states.