Deep generative model

cosmos 15th May 2019 at 3:33am
Probabilistic model

Generative model (basically a Probabilistic model) using a Deep learning model (basically an advanced Deep neural network)


Example of probabilistic modeling (particulary in Deep learning paradigm), using the DeepSaber project as example.

_technical outline of ML approach to beat saber problem_

  • Supervised learning: song -> level
  • But there are many levels that are good for a song
  • Learn the probability distribution over beat-saber levels, conditioned on song
  • We parametrize the distribution by a neural network with softmax output
  • Train by Max Likelihood: find set of parameters that make the training data most likely.
  • How do you even express a complicated distribution with a neural network?
    • Insert noise into it: GANs, normalizing flows
    • Divide and conquer (autoregression)!. Decompose distribution into product of conditionals
    • State space
  • All of our approaches use autoregression over the sequence
  • For each point in the sequence, we tried both GAN, and state space approach to express distribution over block states.