#5 Parameter norm penalties, parameter sharing, dropout, data augmentation, injecting noise, batch normalization

#5 Factor graph, Sum-Product algo, Maximum a Posterior problem, Junction tree

#4 Markov Decision Process, Value evaluation, Policy evaluation, Online sesarch, Monte Carlo tree search

#4 CNN terms

#4 Naive variable elimination algorithm, Treewidth, Sum-Product Algorithm, Message passing protocol

#3 Decision Theory & Utility Theory

#3 Activation function, Stochastic gradient descent

#3 Markov Random Field, Undirected graphical model, 5 Rules