Question: what are bayesian neural networks?
Answer: A Bayesian neural network (BNN) refers to extending standard networks with posterior inference. Standard NN training via optimization is (from a probabilistic perspective) equivalent to maximum likelihood estimation (MLE) for the weights. ... Using MLE ignores any uncertainty that we may have in the proper weight values.