9 Matching Annotations
 Nov 2018

iphysresearch.github.io iphysresearch.github.io

Explaining Deep Learning Models  A Bayesian Nonparametric Approach
无疑，讨论模型可解释性的 paper 总是让人充满好奇的。 文中说前人据网络的 output 形成了两种解释思路：whitebox/blackbox explanation。此文提出了新blackbox方法(general sensitivity level of a target model to specific input dimensions) 通过建立 DMMMEN。

 Sep 2018


conditional distribution for individual components can be constructed
So the conditional distribution is conditioned on other components?

p(y∣x)=∫p(y∣f,x)p(f∣x)df
\(y\) is the data, \(f\) is the model, \(x\) is the input variable


am207.github.io am207.github.io

in equation B for the marginal of a gaussian, only the covariance of the block of the matrix involving the unmarginalized dimensions matters! Thus “if you ask only for the properties of the function (you are fitting to the data) at a finite number of points, then inference in the Gaussian process will give you the same answer if you ignore the infinitely many other points, as if you would have taken them all into account!”(Rasmunnsen)
key insight into Gaussian processes

 Jul 2018

am207.github.io am207.github.io
 Jan 2016

blogs.scientificamerican.com blogs.scientificamerican.com

P(BE) = P(B) X P(EB) / P(E), with P standing for probability, B for belief and E for evidence. P(B) is the probability that B is true, and P(E) is the probability that E is true. P(BE) means the probability of B if E is true, and P(EB) is the probability of E if B is true.

The probability that a belief is true given new evidence equals the probability that the belief is true regardless of that evidence times the probability that the evidence is true given that the belief is true divided by the probability that the evidence is true regardless of whether the belief is true. Got that?

Initial belief plus new evidence = new and improved belief.

 Oct 2015


Nearly all applications of probability to cryptography depend on the factor principle (or Bayes’ Theorem).
This is easily the most interesting sentence in the paper: Turing used Bayesian analysis for codebreaking during WWII.
