Codex Wiki
OurBigBook.com
Site
Source code
Kullback-Leibler divergence
(
D
KL
)
Home
Mathematics
Area of mathematics
Probability and statistics
OurBigBook.com
Words: 45
Articles: 1
For probability densities
p
and
q
, the Kullback-Leibler divergence from
q
to
p
is
D
KL
(
p
∥
q
)
=
E
p
[
lo
g
q
(
X
)
p
(
X
)
]
.
(1)
Table of contents
45
1
Gibbs inequality
Kullback-Leibler divergence
26
Ancestors
(4)
Probability and statistics
Area of mathematics
Mathematics
Home
Incoming links
(2)
Exponential-family deviance
Solution