1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
|
"""
================================================
Maximum entropy models (:mod:`scipy.maxentropy`)
================================================
.. currentmodule:: scipy.maxentropy
.. warning:: This module is deprecated in scipy 0.10, and will be removed in
0.11. Do not use this module in your new code. For questions about
this deprecation, please ask on the scipy-dev mailing list.
Package content
===============
Models:
.. autosummary::
:toctree: generated/
model
bigmodel
basemodel
conditionalmodel
Utilities:
.. autosummary::
:toctree: generated/
arrayexp
arrayexpcomplex
columnmeans
columnvariances
densefeaturematrix
densefeatures
dotprod
flatten
innerprod
innerprodtranspose
logsumexp
logsumexp_naive
robustlog
rowmeans
sample_wr
sparsefeaturematrix
sparsefeatures
Usage information
=================
Contains two classes for fitting maximum entropy models (also known
as "exponential family" models) subject to linear constraints on the
expectations of arbitrary feature statistics. One class, "model", is
for small discrete sample spaces, using explicit summation. The other,
"bigmodel", is for sample spaces that are either continuous (and
perhaps high-dimensional) or discrete but too large to sum over, and
uses importance sampling. conditional Monte Carlo methods.
The maximum entropy model has exponential form
..
p(x) = exp(theta^T f(x)) / Z(theta)
.. math::
p\\left(x\\right)=\\exp\\left(\\frac{\\theta^{T}f\\left(x\\right)}
{Z\\left(\\theta\\right)}\\right)
with a real parameter vector theta of the same length as the feature
statistic f(x), For more background, see, for example, Cover and
Thomas (1991), *Elements of Information Theory*.
See the file bergerexample.py for a walk-through of how to use these
routines when the sample space is small enough to be enumerated.
See bergerexamplesimulated.py for a a similar walk-through using
simulation.
"""
# Copyright: Ed Schofield, 2003-2006
# License: BSD-style (see LICENSE.txt in main source directory)
postpone_import = 1
depends = ['optimize']
|
