信息论与统计学习（英文版）

老到无可依

信息论与统计学习
1 Algorithmic Probability: Theory and Applications . . . . . . . . . . . . . . . . 1
Ray J. Solomonoff
2 Model Selection and Testing by the MDL Principle . . . . . . . . . . . . . . . 25
Jorma Rissanen
3 Normalized Information Distance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Paul M. B. Vit´anyi, Frank J. Balbach, Rudi L. Cilibrasi, and Ming Li
4 The Application of Data Compression-Based Distances
to Biological Sequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Attila Kert´esz-Farkas, Andr´as Kocsor, and S´andor Pongor
5 MIC: Mutual Information Based Hierarchical Clustering . . . . . . . . . . 101
Alexander Kraskov and Peter Grassberger
6 A Hybrid Genetic Algorithm for Feature Selection
Based on Mutual Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
Jinjie Huang and Panxiang Rong
7 Information Approach to Blind Source Separation
and Deconvolution. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Pham Dinh-Tuan
8 Causality in Time Series: Its Detection and Quantification by Means
of Information Theory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Kateˇrina Hlav´aˇckov´a-Schindler
9 Information Theoretic Learning and Kernel Methods . . . . . . . . . . . . . 209
Robert Jenssen
10 Information-Theoretic Causal Power . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
Kevin B. Korb, Lucas R. Hope, and Erik P. Nyberg
vii
viii Contents
11 Information Flows in Complex Networks . . . . . . . . . . . . . . . . . . . . . . . . 267
Jo˜ao Barros
12 Models of Information Processing in the Sensorimotor Loop . . . . . . . 289
Daniel Polani and Marco M¨oller
13 Information Divergence Geometry and the Application to Statistical
Machine Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
Shinto Eguchi
14 Model Selection and Information Criterion . . . . . . . . . . . . . . . . . . . . . . 333
Noboru Murata and Hyeyoung Park
15 Extreme Physical Information as a Principle of Universal Stability . . 355
B. Roy Frieden
16 Entropy and Cloning Methods for Combinatorial Optimization,
Sampling and Counting Using the Gibbs Sampler . . . . . . . . . . . . . . . . 385
Reuven Rubinstein
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435