Główne pojęcia
情報が意味を伝える量を定義する初めての厳密な方法を提供する。
Statystyki
ˆp(w, T ) = w + 1 / T + 2.
Laplace’s Rule of Succession: ˆp(w, T ) = w + 1 / T + 2.
Definition of pragmatic information for a single message: D∆(pm||q) = Σ pi|m log(pi|m/qi).
Cytaty
"Additivity of information for independent events is intuitively a fundamental requirement." - Kullbach (1974)
"The pragmatic information conveyed by a single message is a maximum when ∆ treats it as a certainty." - Author
"Φ∆(M; Ω) ≥ I(M; Ω), with equality if and only if p = q." - Theorem