Generalizing Information Theory: Uncertainty Reduction through Arbitrary Loss Functions

Entropy and information can be generalized beyond Shannon's original framework by considering arbitrary loss functions to quantify uncertainty reduction, rather than just message length. This provides a unified perspective on various information-theoretic quantities.