Jethro's Braindump

I-Diagrams

tags
Information Theory

If we view random variables as sets, different information theory concepts can be represented using an information diagram.

Figure 1: Source: Andreas Kirsch | Better intuition for information theory

Figure 1: Source: Andreas Kirsch | Better intuition for information theory

This can be used to visualize more complex expressions.