In this thread, I will argue that the conventional wisdom that Shannon's information theory is all about syntax and not about semantics stems from superficial reading. On the contrary, even his 1948 BSTJ paper is already concerned with syntax, semantics, *and* pragmatics. 1/14

Of course, it does not help matters that Shannon himself states that "semantic aspects of communication are irrelevant to the engineering problem" of communication on the first page of his paper. But you have to read the entire paper, not just the first page. 2/14

Let's first pin down the notions of syntax, semantics, and pragmatics in the sense of Charles Morris: syntax is about relation of symbols to other symbols, semantics is about their relation to objects, and pragmatics is about their relation to subjects. 3/14

Let's start with pragmatics. The full formulation of Shannon's theory is concerned with the problem of reliable communication of some state of the world over a noisy medium, subject to a fidelity criterion. This is an operationalist, pragmatist concern. 4/14

We may envision the problem where we take an action U contingent on the state of the world X and incur the cost c(X,U). We cannot access the state of the world directly, but must mediate the act of selecting the action through transmission of symbols over a noisy channel. 5/14